-- Logs begin at Sun 2022-10-30 00:10:40 UTC, end at Sun 2022-10-30 03:08:21 UTC. -- Oct 30 00:51:16.050542 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 30 00:51:16.057781 n-d-master-1 devstack@keystone.service[82020]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 00:51:16 2022] *** Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: nodename: n-d-master-1 Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: machine: x86_64 Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: clock source: unix Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: pcre jit disabled Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: detected number of CPU cores: 4 Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: current working directory: / Oct 30 00:51:16.059942 n-d-master-1 devstack@keystone.service[82020]: detected binary path: /usr/bin/uwsgi-core Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: your processes number limit is 47680 Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: your memory page size is 4096 bytes Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: detected max file descriptor number: 2048 Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: lock engine: pthread robust mutexes Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: thunder lock: enabled Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 30 00:51:16.060593 n-d-master-1 devstack@keystone.service[82020]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 00:51:16.101740 n-d-master-1 devstack@keystone.service[82020]: Python main interpreter initialized at 0x5562549b79c0 Oct 30 00:51:16.101740 n-d-master-1 devstack@keystone.service[82020]: python threads support enabled Oct 30 00:51:16.101740 n-d-master-1 devstack@keystone.service[82020]: your server socket listen backlog is limited to 100 connections Oct 30 00:51:16.101740 n-d-master-1 devstack@keystone.service[82020]: your mercy for graceful operations on workers is 90 seconds Oct 30 00:51:16.102126 n-d-master-1 devstack@keystone.service[82020]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 00:51:16.102202 n-d-master-1 devstack@keystone.service[82020]: *** Operational MODE: preforking *** Oct 30 00:51:16.102460 n-d-master-1 devstack@keystone.service[82020]: *** uWSGI is running in multiple interpreter mode *** Oct 30 00:51:16.102460 n-d-master-1 devstack@keystone.service[82020]: spawned uWSGI master process (pid: 82020) Oct 30 00:51:16.102663 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 30 00:51:16.103349 n-d-master-1 devstack@keystone.service[82020]: spawned uWSGI worker 1 (pid: 82035, cores: 1) Oct 30 00:51:16.103554 n-d-master-1 devstack@keystone.service[82020]: spawned uWSGI worker 2 (pid: 82036, cores: 1) Oct 30 00:51:16.103700 n-d-master-1 devstack@keystone.service[82020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 00:51:20.395955 n-d-master-1 devstack@keystone.service[82036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:51:20.395955 n-d-master-1 devstack@keystone.service[82036]: from cryptography.utils import int_from_bytes Oct 30 00:51:20.396780 n-d-master-1 devstack@keystone.service[82036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:51:20.396780 n-d-master-1 devstack@keystone.service[82036]: from cryptography.utils import int_from_bytes Oct 30 00:51:20.397144 n-d-master-1 devstack@keystone.service[82035]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:51:20.397144 n-d-master-1 devstack@keystone.service[82035]: from cryptography.utils import int_from_bytes Oct 30 00:51:20.397631 n-d-master-1 devstack@keystone.service[82035]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:51:20.397631 n-d-master-1 devstack@keystone.service[82035]: from cryptography.utils import int_from_bytes Oct 30 00:51:20.446178 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:51:20.446370 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:51:20.446468 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:51:20.446557 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:51:20.446557 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] command line args: [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:51:20.446699 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] command line args: [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:51:20.446775 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:51:20.446853 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:51:20.446931 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ================================================================================ {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:51:20.447008 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ================================================================================ {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:51:20.447186 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] admin_token = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447273 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] admin_token = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447428 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] config_dir = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447518 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] config_dir = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447597 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447667 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447774 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] config_source = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447853 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] config_source = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.447949 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] debug = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448040 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] debug = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448142 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448437 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448577 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448685 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448685 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448880 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.448984 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449081 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449183 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449291 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449439 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449546 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449649 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_config_append = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.449994 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_config_append = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450110 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450217 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450320 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_dir = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450416 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_dir = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450517 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_file = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450618 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_file = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450715 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450831 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.450958 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451040 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451158 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451233 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451354 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451442 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451516 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451640 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451717 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451834 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451918 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.451991 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452107 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452190 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452257 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452321 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452451 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452527 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452643 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452718 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452833 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452914 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.452997 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453085 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453202 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453290 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453491 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453572 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.453970 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454054 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454193 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] publish_errors = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454315 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] publish_errors = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454397 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454474 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454590 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454671 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454756 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454834 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.454956 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.455053 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.455179 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.455259 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.455409 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] standard_threads = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.455496 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] standard_threads = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456150 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456242 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456395 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456474 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456567 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456651 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456723 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] use_journal = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456793 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] use_journal = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456900 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] use_json = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.456980 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] use_json = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457057 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] use_stderr = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457135 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] use_stderr = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457228 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] use_syslog = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457312 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] use_syslog = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457533 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457613 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:51:20.457714 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.457794 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.457950 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458027 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458204 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458287 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458440 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458526 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458688 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458773 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458919 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.458998 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459163 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459241 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459391 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459469 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459633 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459713 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459873 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.459951 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460116 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460199 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460345 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460424 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460587 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460666 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460817 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.460899 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461060 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461139 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461300 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461439 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461562 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461649 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461816 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.461895 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462063 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462139 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462303 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462390 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462536 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462619 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462785 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.462871 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463044 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463196 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463276 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463354 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463525 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463653 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463735 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463816 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.463963 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464043 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464189 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464273 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464419 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464505 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464666 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464750 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464910 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.464993 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465151 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465310 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465413 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465485 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465620 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465698 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465861 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.465952 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466094 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466172 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466335 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466414 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466561 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466647 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466796 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.466879 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467026 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467134 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467252 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467343 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467476 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467555 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467700 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467785 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.467925 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468015 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468155 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468240 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468396 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468486 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468622 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468745 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468854 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.468942 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469078 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469163 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469309 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469449 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469560 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469642 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469801 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.469879 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470026 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470104 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470257 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470346 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470487 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470567 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470718 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470797 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.470948 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.471028 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.471178 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.471287 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.471983 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472061 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472204 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472285 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472434 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472513 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472667 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472755 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472895 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.472975 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473150 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473239 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473400 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473485 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473628 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473738 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473861 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.473968 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474093 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474201 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474356 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474470 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474594 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474675 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474835 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.474912 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475056 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475126 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475289 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475376 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475517 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475596 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475751 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475831 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.475990 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476067 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476222 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476301 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476452 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476545 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476688 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476786 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476918 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.476997 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477157 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477267 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477398 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477476 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477630 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477717 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477858 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.477947 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478089 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478167 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478317 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478396 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478570 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478659 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478803 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.478883 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479045 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479119 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479281 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479367 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479514 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479594 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479747 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479824 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.479978 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480065 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480208 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480294 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480439 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480518 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480664 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480750 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480886 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.480964 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481109 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481187 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481380 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481476 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481573 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481654 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481817 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.481897 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482045 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482132 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482288 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482367 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482520 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482599 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482769 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.482857 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483023 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483102 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483257 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483362 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483482 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.external = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483563 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.external = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483707 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483794 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.483997 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484078 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484224 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484302 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484450 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.password = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484548 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.password = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484673 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] auth.token = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484753 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] auth.token = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484908 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.484987 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485135 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485225 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485393 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485478 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485624 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485704 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485862 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.485949 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486103 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486208 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486370 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486460 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486601 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486740 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.486904 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487034 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487160 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487288 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487417 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487554 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487692 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487823 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.487823 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488063 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488200 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488338 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488470 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488596 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488724 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488852 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.488983 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489188 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489316 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489516 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489639 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489765 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.489905 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490046 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490176 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490303 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490303 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490553 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490692 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490819 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.490945 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491072 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491199 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491326 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491461 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491588 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491715 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491851 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.491979 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492108 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492243 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492409 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492543 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492673 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492801 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.492929 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493069 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493204 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493360 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493439 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493614 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493689 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493763 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493827 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493887 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.493946 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494005 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494063 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494310 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494447 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494581 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494714 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494843 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.494976 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495125 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495255 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495383 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495511 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495638 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495765 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.495901 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496027 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496156 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496284 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496411 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496537 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496673 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496811 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.496939 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497066 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497141 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497268 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497433 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497565 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497693 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497820 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.497947 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498075 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498214 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498345 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498483 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498610 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498754 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.498890 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499019 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499155 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499283 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499372 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499496 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499627 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499753 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.499881 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500008 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500145 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500277 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500413 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500547 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500674 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500801 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.500928 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501053 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501188 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501316 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501471 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501600 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501728 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501855 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.501993 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502129 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502255 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502382 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502535 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502663 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502800 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.502929 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503056 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503183 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503311 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503438 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503575 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503702 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503831 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.503965 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504099 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504227 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504361 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504488 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504622 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504749 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.504876 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505001 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505001 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505247 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505419 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505553 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505553 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505808 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.505808 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506054 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506180 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506306 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506431 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506557 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506694 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506829 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.506960 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507086 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507213 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507296 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507480 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507609 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507738 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507866 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.507994 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508121 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508261 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508387 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508514 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508639 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508767 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.508894 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509029 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509166 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509293 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509430 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509558 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509706 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509847 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.509927 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510000 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510076 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510156 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510236 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510318 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510391 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510464 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510537 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510609 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510681 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510762 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510835 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510908 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.510980 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511100 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511178 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511261 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511335 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511407 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511479 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511552 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511624 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511707 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511781 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511853 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511926 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.511997 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512069 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512213 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512289 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512362 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512435 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512507 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512579 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512660 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512734 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512806 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512878 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.512950 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513022 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513103 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513176 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513248 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513320 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513456 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513547 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513623 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513696 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513768 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513840 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513911 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.513991 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514065 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514137 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514209 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514280 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514351 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514430 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514504 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514576 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514647 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514718 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514790 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514871 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.514945 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515023 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515097 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515170 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515242 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515322 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515396 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] role.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515468 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515539 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] role.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515611 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] role.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515682 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515762 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] role.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515837 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.515980 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516061 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516265 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516351 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516508 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516590 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516747 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516832 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.516988 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517068 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517226 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517307 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517489 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517571 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517716 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517796 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.517956 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.518038 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.518706 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.518793 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.518946 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519026 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519187 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519271 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519431 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519575 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519677 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.519805 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520047 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520127 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520290 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520370 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520531 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520620 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520773 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.520853 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521001 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521127 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521249 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521358 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521506 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521586 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521738 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521818 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.521966 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522062 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522192 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522272 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522418 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522499 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522657 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522746 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522890 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.522970 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523134 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523212 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523367 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523457 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523597 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523678 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523823 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.523903 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524052 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524141 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524280 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524359 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524518 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524597 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524747 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524836 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.524990 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525069 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525225 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525304 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525479 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525573 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525717 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525797 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.525975 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526067 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526194 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526283 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526423 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526502 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526655 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526735 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526867 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.526955 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527110 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527191 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527377 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527538 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527621 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527697 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527807 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.527879 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528063 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528141 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528305 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528376 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.connection = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528543 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528621 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528781 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.528853 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.connection = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529010 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529080 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529245 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529315 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529482 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529553 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529715 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529785 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.529944 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530055 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530173 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530244 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530412 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530481 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530640 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530710 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530879 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.530949 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531108 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531177 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531348 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531418 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531576 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531648 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531816 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.531885 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532040 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532118 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532274 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532344 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532502 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532570 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532664 n-d-master-1 devstack@keystone.service[82035]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82035) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:51:20.532742 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.532966 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:51:20.533136 n-d-master-1 devstack@keystone.service[82036]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:51:20.562423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.562667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.562804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.562953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.563083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.563235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.571323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.571500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.600492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.600709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.601789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.602019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.653375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.653735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.702580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.702810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.703045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.703283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.855576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.855767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.855913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.855997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.856794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.879762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.879984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.880926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.881116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.881186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.881248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.892184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.892448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.905685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.905914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.906875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.907016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.907146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.907290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.907423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82035) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.907554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82036) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 30 00:51:20.923583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.923748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.923882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:51:20.924016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:51:20.924157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.924297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.924427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:51:20.924557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 30 00:51:20.924685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.924824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.924953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.925089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.925249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.925412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.925541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.925670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.934909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.935924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.943231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.943419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.946140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.946363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.946496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.946654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.946785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.946931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.947981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.948902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.949088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.972407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.972718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.973895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.974176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.974261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.974481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.979172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.979456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.979745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.980586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.980872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.981150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.986143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.986429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.987739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.988026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.992161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.992323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:20.992456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.992583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.992713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.992842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.992980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.993944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.994075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:20.994208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.010066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.010261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.010429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.010570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.014152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.014389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.017367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.017650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.017739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.017944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.022409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.022738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.025573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.025877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.028791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.029956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.030108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.030221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.030307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.030527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.046123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.046386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.046472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.046669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.046767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.046935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.047016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.047197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.054359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.054617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.055896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.056154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.057462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.057733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.057818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.058007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.060374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.060637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.060723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.060919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.061876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.073383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.073575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.073662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.073869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.073953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.074221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.074306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.074510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.074623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.075063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.075154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.075350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.075436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.075643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.090937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.091136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.093880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.094060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.096946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.097044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.098411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.098540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.099937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.100029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.100224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.100329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.100583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.100667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.106950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.107067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.108418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.116612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.116612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.116886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.116886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.117012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.117085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.117163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.117227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.117288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.120560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.120671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.120849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.120934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.121127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.121211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.128734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82036) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.129020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.129304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.129569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82035) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 30 00:51:21.129671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.129849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.129946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.130950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.131879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82036) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.132888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.133222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82035) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 30 00:51:21.166161 n-d-master-1 devstack@keystone.service[82035]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5562549b79c0 pid: 82035 (default app) Oct 30 00:51:21.166725 n-d-master-1 devstack@keystone.service[82036]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5562549b79c0 pid: 82036 (default app) Oct 30 00:51:21.169365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09674-f90d-46c9-bfea-5d78c6200e94 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:21.169649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09674-f90d-46c9-bfea-5d78c6200e94 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:21.169917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09674-f90d-46c9-bfea-5d78c6200e94 None None] PATH_INFO: `/v3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:21.174106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Sun Oct 30 00:51:21 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:29.082378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:29.082941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:29.082941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:29.087182 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:29.092287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:29.092832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:29.092832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:29.163379 n-d-master-1 devstack@keystone.service[82035]: INFO dbcounter [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] Registered counter for database keystone Oct 30 00:51:29.184842 n-d-master-1 devstack@keystone.service[82035]: DEBUG oslo_db.sqlalchemy.engines [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82035) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:51:29.191020 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writer thread running {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:51:29.368826 n-d-master-1 devstack@keystone.service[82035]: DEBUG passlib.handlers.bcrypt [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82035) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:51:29.375499 n-d-master-1 devstack@keystone.service[82035]: DEBUG passlib.handlers.bcrypt [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82035) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:51:29.427857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:29.429432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:29.558438 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:51:30.031924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:30.102747 n-d-master-1 devstack@keystone.service[82036]: INFO dbcounter [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] Registered counter for database keystone Oct 30 00:51:30.121853 n-d-master-1 devstack@keystone.service[82036]: DEBUG oslo_db.sqlalchemy.engines [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:51:30.128214 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writer thread running {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:51:30.246739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9df89-1d73-4e5f-8806-0c009dfb798c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:30.251211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:30.251869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.252170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.252444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.260700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:30.313789 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:51:30.314221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6c8e-ffbd-48b3-8102-fe86b52d7c88 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:30.324102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Sun Oct 30 00:51:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 00:51:30.330356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:30.347674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa5a77-ba33-4e4a-b411-d527db6337e2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:30.352708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:30.353841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:30.354123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:30.354402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] PATH_INFO: `/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:30.358170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] RBAC: Authorizing `identity:get_project(project_id=e4f4b3ee17464dd9b78ef48e253d6687)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:30.409350 n-d-master-1 devstack@keystone.service[82035]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 30 00:51:30.409693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7a5cb-19f5-4188-a0bd-d0f50680cb7c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:30.414257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:51:30 2022] GET /identity/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:32.554357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14636c83-b038-4c4a-babb-8c3272ad0db8 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:32.554882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14636c83-b038-4c4a-babb-8c3272ad0db8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:32.554882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14636c83-b038-4c4a-babb-8c3272ad0db8 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:32.558989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:32.564607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:32.564999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:32.565159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:32.585790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:32.587295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:32.595181 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:51:32.860023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14636c83-b038-4c4a-babb-8c3272ad0db8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:32.872282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14636c83-b038-4c4a-babb-8c3272ad0db8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:32.876649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:32.877251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:32.877562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:32.877835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:32.886115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:32.887869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13d884-995c-4aed-8a84-0eb501422315 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:32.897565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Sun Oct 30 00:51:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 00:51:32.903114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:32.912350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff18e5-f3ef-4579-8807-d84ff65a38d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:32.916638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:32.917256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:32.917567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:32.917838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] PATH_INFO: `/v3/users/4a27d1c574be440baaae707174fd41c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:32.919136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] RBAC: Authorizing `identity:get_user(user_id=4a27d1c574be440baaae707174fd41c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:32.920960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3d76a-5327-4f19-bda7-c169696d8129 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:32.922494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Sun Oct 30 00:51:32 2022] GET /identity/v3/users/4a27d1c574be440baaae707174fd41c2 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:35.118217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb85e9-516b-448d-9ff0-a9791400b180 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.118774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb85e9-516b-448d-9ff0-a9791400b180 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.118774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb85e9-516b-448d-9ff0-a9791400b180 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.120109 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:35.125872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.126366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.126464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.144431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:35.145557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:35.216477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda6e0-f7be-4aea-858b-48daf7108b55 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.216759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda6e0-f7be-4aea-858b-48daf7108b55 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.217035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eda6e0-f7be-4aea-858b-48daf7108b55 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.218392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:51:35.223579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.223862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.224740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.228444 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:35.266094 n-d-master-1 devstack@keystone.service[82036]: DEBUG passlib.handlers.bcrypt [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82036) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 30 00:51:35.266468 n-d-master-1 devstack@keystone.service[82036]: DEBUG passlib.handlers.bcrypt [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82036) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 30 00:51:35.316073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:35.317771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:35.418834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:51:35.496501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.520444 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:35.601829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f5aef-8878-4155-9377-1753bfd39edb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:35.634825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:35.635444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.635721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.635991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.647330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:35.656150 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:35.657094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.657970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:51:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:35.663651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.689050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.765422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e72f9d-7248-466f-89f5-5ff87ce5ee09 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:35.767743 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:35.770627 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:35.789193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff23c4-8f86-45fd-a744-d568977da6f8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:35.803319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:35.804346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.804627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.804903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.805782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:35.806087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:35.807524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:35.819642 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:35.823726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:35.824371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.824672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.824950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.825216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.826703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:35.827425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:35.871964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.sql.core [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:51:35.871964 n-d-master-1 devstack@keystone.service[82035]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:51:35.871964 n-d-master-1 devstack@keystone.service[82035]: [parameters: {'id': 'dd2bd8d7a00c49098823a15e7fb64401', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:51:35.871964 n-d-master-1 devstack@keystone.service[82035]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82035) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:51:35.889594 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:51:35.890522 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application yield resource Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise self.value Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application session.commit() Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:51:35.891430 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:51:35.892261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:51:35.893209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:51:35.893975 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [parameters: {'id': 'dd2bd8d7a00c49098823a15e7fb64401', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:51:35.894798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:35.896033 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 8/16] 10.222.0.13 () {60 vars in 1137 bytes} [Sun Oct 30 00:51:35 2022] POST /identity/v3/domains => generated 190 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:35.896878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.933592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2878d1-f5f0-4343-a2d7-4fdc2946f199 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:35.967712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:35.968492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:35.968798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:35.969079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] PATH_INFO: `/v3/users/4a27d1c574be440baaae707174fd41c2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:35.970594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] RBAC: Authorizing `identity:get_user(user_id=4a27d1c574be440baaae707174fd41c2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:35.972061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:35.973695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:35 2022] GET /identity/v3/users/4a27d1c574be440baaae707174fd41c2 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:51:35.979770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:35.996918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd6d23-c136-48a3-bde2-cb7e3f0ef216 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:36.012934 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:36.031086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:36.031719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:36.032003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:36.032272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:36.043104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:36.044634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:36.053752 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:51:36.062289 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:36.063145 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:51:36.063961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:51:36.063961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:51:36.063961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:36.063961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:51:36.069412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:36.079861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7460-6292-4d31-82aa-9f5d3bd57a3b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:36.115068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:36.115699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:36.115982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:36.116259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:36.117416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:36.118895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:36.120475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:51:36.126126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:36.170044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11b4f-52e3-4511-a847-cf8399e974ca None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:36.203447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:36.208999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76848f80-8eef-4864-983c-62fa07a7dd8d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:36.225458 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:51:36.226172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564691eb-3478-485a-8d28-28e9e39689f3 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:36.227835 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:36.266049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:36.266718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:36.266996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:36.267268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] PATH_INFO: `/v3/domains/default/users/4a27d1c574be440baaae707174fd41c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:36.269233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4a27d1c574be440baaae707174fd41c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:36.270724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c1a0b-4b5d-47a5-a4ed-d1c3a54e1885 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:36.471935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Sun Oct 30 00:51:36 2022] PUT /identity/v3/domains/default/users/4a27d1c574be440baaae707174fd41c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:51:39.021494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f9a2-b065-4d93-8fd2-0f4f15347049 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.022495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f9a2-b065-4d93-8fd2-0f4f15347049 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.022978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f9a2-b065-4d93-8fd2-0f4f15347049 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.024837 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:39.035520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae6b7-bcf5-452d-8ec2-bf0d7bbc2798 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.036017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae6b7-bcf5-452d-8ec2-bf0d7bbc2798 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.036092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae6b7-bcf5-452d-8ec2-bf0d7bbc2798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.067163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d56ae6b7-bcf5-452d-8ec2-bf0d7bbc2798 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:39.069233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d56ae6b7-bcf5-452d-8ec2-bf0d7bbc2798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:39.104540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a8ab-ed80-4bb3-a79b-400cc8c434a2 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.105168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a8ab-ed80-4bb3-a79b-400cc8c434a2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.105659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a8ab-ed80-4bb3-a79b-400cc8c434a2 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.107166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 12/23] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:51:39.113322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356dae2-3b5a-4a63-869b-e18b49fd5356 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.113847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356dae2-3b5a-4a63-869b-e18b49fd5356 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.114351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356dae2-3b5a-4a63-869b-e18b49fd5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.146473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6356dae2-3b5a-4a63-869b-e18b49fd5356 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:39.147999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6356dae2-3b5a-4a63-869b-e18b49fd5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:39.183413 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 12/24] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:39.246115 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:39.273781 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:51:39.399773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebef0-565d-4d1c-86b8-1955bb41ca15 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.400373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebef0-565d-4d1c-86b8-1955bb41ca15 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.400846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ebef0-565d-4d1c-86b8-1955bb41ca15 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.406053 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 13/26] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:39.411910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.416498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.416498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.433908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:39.435393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:39.523024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:39.699538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ebef0-565d-4d1c-86b8-1955bb41ca15 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:39.766956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:39.810375 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:39.831112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ebef0-565d-4d1c-86b8-1955bb41ca15 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:39.882658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:39.883308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.883588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.883860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.905822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-f9094864-daa0-47a1-84cf-98b2fd4753ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:39.919946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:39.920849 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:39.921673 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:39.928548 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 14/28] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:39.929964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7839e-a813-40d5-bdac-83355f7dc173 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:39.930251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7839e-a813-40d5-bdac-83355f7dc173 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:39.930694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7839e-a813-40d5-bdac-83355f7dc173 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:39.933106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 15/29] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:39.933615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7839e-a813-40d5-bdac-83355f7dc173 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:39.970571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2f0e1-f7ad-4004-97c9-1ce5d2d8a226 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:39.993516 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.016361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.016983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.017262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.017750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.018458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.020941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdce0-05c1-498c-9ab3-9ee3d8cf32b0 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.061884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7839e-a813-40d5-bdac-83355f7dc173 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.098174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.098792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.099077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.099920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.100610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:40.100909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.102682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.117578 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 16/30] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:40.117578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.135824 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.222748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edb3d-9c9a-439e-a4cf-68e763b5ebf8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.225790 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 15/31] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 30 00:51:39 2022] POST /identity/v3/roles => generated 219 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:51:40.227856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e974-356f-4a0b-b844-af6cf862d530 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.228361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e974-356f-4a0b-b844-af6cf862d530 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.228869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5e974-356f-4a0b-b844-af6cf862d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.251782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7ef5e974-356f-4a0b-b844-af6cf862d530 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:40.254058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7ef5e974-356f-4a0b-b844-af6cf862d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:40.272106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.272772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.273055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.273371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.300944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.302895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:51:40.332521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:40.333600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:51:40.334979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:51:40.334979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:51:40.334979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:40.334979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 17/32] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:40.335200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.355859 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 16/33] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:40.355859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c63ce-1e39-40d4-bcd4-69b7a011a891 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.355859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c63ce-1e39-40d4-bcd4-69b7a011a891 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.355859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c63ce-1e39-40d4-bcd4-69b7a011a891 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.356938 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 17/34] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:40.359388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c63ce-1e39-40d4-bcd4-69b7a011a891 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.447065 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.496460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554054-2070-4d7d-ac15-958ecb2320b7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.516758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c63ce-1e39-40d4-bcd4-69b7a011a891 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.530754 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.547173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.547808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.548093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.548426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] PATH_INFO: `/v3/users/4a27d1c574be440baaae707174fd41c2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.549664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] RBAC: Authorizing `identity:get_user(user_id=4a27d1c574be440baaae707174fd41c2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.551169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f36cc-9a21-482d-b928-93951bcda6ff None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.552954 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 18/35] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:40 2022] GET /identity/v3/users/4a27d1c574be440baaae707174fd41c2 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:40.558339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.558339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.558339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.561381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.562061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.562434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.562850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.563870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:40.564691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.569075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a5495-bf8e-441a-ac1f-3041b68d9997 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.576840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:40.585578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:40.585698 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 18/36] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:40.585698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f9431-13da-4d1e-8717-ab09921f3c4d None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.585698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f9431-13da-4d1e-8717-ab09921f3c4d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.585698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f9431-13da-4d1e-8717-ab09921f3c4d None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.585698 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 19/37] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:40.588920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f9431-13da-4d1e-8717-ab09921f3c4d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.659478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 19/38] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:40.660453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.708740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f9431-13da-4d1e-8717-ab09921f3c4d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.725470 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.758928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.759942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.760616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.760988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.762370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.763830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1a22c-5cd6-4122-a194-4258e641463e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.765172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521fa9e-83da-4bdf-bcff-eefd59e9b7a2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:40.770153 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 20/39] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:40.771269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.771555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.771829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.790243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:40.791468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:40.802004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:40.803529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:40.803882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:40.804224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:40.804937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:40.806615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:40.823248 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:40.863166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 21/40] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:40.863962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.917262 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:51:40 2022] POST /identity/v3/projects => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:40.924230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:40.990363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d3047-afba-45a8-9114-ed089a8f2e97 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.030748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.031705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.032192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.032604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.033521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.035779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.065215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d761-8415-44f3-ae0d-0161162fe99a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.086149 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:41.104477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.105099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.105410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.105746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.106490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.domain.id=default, user.id=4a27d1c574be440baaae707174fd41c2) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:41.106794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.108248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.117023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1322 bytes} [Sun Oct 30 00:51:40 2022] GET /identity/v3/role_assignments?user.id=4a27d1c574be440baaae707174fd41c2&scope.domain.id=default&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 530 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:41.117857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:41.134736 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 22/43] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 30 00:51:40 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:41.147632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:41.188393 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:41.261035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952e51f-22e5-4bb9-99c9-4658f6bdb339 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.307913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.308618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.308977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.309327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.310181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.311712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.410933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5a33b-cd7f-4884-9f49-422f04a6c396 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.419576 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 30 00:51:41 2022] POST /identity/v3/roles => generated 223 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:41.451466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.452116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.452396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.452686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.453855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.455420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd006066-1b01-4bb6-8362-c0840eb77649 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.457043 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:41.463645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:41.510594 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:41.572496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa58640-f578-4693-936c-840cfcc0d410 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:41.609257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:41.609993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:41.610280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:41.610556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:41.611210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:41.612665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0962f52-e43b-49aa-a530-66b20864ab0e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:41.719225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:51:41 2022] POST /identity/v3/projects => generated 312 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:43.862876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe4a-befa-4675-af4e-35d728b19671 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:43.863433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe4a-befa-4675-af4e-35d728b19671 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:43.863433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe4a-befa-4675-af4e-35d728b19671 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:43.864733 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:43.870404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:43.870806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:43.870946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:43.889062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:43.890282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:43.955031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:44.222908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fe4a-befa-4675-af4e-35d728b19671 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:44.315403 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:44.323165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fe4a-befa-4675-af4e-35d728b19671 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:44.355395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:44.356057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:44.356339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:44.356611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:44.357938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:44.360001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe7072-4a1f-4d2f-802d-5bed3402d394 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:44.361679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:44.367977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:44.392063 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:44.466220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb2332-1d4c-456f-a1d7-36fbbfd3220c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:44.499002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:44.499544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:44.499899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:44.500417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:44.501287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:44.503436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafb5a5-f37c-4cd3-8528-4fc98e7e7699 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:44.599682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1140 bytes} [Sun Oct 30 00:51:44 2022] POST /identity/v3/projects => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:46.733715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a30b-3230-40c3-af56-7de29459c044 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:46.734252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a30b-3230-40c3-af56-7de29459c044 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:46.734338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6a30b-3230-40c3-af56-7de29459c044 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:46.735913 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:46.741585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:46.742054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:46.742140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:46.760424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:46.761656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:46.831644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:47.100566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6a30b-3230-40c3-af56-7de29459c044 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:47.202539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6a30b-3230-40c3-af56-7de29459c044 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:47.236258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:47.236881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:47.237165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:47.237468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:47.238582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:47.240543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef7ded-8a99-4d6d-b7a6-013694116b06 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:47.242120 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:47.247827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:47.250910 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:47.450432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd642b83-03ba-4ebe-8f72-124e20375428 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:47.482652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:47.483285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:47.483565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:47.483836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:47.484486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:47.485938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7f49e-9ccc-4b04-9075-93aadf825cef None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:47.576119 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 27/54] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:51:47 2022] POST /identity/v3/users => generated 275 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:50.781188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce3c-bd83-47d7-996f-7be1f2b81d5a None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:50.781737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce3c-bd83-47d7-996f-7be1f2b81d5a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:50.781737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdce3c-bd83-47d7-996f-7be1f2b81d5a None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:50.783100 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 28/55] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:50.789187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b233b-14fe-495a-8fe3-8b35e228fdc0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:50.790079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b233b-14fe-495a-8fe3-8b35e228fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:50.790594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b233b-14fe-495a-8fe3-8b35e228fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:50.818840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e4b233b-14fe-495a-8fe3-8b35e228fdc0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:50.820401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e4b233b-14fe-495a-8fe3-8b35e228fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:50.905887 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:50.919078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:51.065381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574499-f1bf-4f11-a284-5fede2b6f6ed None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.065978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574499-f1bf-4f11-a284-5fede2b6f6ed None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.066466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574499-f1bf-4f11-a284-5fede2b6f6ed None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.068002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 29/57] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:51.074112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba84ca-f873-4190-bb54-2eaa73342cc6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.074627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba84ca-f873-4190-bb54-2eaa73342cc6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.075095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba84ca-f873-4190-bb54-2eaa73342cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.093961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-80ba84ca-f873-4190-bb54-2eaa73342cc6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:51.095979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e29c6-bff9-4cb5-b07a-af94166c3b2d None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.096459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e29c6-bff9-4cb5-b07a-af94166c3b2d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.096920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e29c6-bff9-4cb5-b07a-af94166c3b2d None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.098722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 30/58] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:51.100278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80ba84ca-f873-4190-bb54-2eaa73342cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:51.103286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.103807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.104275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.133358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:51.136021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:51.180952 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:51.243329 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 29/59] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:51.249358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6118-ab03-420c-a0d5-26c9543d907d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.249358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6118-ab03-420c-a0d5-26c9543d907d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.249358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6118-ab03-420c-a0d5-26c9543d907d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.249358 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 30/60] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:51.251785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.252091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.252394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.254418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 31/61] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:51:51.294420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:51.295611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:51.375986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.404262 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:51:51.519359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b5cb-f7fd-438c-9428-95835647fa73 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:51.542611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.556257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:51.556895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.557175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.557482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.573433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:51.581471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:51.582324 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:51.583169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:51.583760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 32/63] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:51:51.584955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.608988 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:51.618048 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:51.663653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb9418-c844-42da-b47f-e7688ab844f5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:51.715875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:51.716526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.716807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.717092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.717285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a47bb5-16b7-4c55-9c03-7cea38678349 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:51.731547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:51.738748 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:51.739606 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:51:51.740946 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:51.745411 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 32/64] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:51:51.746525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.762460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:51.763187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.763473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.763745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.774713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:51.780003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:51.780861 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 33/65] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:51.782098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.864643 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:51.866364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba0d4f-2a08-4399-b5b2-e0b54c153ad6 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:51.876420 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:51.884476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3d804-c83e-4320-89ce-b62391606e7d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:51.903327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:51.903931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.904210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.904480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.905141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] RBAC: Adding query filter params (name=member) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:51.905483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:51.906860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:51.915934 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 33/66] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:51.916650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:51.923667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:51.924258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:51.924542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:51.924812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:51.925520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:51.925823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:51.927203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:51.939249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 34/67] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:51.940140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.018830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ba3d9-3a5e-435d-a8ed-a1e9ac78fa46 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.038855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fff068-1a63-472e-abf1-9d60e4ddd922 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.054731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.055349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.055627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.055901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.065858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-7a27737c-c4ef-480a-b0a8-5dae43ecab77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:52.070665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:52.071728 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:52.072605 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 34/68] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:52.073272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290d70-9061-4b65-b964-a58ca9ae494d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.073272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290d70-9061-4b65-b964-a58ca9ae494d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.073838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95290d70-9061-4b65-b964-a58ca9ae494d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.074248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.077463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 35/69] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:52.077580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.077580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.077580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.077781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95290d70-9061-4b65-b964-a58ca9ae494d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.077847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:52.077847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.078234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.091550 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.091550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.091550 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.115888 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.186413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95290d70-9061-4b65-b964-a58ca9ae494d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.190310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aeeb7-be34-40c7-9a25-dff3bbb56cbf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.221077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.221729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.222008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.222279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.226223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.226845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.227124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.227397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.236887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.238360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.239989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.240553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.242115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba003b0-8b79-4110-bbe9-2e85e6067685 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.242239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.243844 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.246607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.246892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.247167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.265205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:52.266448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:52.322491 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.330682 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.332619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:52.341483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.349225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92205b-bd7b-4689-a919-8f666c4e2dea None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.384677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.385399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.385796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.386072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.386867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] RBAC: Adding query filter params (name=member) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:52.387170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.388540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.398252 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.402183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.435513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831d7c4-e811-4f49-b914-ce1c960483af None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.471430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.472228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.472510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.472839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] PATH_INFO: `/v3/users/4a27d1c574be440baaae707174fd41c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.474816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] RBAC: Authorizing `identity:get_user(user_id=4a27d1c574be440baaae707174fd41c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.476266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.477881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/users/4a27d1c574be440baaae707174fd41c2 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.478722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.512429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02f84b-18de-47cb-801f-009467e4583d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.538925 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.548050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.548854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.549196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.549492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.551117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.559700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.559700 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.559700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.584436 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.595924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed425f2-9e05-4ae2-b2fb-180c357a060f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.630628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.631816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.632089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.632359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.633545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.634977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.636604 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.637383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.666605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d968b9-da0d-4753-a73c-ada7d2a7a581 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.700680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.701585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.701862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.702137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.703269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.704695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.706563 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 39/78] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.707016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.741133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf25764-c730-4e37-9d5b-84d2ca76d059 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.767491 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.775120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.778367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.778367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.778367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.778367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.778928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.780629 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 40/79] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.781402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.792898 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:52.805826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f710-1151-44a7-b9ef-02902855ad06 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.842511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.843181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.843471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.843748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/37059a78252546879c642c5d24d5fd1b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.845784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, user_id=37059a78252546879c642c5d24d5fd1b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.847261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.885216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f23e-c4b3-49cd-8b98-048bc9068221 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:52.918878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:52.919744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:52.920239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:52.920374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:52.921450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:52.922929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:52.923939 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 40/80] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:51:52 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/37059a78252546879c642c5d24d5fd1b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:52.924718 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 41/81] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:52.924821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:52.926192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:53.000884 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:53.046535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08ab7b-69a9-4cfd-a246-7193ba8d8cd0 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.064309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66769f3-96eb-432e-9033-c556b399d4e9 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.088013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.088661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.088943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.089220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] PATH_INFO: `/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.090476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] RBAC: Authorizing `identity:get_project(project_id=dc84b3cb5a22407084c0d6996fa21f7d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.091961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.093683 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 42/82] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:52 2022] GET /identity/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:53.094425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:53.112323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.112983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.113271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.113600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/37059a78252546879c642c5d24d5fd1b/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.116345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, user_id=37059a78252546879c642c5d24d5fd1b, role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.117939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.202150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c0ea-b1ad-4e99-9378-d39112db4bfe None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.232557 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:53.237916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.238573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.238859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.239133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/4a27d1c574be440baaae707174fd41c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.240649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:51:52 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/37059a78252546879c642c5d24d5fd1b/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:53.241732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:53.250554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, user_id=4a27d1c574be440baaae707174fd41c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.253836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.264093 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:53.363737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405ba9e-d686-4b50-9497-767f5186fcfd None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.405708 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:51:53 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/4a27d1c574be440baaae707174fd41c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:53.406636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:53.407041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.407977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.408637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.409113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.411518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.414191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a60849-707c-4dfb-8339-35e00cc49156 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.513520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 42/85] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:51:53 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:53.552048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c36a-7986-43ed-8faf-7a74d4fc7a51 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:53.597240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:53.597991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:53.598278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:53.598556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] PATH_INFO: `/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d/users/37059a78252546879c642c5d24d5fd1b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:53.607114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc84b3cb5a22407084c0d6996fa21f7d, user_id=37059a78252546879c642c5d24d5fd1b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:53.608738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3794f-fceb-4a80-b906-568fae51158a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:53.703021 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:51:53 2022] PUT /identity/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d/users/37059a78252546879c642c5d24d5fd1b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:51:55.392012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e96f8-3a4a-4c50-96dc-2f33618ce3ea None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:55.392538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e96f8-3a4a-4c50-96dc-2f33618ce3ea None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:55.392538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e96f8-3a4a-4c50-96dc-2f33618ce3ea None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:55.393965 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:55.400304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:55.400758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:55.400860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:55.434390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:55.435595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:55.487414 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:55.508892 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:55.982825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e96f8-3a4a-4c50-96dc-2f33618ce3ea None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.057391 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:56.102168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e96f8-3a4a-4c50-96dc-2f33618ce3ea None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:56.152310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:56.152886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.153169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.153473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.168425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-e8b0b434-90ec-452e-b6aa-7f9a4bcb6de1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:56.175337 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:56.176216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:56.177009 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 44/89] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:56.184758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.196246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebe65-fede-47ca-b1e3-35aa63f84581 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.196536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebe65-fede-47ca-b1e3-35aa63f84581 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.196810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ebe65-fede-47ca-b1e3-35aa63f84581 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.198175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 45/90] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:56.204324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f47-dcf3-484a-bc6d-41123bd1a8d1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.204602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f47-dcf3-484a-bc6d-41123bd1a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.205408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b5f47-dcf3-484a-bc6d-41123bd1a8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.238766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1a2b5f47-dcf3-484a-bc6d-41123bd1a8d1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:56.239972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a2b5f47-dcf3-484a-bc6d-41123bd1a8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:56.327988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569eab5-7dea-4e35-930c-6d3cb15c670b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:56.379900 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:56.381275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f523cf-9a04-43eb-a21c-1ec967c39d7f None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.381591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f523cf-9a04-43eb-a21c-1ec967c39d7f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.381869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f523cf-9a04-43eb-a21c-1ec967c39d7f None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.383414 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 47/92] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:56.389087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.389392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.389668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.409214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:56.410247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:56.410633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:56.414401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:56.432404 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 46/93] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:56.437934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.483369 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:56.485998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 48/94] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:51:56.524642 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:56.583570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba55419-d0f4-4d91-98ee-4b50aab8a7b9 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:56.625003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:56.625676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.626031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.626308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.627512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:56.629010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:56.630631 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 47/95] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:56 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:51:56.636402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.752310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d3b5d-af53-49f4-91c3-b1a9aa3b6b00 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:56.789942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:56.790564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:56.790844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:56.791118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:56.814433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.862543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:56.864115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:56.880433 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:56.982873 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 49/96] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:56.984026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:56.995677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b4451-631b-4642-af52-d7f1772f8139 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.010902 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.035198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.035838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.036164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.036626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.048877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-326da041-f875-45a6-833b-0bcf970c2dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:57.054814 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:57.055943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:51:57.056871 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:57.058775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 48/97] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:57.060310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee088a-85c0-465b-a771-73ed899f1a1a None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.060723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee088a-85c0-465b-a771-73ed899f1a1a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.061138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee088a-85c0-465b-a771-73ed899f1a1a None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.062551 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 49/98] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:57.063510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee088a-85c0-465b-a771-73ed899f1a1a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.081213 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.105718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d90057-c77b-4c7c-b512-f75a7e00f0f3 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.142804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.143563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.143969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.144308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.157231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:57.163222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:57.164305 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:51:57.165280 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:51:57.171535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 50/99] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:57.172507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.208982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee088a-85c0-465b-a771-73ed899f1a1a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.246395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.247120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.247469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.247805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.249098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.250695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72533d47-1aaa-4779-9191-6dfe8810a973 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.252519 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 50/100] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.258948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.259300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.259643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.285355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:57.286645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:57.306629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172ef4-683d-47a3-b235-562e0d3523c8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.329758 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.348918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.349561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.350396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.350669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.351335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:57.351636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.353838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.363102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 51/101] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.364070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.371798 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 51/102] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:57.372656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.379293 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.490626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635ba9-d661-4017-87c4-91d283b70ab0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.493669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd4fc4-62d6-4180-9d8e-1792aace50dd None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.528210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.529112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.529421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.529843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.530707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] RBAC: Adding query filter params (role.id=0586b2548ccb452b89a7c40125c21137, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db, user.id=37059a78252546879c642c5d24d5fd1b) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:57.531149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.532047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.532749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.533075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.533184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.533612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.534370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:57.534827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.536498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f1be-0ead-4338-9bbd-6fd53bb1596b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.541599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 52/103] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/role_assignments?user.id=37059a78252546879c642c5d24d5fd1b&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=0586b2548ccb452b89a7c40125c21137 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.542655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.545879 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 52/104] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.547450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461372-7762-43d5-b13e-ea98cad116bb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.547979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461372-7762-43d5-b13e-ea98cad116bb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.548359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461372-7762-43d5-b13e-ea98cad116bb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.549793 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 53/105] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:57.554867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461372-7762-43d5-b13e-ea98cad116bb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.606680 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.638307 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.682865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461372-7762-43d5-b13e-ea98cad116bb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.706348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb5fa8-5f9a-45ef-90f4-df766fd9cfb7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.722049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.723052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.723517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.723968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] PATH_INFO: `/v3/users/4a27d1c574be440baaae707174fd41c2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.725968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] RBAC: Authorizing `identity:get_user(user_id=4a27d1c574be440baaae707174fd41c2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.727737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b91196-23a0-4efb-bcf7-60f21c33c836 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.729726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 54/106] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/users/4a27d1c574be440baaae707174fd41c2 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.731387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.731626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.731899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.750302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.750940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.751223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.751499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.751907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:57.753157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:57.753408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:57.755035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc60fa4-805f-4678-90e5-e3d0a52f6b51 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:57.756600 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 53/107] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:57.757775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5eb8b-12d3-4396-a445-fe2c116a1d9e None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.758056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5eb8b-12d3-4396-a445-fe2c116a1d9e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.758393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5eb8b-12d3-4396-a445-fe2c116a1d9e None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.759694 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 54/108] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:51:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:51:57.760300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5eb8b-12d3-4396-a445-fe2c116a1d9e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.827510 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 55/109] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:57.828330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.880328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5eb8b-12d3-4396-a445-fe2c116a1d9e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.882968 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.906697 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.917058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.917726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.918076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.918349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:57.929410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:57.934499 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:57.937521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 55/110] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:57.938294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:57.947403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808d639-4bcf-4276-9f79-20cb704428d2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:57.987819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:57.988797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:57.989085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:57.989400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.052924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fa39c-99b2-409f-9f7f-ba3a8f89e366 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.062578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.064035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017315f-c5bb-4a07-95e4-48439dc428a7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.089321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.090160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.090439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.090715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.122347 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.127497 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.160347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.161842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.162457 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 56/111] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:58.163945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.164234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.165354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.184981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:51:58.186207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:51:58.254458 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 57/112] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:51:58.255667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.263953 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 56/113] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:58.266607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.333294 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.356941 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.362578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16c1b-7571-4597-9cb5-914127b61f9a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.372773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0175-a1c8-4361-bd29-9dc02cee9309 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.398604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.399751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.400104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.400892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.401587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] RBAC: Adding query filter params (name=member) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:58.401894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.403479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.408480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.409115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.409425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.409699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.412725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 58/114] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.413821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.424696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:51:58.429636 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:51:58.430595 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:51:58.431397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 57/115] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:51:58.432160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.534413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049047a-9f35-4852-a2bd-db9cabde0684 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.541749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e59bdc-fcd5-4adc-83a9-5351bc588bbc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.565212 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.570940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.571602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.571980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.572153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.573297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.577415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.577415 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 59/116] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.577596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.577671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.578250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.578530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.578801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.579930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.582324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.587707 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 58/117] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.587707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.606563 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.679150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24043967-554b-43ba-a604-6a5f5605798d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.686908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a6c70-4219-484a-bb23-95a85d35c6fb None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.713742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.714377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.714664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.714942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] PATH_INFO: `/v3/users/37059a78252546879c642c5d24d5fd1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.716074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] RBAC: Authorizing `identity:get_user(user_id=37059a78252546879c642c5d24d5fd1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.717551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.719152 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 60/118] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/users/37059a78252546879c642c5d24d5fd1b => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.723702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.723799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.723799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.723799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.723799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.724124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:58.724124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.724264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.732875 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 59/119] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.734353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.786915 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.813577 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:58.820585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a72cd-2ecf-401c-9b59-d9f7baedbba1 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.833949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49520121-9605-48be-b1fb-a9b13deecc51 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:58.853126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.853772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.854054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.854355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.855582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.857326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.861432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 61/120] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.861432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.872743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:58.873373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:58.873664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:58.873939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:58.874666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db, user.id=4a27d1c574be440baaae707174fd41c2) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:58.874974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:58.876427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:58.882316 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 60/121] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/role_assignments?user.id=4a27d1c574be440baaae707174fd41c2&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:58.883104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:58.981273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546d4ab-dc4b-4d1f-8995-68253c01cd36 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.000548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e564ad-bba5-41d9-b65d-8587535a3640 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.018531 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.022391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.023023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.023305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.023586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.024340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] RBAC: Adding query filter params (role.id=70e1716c5bc64e81b540ed4c9a71f126, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db, user.id=37059a78252546879c642c5d24d5fd1b) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:59.024650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.026284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.033373 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 62/122] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/role_assignments?user.id=37059a78252546879c642c5d24d5fd1b&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=70e1716c5bc64e81b540ed4c9a71f126 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:59.033833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.057718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.057718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.057718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.057718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.077585 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.164534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.166295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.185699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15167b6-d89d-4ad3-8e86-d1ea17281a7d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.232041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.232041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.232041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.232041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] PATH_INFO: `/v3/users/5780448ffe4f429eb06c91aa8e18ac86` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.248276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5780448ffe4f429eb06c91aa8e18ac86)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.249769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.251458 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 63/123] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:51:59 2022] GET /identity/v3/users/5780448ffe4f429eb06c91aa8e18ac86 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:59.252214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.291052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 61/124] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:59.295928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.309069 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.350612 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.366389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13643d77-ebed-4b62-97ad-15bcf384f8b5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.388541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bea956-5462-4b8a-8a3f-f8703e0cf949 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.400139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.400742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.401025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.401323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.402000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.403435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.420942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.421627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.421906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.422178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.423285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.424744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.426394 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:59 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:59.427148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.497851 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 64/126] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:51:59 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:51:59.510644 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.514527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.530636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf15aa-e5c4-4271-a6c8-8437547ce951 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.569611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.570463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.570563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.570969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] PATH_INFO: `/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.572199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] RBAC: Authorizing `identity:get_project(project_id=dc84b3cb5a22407084c0d6996fa21f7d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.573704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.575864 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 63/127] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:51:59 2022] GET /identity/v3/projects/dc84b3cb5a22407084c0d6996fa21f7d => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:51:59.582090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:51:59.632061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c563a3-662f-460f-8f15-bdb904810366 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.670295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.671183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.671282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.671491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/5780448ffe4f429eb06c91aa8e18ac86/roles/fe33f3768d5a4a48a0cf00bc0aa28de5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.673452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, user_id=5780448ffe4f429eb06c91aa8e18ac86, role_id=fe33f3768d5a4a48a0cf00bc0aa28de5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.674916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf820b-c539-46e9-b898-0c154f7a39c9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.679469 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:59.696932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fee7a1-d338-45de-8e8c-a824b326cd96 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:51:59.731556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:51:59.732190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:51:59.732472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:51:59.732746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:51:59.733517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] RBAC: Adding query filter params (role.id=0586b2548ccb452b89a7c40125c21137, scope.project.id=dc84b3cb5a22407084c0d6996fa21f7d, user.id=37059a78252546879c642c5d24d5fd1b) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:51:59.733818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:51:59.735317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5193b3-cc04-4449-b5ed-1ba502e82dd0 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:51:59.741653 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 64/128] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:51:59 2022] GET /identity/v3/role_assignments?user.id=37059a78252546879c642c5d24d5fd1b&scope.project.id=dc84b3cb5a22407084c0d6996fa21f7d&role.id=0586b2548ccb452b89a7c40125c21137 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:51:59.758639 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 65/129] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:51:59 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/users/5780448ffe4f429eb06c91aa8e18ac86/roles/fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:01.691816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001e48-530b-4cf0-ab8b-48519ef4ba1f None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:01.692366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001e48-530b-4cf0-ab8b-48519ef4ba1f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:01.692366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf001e48-530b-4cf0-ab8b-48519ef4ba1f None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:01.694283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 65/130] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:01.699384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472fdbb-2064-4efe-bd13-3faa1e4afc08 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:01.699825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472fdbb-2064-4efe-bd13-3faa1e4afc08 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:01.699937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472fdbb-2064-4efe-bd13-3faa1e4afc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:01.718468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8472fdbb-2064-4efe-bd13-3faa1e4afc08 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:01.719646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8472fdbb-2064-4efe-bd13-3faa1e4afc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:01.783673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 66/131] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:01.914979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a4e14-f8b2-400d-8389-e14db34afce5 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:01.915270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a4e14-f8b2-400d-8389-e14db34afce5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:01.915547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a4e14-f8b2-400d-8389-e14db34afce5 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:01.916895 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 66/132] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:01.922094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:01.922396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:01.922662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:01.941001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:01.942250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:02.006914 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 67/133] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:02.058077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a4e14-f8b2-400d-8389-e14db34afce5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.076858 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:02.159810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a4e14-f8b2-400d-8389-e14db34afce5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.193215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.193833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.194114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.194385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:02.195484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:02.196927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:02.198503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 67/134] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:02.204416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.259537 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:02.273317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.303378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef349e-01c4-4135-b787-cc40045f842b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.337345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.337974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.338257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.338529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:02.339179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:02.340605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:02.356592 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:02.371603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb263a-867d-4567-bdfa-7f9d27af41ae None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.403703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.404316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.404594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.404859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:02.416136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:02.420910 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:02.421932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:02.422807 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 68/135] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:02.427850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.496812 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 68/136] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:02 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:02.528255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf44d0a-6b58-458e-ae33-d6c2d987eb67 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.566110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.566750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.567035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.567309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:02.568003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:02.568367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:02.570448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:02.580188 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 69/137] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:02.586289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.692492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce954f86-a8b0-4900-8c34-98e3bf36318f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.705674 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:02.726756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.727395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.727678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.727954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] PATH_INFO: `/v3/users/5780448ffe4f429eb06c91aa8e18ac86` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:02.729095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] RBAC: Authorizing `identity:get_user(user_id=5780448ffe4f429eb06c91aa8e18ac86)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:02.730642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:02.733715 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 69/138] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:02 2022] GET /identity/v3/users/5780448ffe4f429eb06c91aa8e18ac86 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:02.738080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:02.748439 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:02.906231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec4-4ac4-482f-b112-8528512127dc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:02.947907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:02.948520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:02.948802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:02.949074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:03.028026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:03.029445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:03.038707 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:03.134920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:03.140851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:03.245964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf26c40-bfdf-4d9b-b6a4-9d8578476020 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:03.281126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:03.281705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:03.281983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:03.282257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:03.283379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:03.284809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc39dac-c7d6-4b45-b736-009053144aca None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:03.286483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 70/140] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:03 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:03.293265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:03.400218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b59f4-e22c-435a-b024-0ea2ba48ca8a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:03.408721 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:03.436062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:03.436675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:03.436952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:03.437222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:03.438040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] RBAC: Adding query filter params (role.id=fe33f3768d5a4a48a0cf00bc0aa28de5, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db, user.id=5780448ffe4f429eb06c91aa8e18ac86) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:03.438375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:03.439838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3169e6-30ae-4018-9d88-18e3945531e8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:03.453515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 71/141] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:03 2022] GET /identity/v3/role_assignments?user.id=5780448ffe4f429eb06c91aa8e18ac86&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:04.801871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a12e0-523a-40ba-9e7f-36d4079ec6af None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:04.802437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a12e0-523a-40ba-9e7f-36d4079ec6af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:04.802437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a12e0-523a-40ba-9e7f-36d4079ec6af None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:04.804099 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 71/142] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:04.809949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35c475-96bb-4646-806d-803d8bda84ae None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:04.810495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35c475-96bb-4646-806d-803d8bda84ae None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:04.810495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35c475-96bb-4646-806d-803d8bda84ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:04.829593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ac35c475-96bb-4646-806d-803d8bda84ae None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:04.830784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ac35c475-96bb-4646-806d-803d8bda84ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:04.904047 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 72/143] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:04.909464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c053f7-52c2-4560-9478-df70cfb9e1d3 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:04.909819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c053f7-52c2-4560-9478-df70cfb9e1d3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:04.910020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c053f7-52c2-4560-9478-df70cfb9e1d3 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:04.911582 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 72/144] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:04.917267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797612-072a-4053-a827-1d152fc8a26c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:04.917619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797612-072a-4053-a827-1d152fc8a26c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:04.917859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c797612-072a-4053-a827-1d152fc8a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:04.937044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2c797612-072a-4053-a827-1d152fc8a26c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:04.938264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c797612-072a-4053-a827-1d152fc8a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:05.009483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 73/145] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:05.026439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad4a-d768-4b82-9486-4a6ed09234c4 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.026781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad4a-d768-4b82-9486-4a6ed09234c4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.027055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ad4a-d768-4b82-9486-4a6ed09234c4 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.028535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 73/146] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:05.033761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.034228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.034650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.052507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:05.053924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:05.078341 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.120930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:05.172458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ad4a-d768-4b82-9486-4a6ed09234c4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.223039 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.276198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ad4a-d768-4b82-9486-4a6ed09234c4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.289091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.315404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.316117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.316698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.316988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.329525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:05.336983 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:05.338047 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:05.338826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 74/148] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:05.344036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.394622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d470c0-efe4-4f91-9418-d0edbde545e9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.429257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.429915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.430192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.430459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.440515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:05.445385 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:05.446266 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:05.447094 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 75/149] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:05.447789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.450323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77720127-f6cc-4670-8e6f-2c3e6203b524 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.460354 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.470966 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.485317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.485949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.486224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.486495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.487152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:05.487453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.488877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.498257 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 75/150] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:05.500757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.556062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd32ee-59d4-4a80-8128-95e2a27eda8d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.591364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.591961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.592237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.592504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.593618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.595051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.596586 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 76/151] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:05.597474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.603889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf3979-cf2c-4fbd-bcbc-0d95732d8b83 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.637150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.637793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.638071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.638341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.638998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:05.639295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.640664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.648921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 76/152] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:05.649718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.680954 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.685071 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:05.696495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe5928-e1a0-459c-a173-2ab0f8f8823c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.729156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.729805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.730110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.730379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] PATH_INFO: `/v3/users/35ea06dcffd04e0fbf72a20cd566d494` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.743740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] RBAC: Authorizing `identity:get_user(user_id=35ea06dcffd04e0fbf72a20cd566d494)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.745205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.747021 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 77/153] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/users/35ea06dcffd04e0fbf72a20cd566d494 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:05.753838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.753956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd95b3-d8b0-4c53-87f0-48b0206a8f55 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.782698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.783303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.783580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.783851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.784495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.785956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.846586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b487-6f53-4f7d-a91c-d1a38245b935 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:05.879922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:05.880606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:05.880883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:05.881148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] PATH_INFO: `/v3/users/35ea06dcffd04e0fbf72a20cd566d494` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:05.887400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 77/154] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:05 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:05.887400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.888579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] RBAC: Authorizing `identity:get_user(user_id=35ea06dcffd04e0fbf72a20cd566d494)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:05.890204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:05.898176 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 78/155] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/users/35ea06dcffd04e0fbf72a20cd566d494 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:05.898176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:05.915670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.002342 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.016157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b658de-f3ef-431b-a86b-ac2ca8209130 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.016680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748a55a-213d-4e3f-8b97-d6b45617ba95 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.058578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.058778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.058889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.058889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.058889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.059105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.059105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.059451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.060392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.060556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.063384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:06.063495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:06.063657 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 79/156] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:06.063738 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 78/157] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:05 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:06.070621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:06.071103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:06.168173 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:06.189560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317f325-ab6e-4d4d-989d-12b0e39323bc None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.191180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146304e-104a-4a87-ae7b-c9668fac455a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:06.229300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.229987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.230269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.230557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/users/35ea06dcffd04e0fbf72a20cd566d494/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.232467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, user_id=35ea06dcffd04e0fbf72a20cd566d494, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.233963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51fc7e-6f69-43b9-9acd-9ec1217fcc57 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:06.237604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:06.238277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:06.238553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:06.238823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/users/35ea06dcffd04e0fbf72a20cd566d494/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:06.241766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, user_id=35ea06dcffd04e0fbf72a20cd566d494, role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:06.243540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5fe52-b711-4d9a-83c8-de29f626baf1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:06.338140 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 79/158] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:06 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/users/35ea06dcffd04e0fbf72a20cd566d494/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:06.353800 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 80/159] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:06 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/users/35ea06dcffd04e0fbf72a20cd566d494/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:52:08.180458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668ec7-f994-4eba-a816-c003bfbaa651 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.181012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668ec7-f994-4eba-a816-c003bfbaa651 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.181012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668ec7-f994-4eba-a816-c003bfbaa651 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.182563 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 80/160] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:08.188318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.189194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.189704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.208792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.210923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.275731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43b6a-6a41-4d05-9d2d-f15a1e5a1716 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.276037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43b6a-6a41-4d05-9d2d-f15a1e5a1716 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.276275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43b6a-6a41-4d05-9d2d-f15a1e5a1716 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.278437 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 81/161] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:08.283370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337fbb-28cb-499a-97cf-085006e270d3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.283677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337fbb-28cb-499a-97cf-085006e270d3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.283956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f337fbb-28cb-499a-97cf-085006e270d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.285860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 81/162] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:08.305106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8f337fbb-28cb-499a-97cf-085006e270d3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.306692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f337fbb-28cb-499a-97cf-085006e270d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.318473 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.387558 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 82/163] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:08.566485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.599821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160840b-7a9c-4aeb-b61f-a8cee20ce2ce None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.600647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160840b-7a9c-4aeb-b61f-a8cee20ce2ce None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.600898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160840b-7a9c-4aeb-b61f-a8cee20ce2ce None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.602553 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 83/164] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:08.607729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e406-4dc1-4eba-8e31-9a51732e20fd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.608016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e406-4dc1-4eba-8e31-9a51732e20fd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.608294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1e406-4dc1-4eba-8e31-9a51732e20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.629293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ae1e406-4dc1-4eba-8e31-9a51732e20fd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.630660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ae1e406-4dc1-4eba-8e31-9a51732e20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.644650 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.676441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f22e1-0da0-48a3-827f-d456be2e9850 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:08.704771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 84/165] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:08.706040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782584d3-4c90-4bdd-bb8a-4ca7dc7b352b None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.706326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782584d3-4c90-4bdd-bb8a-4ca7dc7b352b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.706602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782584d3-4c90-4bdd-bb8a-4ca7dc7b352b None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.707965 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 85/166] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:08.708656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782584d3-4c90-4bdd-bb8a-4ca7dc7b352b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.721424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:08.722053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.722324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.722588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.734298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-61e6ca9f-ac77-49ca-afa4-2279de6404b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:08.740421 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:08.741906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:08.742739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:08.744583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.744583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.744583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.766139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:08.767335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:08.797110 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.822213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782584d3-4c90-4bdd-bb8a-4ca7dc7b352b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:08.837889 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 83/168] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:08.842830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.866974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:08.867659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:08.868198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:08.868480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:08.869648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:08.871267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:08.872963 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 86/169] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:08.878825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:08.934340 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:08.987080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac212-fd04-462f-9b83-92332cc4d177 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:08.989218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca28c0-e988-4d73-84c2-1c69c02044c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.025317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.025949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.026230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.026340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.026516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.026966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.027139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.027243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.027429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.028099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:09.028396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.028571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.029771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.038222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 84/170] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.041863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.139861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86610-fd8e-415a-823f-f2bda845d1cd None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.155267 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.161446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 87/171] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:08 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:09.161446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.168750 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.181465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.182109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.182389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.182659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.195344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:09.200597 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:09.201660 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:09.202718 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 85/172] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:09.203389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.277635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044454-f3fb-4e89-8079-96c16bc79d0a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.311979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0538c5-5729-4c5d-84d0-163daec76f44 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.313887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.314543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.314824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.315097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] PATH_INFO: `/v3/users/48cb402a954b453fa407ca50c966df05` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.330967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] RBAC: Authorizing `identity:get_user(user_id=48cb402a954b453fa407ca50c966df05)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.332489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.334225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 88/173] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/users/48cb402a954b453fa407ca50c966df05 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.335066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.351562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.352869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.352869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.352869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.366852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:09.372115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:09.372999 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:09.373988 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 86/174] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:09.374805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.410498 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.431542 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.491538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1785ac-4ca1-418a-b79a-8f3cd3477cd1 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.529197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.529978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.530193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.530466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.531797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.533263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.535092 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 87/175] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.539577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.572347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b980c5-22e5-4192-a068-5f92f33a7658 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.619396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.620072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.620360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.620634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.621395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:09.621708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.623232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.637066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 89/176] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.638019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.665784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fe0a8-b9af-4eb7-9260-54b89b28011f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.680390 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.703563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.704282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.704650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.704994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.705924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:09.706297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.707939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.718277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 88/177] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.719256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.769855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a808ef-d882-4cc3-ba2e-490a42e0101b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.792702 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.810244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.822478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.822478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.822478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/users/48cb402a954b453fa407ca50c966df05/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.822478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, user_id=48cb402a954b453fa407ca50c966df05, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.822478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.840530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8160c-1ea7-4025-8342-a4278dee76f7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:09.875837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:09.876517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:09.876804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:09.877074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] PATH_INFO: `/v3/users/35ea06dcffd04e0fbf72a20cd566d494` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:09.878275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] RBAC: Authorizing `identity:get_user(user_id=35ea06dcffd04e0fbf72a20cd566d494)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:09.879983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:09.882324 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 89/178] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/users/35ea06dcffd04e0fbf72a20cd566d494 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:09.883111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:09.935934 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:09.940856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 90/179] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:09 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/users/48cb402a954b453fa407ca50c966df05/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:09.941999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.066064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b20923-181f-4b5d-8e8a-eda89f81f2bd None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.149201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.149869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.150362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.150637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] PATH_INFO: `/v3/users/35ea06dcffd04e0fbf72a20cd566d494` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.152788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] RBAC: Authorizing `identity:get_user(user_id=35ea06dcffd04e0fbf72a20cd566d494)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.154282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:10.156122 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 90/180] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/users/35ea06dcffd04e0fbf72a20cd566d494 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:10.158278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13c4d-bc19-4709-8ba5-a59746159577 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.161523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.199762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.200872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.201378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.201879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.254579 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:10.275036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3788b-d745-4000-ae5a-1bf8ac873a4f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.277901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.280089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:10.286860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:10.315842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.316456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.316729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.317009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.454578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.457369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 91/181] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:10.458525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:10.466159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.577939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 91/182] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:10.583446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.595661 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:10.637730 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:10.645187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39a52f-f858-49f0-9c06-4ada5ce24ac4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.713619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.714176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.714455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.714727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.716502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.718062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:10.719929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 92/183] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:10 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:10.726610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.732431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a80803-c76f-42a7-8865-241285642da7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.778216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.778847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.779123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.779391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.781193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.782663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:10.785377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 92/184] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:10 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:10.792824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:10.925639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb76fd-7797-4cec-b6fb-076926162b91 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.931517 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:10.970920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45483036-a7b0-4010-aed8-f2fc98e2b0d5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:10.987570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:10.988182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:10.988457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:10.988729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:10.989483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=76ddf06755e744a9b1714d49b9924590, user.id=35ea06dcffd04e0fbf72a20cd566d494) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:10.989790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:10.991779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e6b67-2029-4dd0-8de8-cd694abda318 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:11.004367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 93/185] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:10 2022] GET /identity/v3/role_assignments?user.id=35ea06dcffd04e0fbf72a20cd566d494&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:11.035110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:11.035724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:11.036000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:11.036263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:11.036995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] RBAC: Adding query filter params (role.id=70e1716c5bc64e81b540ed4c9a71f126, scope.project.id=76ddf06755e744a9b1714d49b9924590, user.id=35ea06dcffd04e0fbf72a20cd566d494) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:11.037298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:11.039346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26c8dc-bd21-417e-a5f9-76c19d020358 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:11.048863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 93/186] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:10 2022] GET /identity/v3/role_assignments?user.id=35ea06dcffd04e0fbf72a20cd566d494&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=70e1716c5bc64e81b540ed4c9a71f126 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:11.675892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1185a-fd32-43cd-826d-e7a37f8bffc9 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:11.676442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1185a-fd32-43cd-826d-e7a37f8bffc9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:11.676442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1185a-fd32-43cd-826d-e7a37f8bffc9 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:11.678059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 94/187] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:11.683060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:11.683498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:11.683585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:11.702580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:11.703680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:11.723308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350dc-e4d9-4fa5-bf0f-974c6a7098d1 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:11.723681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350dc-e4d9-4fa5-bf0f-974c6a7098d1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:11.723892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423350dc-e4d9-4fa5-bf0f-974c6a7098d1 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:11.725859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 95/188] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:11.731255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:11.731255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:11.731428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:11.749205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:11.750370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:11.758713 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:11.775581 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 94/189] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:11.824737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 96/190] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:12.043201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.090218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.120345 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.150778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28b7b-bb1f-4de3-a1c3-3d9887aa67d7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.185917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.186549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.186827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.187091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.197961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:12.203072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:12.204209 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:12.205002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 95/191] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:12.206323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b8892-d315-4e68-8daf-b2f02e90c25d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.210216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.246642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.247267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.247539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.247805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.248900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.250395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.252120 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 97/192] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:12.257262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.270687 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.313261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18574365-3dd7-4a9c-bd0a-301c52352e22 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.345265 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.350933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.351558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.351840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.352097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.352916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:12.353220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.354671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.363813 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 96/193] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:12.369479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.371518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbad50-9242-4f37-814c-97c8af03c018 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.410149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.410751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.411025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.411292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.411935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.413466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddcdab-60ef-4c2c-9288-d35e0e0eb592 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.504032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b722-da22-476d-aba4-a3c9b793ba43 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.531173 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 98/194] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:12 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:52:12.532509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50f9e-505b-40c5-99c4-cfdcabd19e06 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.532865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50f9e-505b-40c5-99c4-cfdcabd19e06 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.533212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e50f9e-505b-40c5-99c4-cfdcabd19e06 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.534716 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 99/195] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:12.540358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.540639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.540918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.544707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.545464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.545745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.546013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] PATH_INFO: `/v3/users/7c93019b1427400c8e7ed744b02a1aee` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.560588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:12.562350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:12.564353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] RBAC: Authorizing `identity:get_user(user_id=7c93019b1427400c8e7ed744b02a1aee)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.567358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.570015 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 97/196] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/users/7c93019b1427400c8e7ed744b02a1aee => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:12.575952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.634028 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.637583 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.646443 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 100/197] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:12.690992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70e9f-541c-4174-9b7b-5806865b03c1 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.730665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.731295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.731571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.731840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.732973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.734458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.736125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 98/198] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:12.742316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:12.849277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90003c7-5c83-437a-9962-20a188183c43 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:12.886276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:12.886949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:12.887227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:12.887498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/users/7c93019b1427400c8e7ed744b02a1aee/roles/fe33f3768d5a4a48a0cf00bc0aa28de5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:12.889451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, user_id=7c93019b1427400c8e7ed744b02a1aee, role_id=fe33f3768d5a4a48a0cf00bc0aa28de5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:12.891078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:12.918506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:13.005656 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 101/199] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:12 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/users/7c93019b1427400c8e7ed744b02a1aee/roles/fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:13.041879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce8065-e111-4a4a-a9ee-2cbe2d24f223 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:13.066426 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:13.083414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:13.084448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:13.085470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:13.085972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:13.098603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:13.104917 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:13.105912 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:13.106733 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:13.109521 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 99/200] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:13.116063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:13.182678 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:13.227309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2215e0-2736-45a9-bf43-5705399e51e0 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:13.263950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:13.264554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:13.264830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:13.265100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:13.265881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:13.266183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:13.267570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:13.276603 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 102/201] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:13.282250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:13.431625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f6f2f-7b2d-4e13-b5ac-6bd061ddc939 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:13.474012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:13.475009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:13.475534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:13.476002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] PATH_INFO: `/v3/users/48cb402a954b453fa407ca50c966df05` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:13.477368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] RBAC: Authorizing `identity:get_user(user_id=48cb402a954b453fa407ca50c966df05)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:13.479012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:13.481026 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:13 2022] GET /identity/v3/users/48cb402a954b453fa407ca50c966df05 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:13.489374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:13.642326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927522a-c04e-42e8-a2a8-a6c5e6d2f3d5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:13.664088 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:13.679158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:13.679783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:13.680063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:13.680334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:13.784031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:13.785963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:13.914768 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:13.922817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:13.977084 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:14.099244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4d55d-d185-4d1d-b605-adcc055e628e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:14.150879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:14.151743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:14.153266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:14.153701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:14.154994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:14.157360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261db66-673d-44ce-ae83-dd10f79ca597 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:14.167267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:14.173126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 101/204] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:13 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:14.201857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:14.287459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ff564-1d12-4a82-a63d-1d8fbc03c42c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:14.323091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:14.323899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:14.324430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:14.324861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:14.325744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] RBAC: Adding query filter params (role.id=0586b2548ccb452b89a7c40125c21137, scope.project.id=76ddf06755e744a9b1714d49b9924590, user.id=48cb402a954b453fa407ca50c966df05) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:14.326190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:14.328001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec30a-d75c-46a1-9708-a1cbf906fd0f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:14.334396 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 104/205] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:14 2022] GET /identity/v3/role_assignments?user.id=48cb402a954b453fa407ca50c966df05&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=0586b2548ccb452b89a7c40125c21137 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:14.966336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153937f-88ef-4aab-af20-21ed4c3b192c None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:14.966923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153937f-88ef-4aab-af20-21ed4c3b192c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:14.966923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153937f-88ef-4aab-af20-21ed4c3b192c None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:14.968467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 102/206] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:14.974257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6571e-f0ac-4104-bdf1-ba8a3eb5911d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:14.974749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6571e-f0ac-4104-bdf1-ba8a3eb5911d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:14.974749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6571e-f0ac-4104-bdf1-ba8a3eb5911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:14.993510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-99a6571e-f0ac-4104-bdf1-ba8a3eb5911d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:14.994694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99a6571e-f0ac-4104-bdf1-ba8a3eb5911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:15.064620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 105/207] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:15.066456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5c3cc-3465-42a0-b92e-d399b62f0585 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.066740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5c3cc-3465-42a0-b92e-d399b62f0585 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.067012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5c3cc-3465-42a0-b92e-d399b62f0585 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.068511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 103/208] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:15.073669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75a6b-c8f5-4531-be6f-16ca7e3136da None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.073963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75a6b-c8f5-4531-be6f-16ca7e3136da None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.074241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be75a6b-c8f5-4531-be6f-16ca7e3136da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.093696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6be75a6b-c8f5-4531-be6f-16ca7e3136da None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:15.094906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6be75a6b-c8f5-4531-be6f-16ca7e3136da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:15.103526 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.162172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 106/209] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:15.332838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5c3cc-3465-42a0-b92e-d399b62f0585 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.340921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea991-b289-4e6a-824f-d01ff0aa2116 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.341208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea991-b289-4e6a-824f-d01ff0aa2116 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.341520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fea991-b289-4e6a-824f-d01ff0aa2116 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.343004 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 107/210] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:15.347757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.348038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.348314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.366985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:15.368152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:15.439385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:15.439945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5c3cc-3465-42a0-b92e-d399b62f0585 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.440824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.458380 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.477134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.477792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.478063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.478328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.489324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:15.494858 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:15.495747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:15.496609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:15.501391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 104/212] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:15.504566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.529736 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.559771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24d722-4aea-4e7f-9347-5331ecca59ed None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.602504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.603237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.603515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.603785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.604879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:15.607285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:15.609395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:15.611626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9946-457f-467e-9706-07c53cf454b4 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.614769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.647377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.648556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.648846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.649373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.649829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:15.650212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:15.651618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:15.664768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 105/214] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:15.665666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.709394 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.724149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd795-f707-49e2-9c80-dc5347d08dc5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.758952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.759557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.759838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.760110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.760764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:15.762224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:15.769661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e793a6-d6c5-4e33-87c6-f22b8e093ed7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.773699 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.802075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.802686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.802959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.803225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] PATH_INFO: `/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.816707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] RBAC: Authorizing `identity:get_user(user_id=22a8f6b9ff614b5eac1bdcc64c9563e7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:15.818201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:15.820376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 106/215] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:15.821118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.874264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 110/216] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:15 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:15.875261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:15.935239 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:15.942762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e086-7c7f-4c99-8d10-f841cc4ce046 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:15.981007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:15.981741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:15.981977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:15.982165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:15.995540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:15.995796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcae1-6dd9-4f2e-a200-c3319b45ca51 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:16.000838 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:16.002027 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:16.006473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 107/217] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:16.009000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:16.036105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:16.036719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:16.036995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:16.037261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:16.038064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] RBAC: Adding query filter params (role.id=0586b2548ccb452b89a7c40125c21137, user.id=22a8f6b9ff614b5eac1bdcc64c9563e7, scope.system=all) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:16.038368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:16.040056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:16.045786 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 111/218] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 30 00:52:15 2022] GET /identity/v3/role_assignments?user.id=22a8f6b9ff614b5eac1bdcc64c9563e7&scope.system=all&role.id=0586b2548ccb452b89a7c40125c21137 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:16.130165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1c5d-6b63-4e5b-a1e8-6ef291a598a8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.169995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:16.170617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:16.170888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:16.171159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:16.171847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:16.172146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:16.173604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:16.183998 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 108/219] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:16.189768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:16.258842 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:16.304262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cd55-e86b-4e66-93c0-32ca86917c85 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.340026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:16.340661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:16.340939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:16.341208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] PATH_INFO: `/v3/users/7c93019b1427400c8e7ed744b02a1aee` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:16.342382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] RBAC: Authorizing `identity:get_user(user_id=7c93019b1427400c8e7ed744b02a1aee)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:16.343940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:16.345940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 112/220] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:16 2022] GET /identity/v3/users/7c93019b1427400c8e7ed744b02a1aee => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:16.352329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:16.373911 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:16.483670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5e5a-a56f-4c2a-9305-0af0fa9542fa None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.518394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:16.518991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:16.519321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:16.519598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:16.595452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:16.596930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:16.617517 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:16.703578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 109/221] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:16.709734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:16.816467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19134b8f-ed09-42bf-b24e-714eaae17b27 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.844277 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:16.857301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:16.860417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:16.860417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:16.860417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:16.860417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:16.862001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d785c-3e61-4ca1-8246-392b254016d2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:16.864212 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 113/222] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:16 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:16.870079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:16.977247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9cd8-61eb-4fab-ac55-4b6145389697 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:16.999793 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:17.015139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:17.016159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:17.016583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:17.017045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:17.017958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] RBAC: Adding query filter params (role.id=fe33f3768d5a4a48a0cf00bc0aa28de5, scope.project.id=76ddf06755e744a9b1714d49b9924590, user.id=7c93019b1427400c8e7ed744b02a1aee) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:17.018401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:17.020024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdb4cb-235f-4e63-a5ba-41cf84a4a2cb None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:17.027506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 110/223] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:16 2022] GET /identity/v3/role_assignments?user.id=7c93019b1427400c8e7ed744b02a1aee&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:18.269383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e315b-e845-495d-94d9-42f3dd05d1d9 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.269970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e315b-e845-495d-94d9-42f3dd05d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.269970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e315b-e845-495d-94d9-42f3dd05d1d9 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.271527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 114/224] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:18.277743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f1fb-0cba-495d-acde-382f3f4fe3a0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.278257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f1fb-0cba-495d-acde-382f3f4fe3a0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.278358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f1fb-0cba-495d-acde-382f3f4fe3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.297204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8098f1fb-0cba-495d-acde-382f3f4fe3a0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:18.298419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8098f1fb-0cba-495d-acde-382f3f4fe3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:18.312383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45599-9609-40a4-823e-151dd226fc16 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.312661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45599-9609-40a4-823e-151dd226fc16 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.312943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a45599-9609-40a4-823e-151dd226fc16 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.314343 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 115/225] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:18.320179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.320460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.320736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.339379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:18.340560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:18.379698 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 111/226] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:18.380996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263529-e977-40e3-af9c-eb6e51040fc8 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.381285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263529-e977-40e3-af9c-eb6e51040fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.381584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91263529-e977-40e3-af9c-eb6e51040fc8 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.383567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 112/227] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:18.388694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.388979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.389373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.407939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:18.409124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:18.415190 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 116/228] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:18.478859 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 113/229] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:18.646295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:18.685175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:18.729724 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:18.754095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c178d-9e04-479b-ac11-6cdf02705908 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:18.780343 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:18.786593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0ff95-ac6a-4b58-bd91-8de475fb7f81 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:18.788401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:18.789025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.789303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.789605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.799421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:18.805080 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:18.806098 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:18.806932 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 117/230] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:18.808620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:18.822308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:18.822936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.823216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.823483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.824574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:18.826055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:18.827870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 114/231] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:18.830168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:18.916784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f04f4-1510-411f-9c68-cda419bba976 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:18.928605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a99b2-5eaf-4b40-9e4f-859deada74de None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:18.940302 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:18.950795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:18.951416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.955039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.955039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.962382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:18.963170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:18.963762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:18.964036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:18.964305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:18.965053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:18.965380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:18.966767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:18.967233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:18.968356 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 118/232] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:18.969568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:18.982551 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 115/233] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:18.983411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:19.016695 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:19.071947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6522a2b-be7d-48d8-a0ec-34dc80bc8424 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.082887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3b66a-03ae-4b8a-a6a4-171bc3c5d84f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.107428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.108032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.108306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.108574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.109204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.110654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.116407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.117006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.117281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.117577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.118234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:19.118531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.119867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.127856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 116/234] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:19.132492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:19.161771 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:19.190000 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 119/235] 10.222.0.13 () {60 vars in 1134 bytes} [Sun Oct 30 00:52:18 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:19.190000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:19.232982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f2cc3-0170-49fd-817a-67582a077184 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.271471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.272116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.272409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.273296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] PATH_INFO: `/v3/users/f9fb14030554461491d81b4e9cb7571a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.288106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fb14030554461491d81b4e9cb7571a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.289612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.291348 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 117/236] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:19 2022] GET /identity/v3/users/f9fb14030554461491d81b4e9cb7571a => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:19.297302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:19.329177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41064b1-c6ad-4b2e-a693-f3a8092e9be0 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.338896 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:19.369261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.369261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.369616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.369686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] PATH_INFO: `/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.370832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] RBAC: Authorizing `identity:get_user(user_id=22a8f6b9ff614b5eac1bdcc64c9563e7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.373141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.375100 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 120/237] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:19 2022] GET /identity/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:19.380878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:19.404904 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:19.415150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4a6e3-7490-47ce-98f9-5447b2ae14a8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.517413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf1724-4ccd-43be-a059-fd71df0730e7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:19.521071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.521963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.522971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.523444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.524370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] RBAC: Adding query filter params (role.id=fe33f3768d5a4a48a0cf00bc0aa28de5, user.id=f9fb14030554461491d81b4e9cb7571a, scope.system=all) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:19.525325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.527392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad255e3-6625-4c99-9e75-32c0327c6369 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.533518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 118/238] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 30 00:52:19 2022] GET /identity/v3/role_assignments?user.id=f9fb14030554461491d81b4e9cb7571a&scope.system=all&role.id=fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:19.561261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:19.562551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:19.563008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:19.563413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] PATH_INFO: `/v3/system/users/22a8f6b9ff614b5eac1bdcc64c9563e7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:19.565255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=22a8f6b9ff614b5eac1bdcc64c9563e7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:19.566882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e891e1-545c-441d-bc2e-b86a8f8f3dd4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:19.664403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 121/239] 10.222.0.13 () {58 vars in 1334 bytes} [Sun Oct 30 00:52:19 2022] PUT /identity/v3/system/users/22a8f6b9ff614b5eac1bdcc64c9563e7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:52:21.395491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303481af-5c9c-4220-8494-894501325065 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.396013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303481af-5c9c-4220-8494-894501325065 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.396013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303481af-5c9c-4220-8494-894501325065 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.397543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 119/240] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:21.402951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c2df-6fb3-4514-b713-3b9081694a6c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.408153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c2df-6fb3-4514-b713-3b9081694a6c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.408153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c2df-6fb3-4514-b713-3b9081694a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.423100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-89f2c2df-6fb3-4514-b713-3b9081694a6c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:21.424280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-89f2c2df-6fb3-4514-b713-3b9081694a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:21.462084 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:21.499670 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 122/241] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:21.694860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef9bb-1dc1-4a94-a8d7-db1e2fa67023 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.695191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef9bb-1dc1-4a94-a8d7-db1e2fa67023 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.695405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fef9bb-1dc1-4a94-a8d7-db1e2fa67023 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.697155 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 120/242] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:21.703113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829aa42-c2fa-4dc5-a0b1-5608dda415a9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.703425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829aa42-c2fa-4dc5-a0b1-5608dda415a9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.703663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829aa42-c2fa-4dc5-a0b1-5608dda415a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.724213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a829aa42-c2fa-4dc5-a0b1-5608dda415a9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:21.725472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a829aa42-c2fa-4dc5-a0b1-5608dda415a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:21.763822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fef9bb-1dc1-4a94-a8d7-db1e2fa67023 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:21.798677 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 123/243] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:21.829068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624fb9-f4ee-4529-8673-a06f601e0f6c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.830436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624fb9-f4ee-4529-8673-a06f601e0f6c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.830436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624fb9-f4ee-4529-8673-a06f601e0f6c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.831184 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 124/244] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:21.836559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.836839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.837109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.855379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:21.856540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:21.874776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fef9bb-1dc1-4a94-a8d7-db1e2fa67023 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:21.917192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:21.917851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:21.918161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:21.918443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:21.919642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:21.921108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:21.922693 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 121/245] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:21.928268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:21.934203 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 125/246] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:21.953985 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.028421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9f725-6b28-4974-9c67-1b944711b9d4 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.064324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.070076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.070735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.071012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.071323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.071958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.073498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.093888 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.163462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebccb1-6386-4e11-9066-77523f93ce06 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.195130 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 122/247] 10.222.0.13 () {60 vars in 1134 bytes} [Sun Oct 30 00:52:21 2022] POST /identity/v3/groups => generated 226 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:52:22.199360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.200126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.200457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.200730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.206745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.214920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:22.219995 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:22.220940 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:22.221806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 126/248] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:22.227798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.312986 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.330888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60193f4-fa8d-4a93-bee9-d481e54a350d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.335974 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.349507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0ed0-0a53-4156-96b5-ad0d3392ddee None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.369132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.370530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.370819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.376761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.385132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:22.387335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.387975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.388255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.388530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.389202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:22.389544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:22.390053 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:22.390923 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:22.391706 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:22.392317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.392387 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 123/249] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:22.397295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.403626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 127/250] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:22.409085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.531597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071a21a-6069-44a5-97a4-684954c0f303 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.536444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dff993-f775-4ed8-aa10-10c2aa8e5584 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.649451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.649655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.650106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.650384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.650724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] PATH_INFO: `/v3/users/f9fb14030554461491d81b4e9cb7571a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.650894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.651223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.651598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.652277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:22.652376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] RBAC: Authorizing `identity:get_user(user_id=f9fb14030554461491d81b4e9cb7571a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.652574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.653863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.654136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.655988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 128/251] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/users/f9fb14030554461491d81b4e9cb7571a => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:22.661769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.666255 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 124/252] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:22.676353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.686312 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.690469 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.805939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a03c7c-ef10-428c-af63-22a0f8bab8ee None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.806465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b60e5-8eb0-46c5-8e5f-d9bf041a8355 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:22.849198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.849897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.850165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.852213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] PATH_INFO: `/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.852713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] RBAC: Authorizing `identity:get_user(user_id=22a8f6b9ff614b5eac1bdcc64c9563e7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.854210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.855834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 125/253] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/users/22a8f6b9ff614b5eac1bdcc64c9563e7 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:22.856256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:22.857170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:22.857664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:22.858135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] PATH_INFO: `/v3/system/users/f9fb14030554461491d81b4e9cb7571a/roles/fe33f3768d5a4a48a0cf00bc0aa28de5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:22.860778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f9fb14030554461491d81b4e9cb7571a, role_id=fe33f3768d5a4a48a0cf00bc0aa28de5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:22.862138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:22.863169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ae0f-46a5-4b8e-a10d-a9f174f653aa None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:22.926912 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 129/254] 10.222.0.13 () {58 vars in 1334 bytes} [Sun Oct 30 00:52:22 2022] PUT /identity/v3/system/users/f9fb14030554461491d81b4e9cb7571a/roles/fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:22.952396 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:22.983113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f6b1-057c-410a-a81c-9e3d0d30ec84 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:23.021580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:23.022479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:23.023432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:23.023932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:23.024829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] RBAC: Adding query filter params (role.id=0586b2548ccb452b89a7c40125c21137, user.id=22a8f6b9ff614b5eac1bdcc64c9563e7, scope.system=all) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:23.025302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:23.026946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c36965-3bb7-46a7-bda4-cd9b9e638963 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:23.041328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 126/255] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 30 00:52:22 2022] GET /identity/v3/role_assignments?user.id=22a8f6b9ff614b5eac1bdcc64c9563e7&scope.system=all&role.id=0586b2548ccb452b89a7c40125c21137 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:24.836458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc86ae-4f22-4f8d-b196-27c3a1987b74 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:24.837004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc86ae-4f22-4f8d-b196-27c3a1987b74 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:24.837004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc86ae-4f22-4f8d-b196-27c3a1987b74 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:24.838647 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 130/256] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:24.844452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cfd2-15a2-46fa-8348-4c47e02c9eab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:24.844891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cfd2-15a2-46fa-8348-4c47e02c9eab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:24.845066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20cfd2-15a2-46fa-8348-4c47e02c9eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:24.869565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3e20cfd2-15a2-46fa-8348-4c47e02c9eab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:24.870787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e20cfd2-15a2-46fa-8348-4c47e02c9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:24.970497 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 127/257] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:52:25.085858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652eb80-f08c-4aac-8909-8dd1b5c40119 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.086556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652eb80-f08c-4aac-8909-8dd1b5c40119 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.087030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652eb80-f08c-4aac-8909-8dd1b5c40119 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.088855 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 131/258] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:25.100222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.100727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.101870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.125773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:25.127177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:25.139334 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 128/259] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:52:25.480455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652eb80-f08c-4aac-8909-8dd1b5c40119 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.500244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652eb80-f08c-4aac-8909-8dd1b5c40119 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.505228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.506248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.506725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.507820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.529576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:25.534974 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:25.535897 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:25.536687 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:25.539526 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 132/260] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:25.545434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.556092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a5bdd-7a2a-4310-8d1e-67e4c9a898de None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.560790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.565801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.566353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.566820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.567740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:25.568236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.570853 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:25.570853 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 00:52:25.570853 n-d-master-1 devstack@keystone.service[82035]: Oct 30 00:52:25.572144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399e2ab-86fa-4bf7-9030-54e8508849d5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.581956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 129/261] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:25.589052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.602715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e51674-d7cd-4e17-a009-d3ad5e73b3c2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.607438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.608328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.608809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.609287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.619246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4fc8-7b40-4bf4-a2e9-201135be1718 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.619828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4fc8-7b40-4bf4-a2e9-201135be1718 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.620346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a4fc8-7b40-4bf4-a2e9-201135be1718 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.621909 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 130/262] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:25.624386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.626500 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:25.626500 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 00:52:25.626500 n-d-master-1 devstack@keystone.service[82036]: Oct 30 00:52:25.627356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.627873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.628106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.628558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.630080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 133/263] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:25.641037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.649218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553b05-7439-410c-9268-82bb166a111b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.655528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.655528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.655528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.655528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.656033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.662798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.664871 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 134/264] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:25.670358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:25.670615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.672137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:25.684415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eda399-bf23-4703-a924-e6388cfce151 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.684784 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 131/265] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:52:25.691851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.692025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.692669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.692952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.693312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/groups/ba9f54baa06a465380b232e060ca0451/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.696183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, group_id=ba9f54baa06a465380b232e060ca0451, role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.697206 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:25.697206 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 00:52:25.697206 n-d-master-1 devstack@keystone.service[82036]: Oct 30 00:52:25.705358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.711059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b43acc-aa0c-474b-93db-ccccb557a66a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.720771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.721818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.722294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.722795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.738795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:25.745032 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:25.747768 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:25.748588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:25.753257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.765139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e59d-5573-4b77-a295-1eef8a26eff6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.779364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.779988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.780264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.780535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.781217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:25.781627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.783300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064a37-2081-4633-92e8-bf4e1d5bbe52 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.785181 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 30 00:52:25 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/groups/ba9f54baa06a465380b232e060ca0451/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:52:25.793904 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 133/268] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:25.800019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.900116 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:25.907460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc6c3b-20b6-4b53-b5a3-93077e7d7572 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.908430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc6c3b-20b6-4b53-b5a3-93077e7d7572 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.908895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc6c3b-20b6-4b53-b5a3-93077e7d7572 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.910613 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 134/269] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:25.916931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad268-6f3e-4cce-bec1-181392c07aa0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.923372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.924030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.924308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.924579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.926078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.927626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.928003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.928318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.928774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.930592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 136/270] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:25.936088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.950718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370d0-f5b9-49c2-ab0d-7e5832ea82c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:25.961845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:25.962490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:25.965513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:25.965513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:25.965513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:25.966964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:25.967567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:25.968593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:25.969226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 137/271] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:52:25 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:25.976883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:25.992863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0ea13-befa-49fc-8409-acccfcd0a1db admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.000672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.001363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.001661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.001930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/groups/ba9f54baa06a465380b232e060ca0451/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.003839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db, group_id=ba9f54baa06a465380b232e060ca0451, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.006814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.033685 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:26.091949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 135/272] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:26.093313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 138/273] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 30 00:52:25 2022] PUT /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db/groups/ba9f54baa06a465380b232e060ca0451/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:52:26.162610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.237673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860af9cd-1ac6-430b-ad50-6a0e59b30686 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.245862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.246433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.246710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.246978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.261140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:26.266392 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:26.267361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:26.268181 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 136/274] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:26.274830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.292943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835651-b8a6-43af-9e8d-f1d4783d4d27 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.302794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.303425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.303702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.303965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.304683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:26.304982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.306030 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:26.306030 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 00:52:26.306030 n-d-master-1 devstack@keystone.service[82036]: Oct 30 00:52:26.306933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.318096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 139/275] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:26.323646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.340902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f8f5b-b29f-4088-bbd0-10ba7c33c8cd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.347574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.348289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.348609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.348879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.352353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.353497 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:26.353497 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 00:52:26.353497 n-d-master-1 devstack@keystone.service[82035]: Oct 30 00:52:26.354822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.357125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 137/276] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:26.363098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.379851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7fcb2-e009-457f-b9f3-523481a76cf0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.390968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.391647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.391903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.392174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.393359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.395500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.397623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 140/277] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:26.404563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.417501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f79c1-31e6-4550-9cd2-059a699b0e48 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.424943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.425706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.425990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.426392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/groups/ba9f54baa06a465380b232e060ca0451/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.428570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, group_id=ba9f54baa06a465380b232e060ca0451, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.429731 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 00:52:26.429731 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 00:52:26.429731 n-d-master-1 devstack@keystone.service[82035]: Oct 30 00:52:26.432002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.495095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.572722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 138/278] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 30 00:52:26 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/groups/ba9f54baa06a465380b232e060ca0451/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:26.611583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631c145-68b4-4141-a45a-faa921d5226b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.656870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.657549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.657827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.658101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.669961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:26.680092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:26.682300 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:26.684394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 141/279] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:26.687933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.833917 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:26.851627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173feab5-f5fe-4633-a4cf-8aa188dbb755 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:26.907702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:26.908490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:26.908723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:26.908903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:26.909570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:26.909868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:26.911259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:26.921147 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 139/280] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:26.926934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:26.956552 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:27.043476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a7afa-28d0-4443-8c96-de87a6d84b6d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.086583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.087141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.087417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.087685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] PATH_INFO: `/v3/users/f9fb14030554461491d81b4e9cb7571a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.088819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] RBAC: Authorizing `identity:get_user(user_id=f9fb14030554461491d81b4e9cb7571a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.090294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71cfbe-9bf7-48ed-80f4-0e7f20eb3c5b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.091875 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 142/281] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:52:26 2022] GET /identity/v3/users/f9fb14030554461491d81b4e9cb7571a => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:27.097667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.110830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502adf1-8647-4702-8a92-593b97d353bd None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.111126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502adf1-8647-4702-8a92-593b97d353bd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.111368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502adf1-8647-4702-8a92-593b97d353bd None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.114401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 143/282] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:27.119059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.119336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.119607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.150714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:27.151832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:27.221636 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 144/283] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 30 00:52:27.285073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2be26-4d80-443e-b7da-acf05dacb0fd None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.329192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.329843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.330119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.330387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.331182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] RBAC: Adding query filter params (role.id=fe33f3768d5a4a48a0cf00bc0aa28de5, user.id=f9fb14030554461491d81b4e9cb7571a, scope.system=all) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:27.331547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.333040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.348710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 140/284] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 30 00:52:27 2022] GET /identity/v3/role_assignments?user.id=f9fb14030554461491d81b4e9cb7571a&scope.system=all&role.id=fe33f3768d5a4a48a0cf00bc0aa28de5 => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:27.703807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.713949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a582a3-8935-45d1-a19d-4eccd0223a24 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.721390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.722036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.722313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.722588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.739626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:27.744555 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:27.745474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:27.746297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:27.746899 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 145/285] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:27.751396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.766888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e04f-c587-46e1-a30b-f539ed8c5068 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.771300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.771955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.772231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.772500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.773747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:27.774045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.775697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.782430 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:27.792539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 141/286] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 30 00:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:27.799539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.815213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da367-9c22-4877-8fcd-8ff29b6fcffe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.825794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.826451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.826729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.827003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.829816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.831780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.833827 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 146/287] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 30 00:52:27 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:27.840374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.851827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc860112-b9a3-427c-8f07-9de253a00ba0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.860876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.861828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.862376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.862838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.864211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.866643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06595881-4ad9-4e62-b4d6-ca86157490c6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.868588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 142/288] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:52:27 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:27.874486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:27.892366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5ec7d-b877-4943-8629-fce9fb821afc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:27.904819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:27.905539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.905819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.906093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590/groups/ba9f54baa06a465380b232e060ca0451/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.915248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ddf06755e744a9b1714d49b9924590, group_id=ba9f54baa06a465380b232e060ca0451, role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:27.918038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:27.965553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3249-6012-44ad-8b09-e1ba7f237bf2 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.966454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3249-6012-44ad-8b09-e1ba7f237bf2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.966938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3249-6012-44ad-8b09-e1ba7f237bf2 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.968472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 143/289] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:27.974453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:27.975015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:27.975482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:27.997533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:27.999109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:28.005886 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 147/290] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 30 00:52:27 2022] PUT /identity/v3/projects/76ddf06755e744a9b1714d49b9924590/groups/ba9f54baa06a465380b232e060ca0451/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:28.081212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 144/291] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 30 00:52:28.445917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:28.456805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad48984-153e-422e-a50f-42b2a8ca83a5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:28.464899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:28.465924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:28.466447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:28.466910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:28.477739 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:28.482518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:28.489029 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:28.489984 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:28.490775 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:28.493993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 148/292] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:28.499925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:28.510314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a44b-ca68-4cdf-8fbb-69b13e9edefa None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:28.519135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:28.520100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:28.520625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:28.521089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:28.522002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:28.522500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:28.524356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:28.537381 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 145/293] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:28.543245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:28.556310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70660a-ea24-4a2c-9fc9-1d9f470b023f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:28.561305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:28.562199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:28.562674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:28.563139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] PATH_INFO: `/v3/groups/2f38c406e2b8403b87797b6ea65232e1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:28.571806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=2f38c406e2b8403b87797b6ea65232e1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:28.574092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:28.576028 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 149/294] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 30 00:52:28 2022] GET /identity/v3/groups/2f38c406e2b8403b87797b6ea65232e1 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:28.582118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:28.597293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7936aa-3899-4e03-ae38-e0763b790b2c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:28.602767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:28.603666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:28.604135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:28.604636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] PATH_INFO: `/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:28.606003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] RBAC: Authorizing `identity:get_project(project_id=e4f4b3ee17464dd9b78ef48e253d6687)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:28.608231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786554e-0f9f-464c-aa5e-3f6061f636ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:28.610494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 146/295] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 30 00:52:28 2022] GET /identity/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:28.616522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:28.630687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb16fdd-2a3a-4e1a-aaff-2a641168e8f4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:28.637512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:28.638471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:28.638945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:28.639406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] PATH_INFO: `/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687/groups/2f38c406e2b8403b87797b6ea65232e1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:28.641663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f4b3ee17464dd9b78ef48e253d6687, group_id=2f38c406e2b8403b87797b6ea65232e1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:28.644736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b3a7-939b-447a-b4fd-e6e77685a5f9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:28.722111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 150/296] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 30 00:52:28 2022] PUT /identity/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687/groups/2f38c406e2b8403b87797b6ea65232e1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:29.175454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948e8-46e6-4b9d-b4f1-e690c8295f82 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.176097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948e8-46e6-4b9d-b4f1-e690c8295f82 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.176097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948e8-46e6-4b9d-b4f1-e690c8295f82 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.177681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 147/297] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:29.183008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ec58-7ce3-4e8b-866c-a31b3e3600f4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.183510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ec58-7ce3-4e8b-866c-a31b3e3600f4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.183591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ec58-7ce3-4e8b-866c-a31b3e3600f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.206887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fb97ec58-7ce3-4e8b-866c-a31b3e3600f4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:29.208103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fb97ec58-7ce3-4e8b-866c-a31b3e3600f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:29.294772 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 151/298] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:29.515854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aabac-6558-4398-9743-2a23728846f8 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.516032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aabac-6558-4398-9743-2a23728846f8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.516300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aabac-6558-4398-9743-2a23728846f8 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.517946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 148/299] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:29.523404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.523691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.523968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.546174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:29.547381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:29.621999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 152/300] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:29.669880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aabac-6558-4398-9743-2a23728846f8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:29.801824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aabac-6558-4398-9743-2a23728846f8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:29.829935 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:29.839054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:29.839714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.839984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.840239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.852578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c5246e08-ffda-4b40-9be2-b422bb5211c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:29.857802 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:29.858745 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:29.859577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 149/301] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:52:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:29.866708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:29.902548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca0cf-53bb-46ed-a85e-a2ac7742afcd None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.902877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca0cf-53bb-46ed-a85e-a2ac7742afcd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.903091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ca0cf-53bb-46ed-a85e-a2ac7742afcd None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.904680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 150/302] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:29.910138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:29.910419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:29.910687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:29.926042 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:29.937784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:29.939633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:30.040197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e394c3-9b46-4cf0-861c-8e439db179a8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.062567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 151/303] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:30.063337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.097067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.097705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.097979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.098246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.099888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:30.100189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:30.104135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:30.119265 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 153/304] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:30.125991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.217571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4f621-24ee-47c0-ae8b-8016bb9fd503 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.244459 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.267574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.268396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.268672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.268944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.287227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:30.292717 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:30.295234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:30.297148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 152/305] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:30.301976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.345207 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.352804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960b14d-6659-4d6b-b9c6-5bde795b3948 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.422007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.422987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.423695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.424351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.459940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a72f-94b8-465d-86eb-2f69b09df684 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.499540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.500160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.500436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.500704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.501396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:30.501699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:30.503139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:30.512516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 153/306] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:30.513163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.521249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:30.525527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:30.576051 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.652034 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.659028 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 154/307] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:30.659028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.665054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ca5aa-5f58-4ec4-9da4-12ed55474dad None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.713715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.714984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.715729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.716621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.736866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:30.743342 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:30.744331 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 30 00:52:30.745228 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:30.750137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 154/308] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:30.751307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.827980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8e548-be92-4557-9999-e0f3f35bd2a9 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.867377 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.874485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5a9-5e21-45da-a4c9-15b45868202a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:30.884031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.884031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.884031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.884031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.928981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:30.930164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:30.930439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:30.930705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:30.931809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:30.933308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:30.936233 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 155/309] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:30.936233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:30.964857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:30.967645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:30.969036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ba12-00ff-475b-88e8-741028cbad6d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.055821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250bf47-d27f-4c50-bba5-1d6d19409fa2 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.096917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.097565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.097845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.098114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.098786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:31.099500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.100447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.109905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 155/310] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:31.111050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 156/311] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:31.111475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155bf-ea77-494a-acee-35a09b6959e5 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.111762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155bf-ea77-494a-acee-35a09b6959e5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.111863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.112032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1155bf-ea77-494a-acee-35a09b6959e5 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.115271 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 156/312] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:31.116316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1155bf-ea77-494a-acee-35a09b6959e5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.151062 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.245537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773dd6e-9981-4f5a-afd7-f682859a71f0 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.251171 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.255130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1155bf-ea77-494a-acee-35a09b6959e5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.292600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.293557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.293995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.294422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.295786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.297308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356c346-fb39-45ee-9b5d-7f55151675fa None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.299978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 157/313] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:31.300101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.300195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.300432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480249-c387-4c16-8031-835d6197560d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.300543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.300710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480249-c387-4c16-8031-835d6197560d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.300904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] PATH_INFO: `/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.301001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca480249-c387-4c16-8031-835d6197560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.302276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] RBAC: Authorizing `identity:get_project(project_id=27f7f7063b1b4a7ea9ff18ca0a7530db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.304079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.305927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 157/314] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/projects/27f7f7063b1b4a7ea9ff18ca0a7530db => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:31.306968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.321436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ca480249-c387-4c16-8031-835d6197560d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:31.322670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca480249-c387-4c16-8031-835d6197560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:31.416813 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 158/315] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:31.418157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca480249-c387-4c16-8031-835d6197560d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.446185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9059d-5768-4d78-b2f0-d87a1cc8a68d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.448795 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.491989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.492603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.492881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.493151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.534776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca480249-c387-4c16-8031-835d6197560d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.537701 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.580937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.583189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.583189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.583189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.583901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] RBAC: Adding query filter params (group.id=ba9f54baa06a465380b232e060ca0451, role.id=70e1716c5bc64e81b540ed4c9a71f126, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:31.584278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.587155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.588123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.590096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5caf36-e294-4cc9-8066-0254f87850b8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.596126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 159/316] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/role_assignments?group.id=ba9f54baa06a465380b232e060ca0451&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=70e1716c5bc64e81b540ed4c9a71f126 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:31.602457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.757670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.767758 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 158/317] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:31.769102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c8bd-0b26-4489-aaa3-e2227b14c722 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.771332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c8bd-0b26-4489-aaa3-e2227b14c722 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.771677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c8bd-0b26-4489-aaa3-e2227b14c722 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.772580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da15d3-c048-4b3f-a7f9-d4c78be90829 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.773987 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 159/318] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:31.774796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c8bd-0b26-4489-aaa3-e2227b14c722 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.821216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.823304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.823304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.823304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.823982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:31.825750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e21d93-7666-4ca8-a7c6-2ad0dad2110b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:31.827183 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 160/319] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:31.828207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.830236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.830236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.850731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:31.852504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:31.881744 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:31.924742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c8bd-0b26-4489-aaa3-e2227b14c722 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:31.941649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 161/320] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:31.942491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:31.961799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:31.962753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:31.963226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:31.963676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:31.979684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:31.984900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:31.985839 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:31.986626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 160/321] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:31.987270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.060145 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.089579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d55407-a79f-4950-aa7b-12bfd06bb399 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.109132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab94516-fe1d-4100-a7ba-4f089357cdd1 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.116676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.118014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.118292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.118645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.119807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.123395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.123395 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 162/322] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.124195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.144918 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.153840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] RBAC: Adding query filter params (group.id=ba9f54baa06a465380b232e060ca0451, role.id=0586b2548ccb452b89a7c40125c21137, scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.158665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.166961 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 161/323] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 30 00:52:31 2022] GET /identity/v3/role_assignments?group.id=ba9f54baa06a465380b232e060ca0451&scope.project.id=27f7f7063b1b4a7ea9ff18ca0a7530db&role.id=0586b2548ccb452b89a7c40125c21137 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.167991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.251406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918e9bd-659c-4fe1-bb9e-ea1380fe67f2 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.295427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.295427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.295812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.295892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.296559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:32.297124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.298283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.307839 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 163/324] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.308695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.325784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce2553-f226-4d96-96fd-ae1b572eae2e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.334098 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.373224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.374229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.374728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.375150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.376478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.377973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.379875 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 162/325] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.380670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.444560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc6c7-485c-41cd-b58a-792f5396d716 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.461505 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.486842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.487476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.488198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.488198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.501437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:32.508899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebb68-881e-482c-8809-ae242003c6f4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:32.509470 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:32.510379 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:32.511169 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 164/326] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:32.511958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.550577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.551192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.551473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.551750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.611927 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.635597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c7f0f-885c-4b1a-9353-bef4a606f27c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.637969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.639430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.673388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.673998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.674275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.674538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.675256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] RBAC: Adding query filter params (group.id=ba9f54baa06a465380b232e060ca0451, role.id=0586b2548ccb452b89a7c40125c21137, scope.project.id=76ddf06755e744a9b1714d49b9924590) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:32.675557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.676998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.684193 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 165/327] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/role_assignments?group.id=ba9f54baa06a465380b232e060ca0451&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=0586b2548ccb452b89a7c40125c21137 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.684463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.717996 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.782620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 163/328] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:32.784174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.830265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292359f-8fe9-4f3e-8580-964dd4e9dd9a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.871445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.872051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.872329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.872591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.873254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:32.873582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.874969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.891861 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 166/329] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.897296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:32.902135 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.917971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e58db-136b-47f7-b3b8-50ca2487c186 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:32.956315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:32.956956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:32.957230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:32.957576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] PATH_INFO: `/v3/projects/76ddf06755e744a9b1714d49b9924590` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:32.958701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] RBAC: Authorizing `identity:get_project(project_id=76ddf06755e744a9b1714d49b9924590)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:32.960136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:32.967062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 164/330] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/projects/76ddf06755e744a9b1714d49b9924590 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:32.967877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:33.003062 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:33.023629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96b65b-0a8b-4de0-9a33-683dfbbba1c2 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.066122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.066784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.067284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.067461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.095712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda73d-87e2-4b2f-9511-ce13c69a00da None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.129915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.130548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.130833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.131101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] PATH_INFO: `/v3/groups/ba9f54baa06a465380b232e060ca0451` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.132191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] RBAC: Authorizing `identity:get_group(group_id=ba9f54baa06a465380b232e060ca0451)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.134224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.135791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 165/331] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/groups/ba9f54baa06a465380b232e060ca0451 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:33.138657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.140093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.141551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:33.142731 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:33.235374 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:33.239218 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 167/332] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:33.241189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edee3c-06a2-4e3e-a03e-0ef1eb2b1126 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.245065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:33.276057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.276651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.276927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.277198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.277942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] RBAC: Adding query filter params (group.id=ba9f54baa06a465380b232e060ca0451, role.id=70e1716c5bc64e81b540ed4c9a71f126, scope.project.id=76ddf06755e744a9b1714d49b9924590) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:33.278234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.279640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.285487 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 30 00:52:33 2022] GET /identity/v3/role_assignments?group.id=ba9f54baa06a465380b232e060ca0451&scope.project.id=76ddf06755e744a9b1714d49b9924590&role.id=70e1716c5bc64e81b540ed4c9a71f126 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:33.350537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc147-846b-4025-b968-d55eab413665 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.353639 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:33.388204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.389104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.389637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.390079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] PATH_INFO: `/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.391494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] RBAC: Authorizing `identity:get_project(project_id=e4f4b3ee17464dd9b78ef48e253d6687)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.393021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.394787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 168/334] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:52:33 2022] GET /identity/v3/projects/e4f4b3ee17464dd9b78ef48e253d6687 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:33.400868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:33.508356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd90951-2fd7-4aa2-87e2-e19a7ad8bf7f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.542883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.543507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.543780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.544047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] PATH_INFO: `/v3/groups/2f38c406e2b8403b87797b6ea65232e1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.545137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] RBAC: Authorizing `identity:get_group(group_id=2f38c406e2b8403b87797b6ea65232e1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.546660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c83e61-041a-495a-88dd-ed60a21e35b2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.548227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 167/335] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 30 00:52:33 2022] GET /identity/v3/groups/2f38c406e2b8403b87797b6ea65232e1 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:33.554099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:33.656059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242aea1-0793-4ad5-87ce-7f828daf0353 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:33.690792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:33.691386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:33.691683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:33.691947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:33.692660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] RBAC: Adding query filter params (group.id=2f38c406e2b8403b87797b6ea65232e1, role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=e4f4b3ee17464dd9b78ef48e253d6687) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:33.692959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:33.694453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf5630-7f82-40af-8684-cd129c023d83 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:33.700243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 169/336] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 30 00:52:33 2022] GET /identity/v3/role_assignments?group.id=2f38c406e2b8403b87797b6ea65232e1&scope.project.id=e4f4b3ee17464dd9b78ef48e253d6687&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:36.358353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ce5e-66a6-4bac-a691-d2dc1f849100 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.359375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ce5e-66a6-4bac-a691-d2dc1f849100 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.359879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ce5e-66a6-4bac-a691-d2dc1f849100 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.361764 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 168/337] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:36.366981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac27d-ac48-42d3-8ced-d0d764efdb4c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.368446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac27d-ac48-42d3-8ced-d0d764efdb4c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.368942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ac27d-ac48-42d3-8ced-d0d764efdb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.388576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0c0ac27d-ac48-42d3-8ced-d0d764efdb4c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:36.390146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c0ac27d-ac48-42d3-8ced-d0d764efdb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:36.436780 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:36.495279 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:36.591790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811773-6c20-4ed4-b85c-5c52a36092c0 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.592416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811773-6c20-4ed4-b85c-5c52a36092c0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.592898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a811773-6c20-4ed4-b85c-5c52a36092c0 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.594787 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 169/339] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:36.600010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.600557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.601068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.625856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:36.627347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:36.662457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b40e4-6581-42bb-9ebd-27d077de7422 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.663087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b40e4-6581-42bb-9ebd-27d077de7422 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.663557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b40e4-6581-42bb-9ebd-27d077de7422 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.665455 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 170/340] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:36.670593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:36.670871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:36.671148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:36.705242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:36.706783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:36.713072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 171/341] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:36.736777 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:36.786379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 171/342] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:36.838387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:36.961624 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:36.972117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b85c2-cf74-45c6-a306-204b7a5296c1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.020746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.021418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.021693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.021959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.034933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.036419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.050431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:37.057987 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:37.058949 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:37.059815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:37.059815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.059815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:37.062196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 172/343] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:37.070486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.166448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70da38-2fba-4243-99d5-9ac42c8ef1f8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.209306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.210270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.210482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.210896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.222924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.224510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.229682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd8de9-fa1e-4dd8-b230-aafa17665880 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-1f635457-b1bb-4438-b406-dd5d463d4ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:37.242203 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:37.243209 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:37.244078 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:37.244078 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.244078 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:37.244078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 172/344] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:37.244774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760b38-594e-4844-ada8-b14ddc909602 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.244774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760b38-594e-4844-ada8-b14ddc909602 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.245015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df760b38-594e-4844-ada8-b14ddc909602 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.249106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 173/345] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:37.249106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760b38-594e-4844-ada8-b14ddc909602 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.260811 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.275227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.275879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.276179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.276434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.277075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:37.277396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.278752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8be57-9fae-4a3c-be2b-acf1c24f49e3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.293492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 173/346] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:37.295267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.295857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.296247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.318828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:37.320841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:37.324142 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.355398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df760b38-594e-4844-ada8-b14ddc909602 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.389755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.390388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.390666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.390916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.396188 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 174/347] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:37.396924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.405434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.406982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:37.424683 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:37.425643 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:37.426494 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:37.426494 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.426494 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:37.426494 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 174/348] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:37.426494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.505718 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.524562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e894-0bf7-4424-bc06-40d0d7416e6c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.549783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0ced-6004-4462-b04e-4b77252607b4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.568817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.569690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.570106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.571145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.571932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:37.572848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.574673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.584350 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.588075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.588877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.589268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.589714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.590474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.592057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 175/349] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:37.592277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.593247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.694018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 175/350] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:37 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:37.698444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.706006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868085d2-7ebd-4cac-973d-16acfd8fb304 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.746740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.747363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.747644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.747915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.748572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:37.748904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.750685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.765738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 176/351] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:37.767042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.838385 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.856205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9534d-0c50-4095-b9e6-452fbd51a84d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.879385 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.892555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb967e-b47a-413c-affc-70bdbf012f71 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:37.902332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.903456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.903456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.904913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.905910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.907660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.936669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:37.937567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:37.937815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:37.938086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:37.951920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:37.954092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:37.970341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:37.971305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:37.972268 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:37.972268 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:37.972268 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:37.973651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 177/352] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:37.974512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:37.997697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 176/353] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:37 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:37.999491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:38.156189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244e9d-4aac-4e9d-8f2b-2a3f56c5642e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:38.171741 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:38.180387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d464e-4b11-47c2-95db-7135e7f02f23 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:38.205564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:38.206454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.207245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.207749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.209453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:38.212136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8dbb-71f3-4f30-acac-0e68b39b437d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:38.230811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:38.231482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.231766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.232035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.232765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:38.233071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:38.234823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b3cbe-deb6-4c5d-b890-49190fc75904 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:38.255093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 177/354] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:38.256354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83edd-b158-472a-9c7f-30262b586b3c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.256642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83edd-b158-472a-9c7f-30262b586b3c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.256914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83edd-b158-472a-9c7f-30262b586b3c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.258830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 178/355] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:38.263567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83edd-b158-472a-9c7f-30262b586b3c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:38.301826 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:38.350416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 178/356] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:37 2022] POST /identity/v3/users => generated 248 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:38.351508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.351806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.352075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.372730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:38.373799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:38.379988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83edd-b158-472a-9c7f-30262b586b3c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:38.447852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:38.448636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.448821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.449063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.451648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:38.455491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:38.489483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 179/357] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:38.585253 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 179/358] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:38 2022] POST /identity/v3/users => generated 249 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:38.783967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:38.893889 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:38.901435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf319b-24f6-43a1-997b-f0695bbf9435 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:38.942000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:38.942606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:38.942879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:38.943140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:38.943895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:38.945262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:39.007658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.sql.core [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:52:39.007658 n-d-master-1 devstack@keystone.service[82035]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:52:39.007658 n-d-master-1 devstack@keystone.service[82035]: [parameters: {'id': '594b128b6f0640c596a2e430ab1e271a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:52:39.007658 n-d-master-1 devstack@keystone.service[82035]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82035) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:52:39.015182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return ref.to_dict() Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:52:39.016051 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application yield resource Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise self.value Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application session.commit() Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:52:39.017044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:52:39.017991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:52:39.019996 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:52:39.021943 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [parameters: {'id': '594b128b6f0640c596a2e430ab1e271a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:39.023520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 30 00:52:39.024530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:39.026013 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 180/359] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 30 00:52:38 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:39.026149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:39.173701 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:39.180570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b03466-f224-4fa1-96f4-f98a515c7c13 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:39.235909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:39.236543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:39.236823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:39.237099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:39.252455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-46ed1972-d017-48c2-b00d-71cb857a8fb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:39.258083 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:39.260111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 30 00:52:39.262055 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:39.269589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 180/360] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:52:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:39.274285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:39.389600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811e4e1-4972-4df1-83d1-2217844edb96 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:39.427139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:39.427655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:39.427929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:39.428194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:39.428854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:39.429208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:39.430761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9669acb-1d38-465f-bb73-94191538b265 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:39.440025 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 181/361] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:40.155967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1236-5747-47f6-89cf-fded4d8b91fd None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:40.155967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1236-5747-47f6-89cf-fded4d8b91fd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:40.155967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1236-5747-47f6-89cf-fded4d8b91fd None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:40.155967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 181/362] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:40.165932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c49-fc59-4d40-a0de-59911546f74a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:40.165932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c49-fc59-4d40-a0de-59911546f74a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:40.165932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c49-fc59-4d40-a0de-59911546f74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:40.191145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b5ce4c49-fc59-4d40-a0de-59911546f74a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:40.192694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b5ce4c49-fc59-4d40-a0de-59911546f74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:40.217388 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:40.283148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 182/363] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:40.621464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1236-5747-47f6-89cf-fded4d8b91fd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:40.706923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196536-313b-4080-a7de-e957e375e8c1 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:40.707245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196536-313b-4080-a7de-e957e375e8c1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:40.707480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e196536-313b-4080-a7de-e957e375e8c1 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:40.709048 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 183/364] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:40.714407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:40.714690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:40.714966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:40.750775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:40.751124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1236-5747-47f6-89cf-fded4d8b91fd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:40.751965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:40.788589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:40.789247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:40.789591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:40.789859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:40.816070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:40.825318 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:40.826237 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:40.827034 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:40.831762 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 182/365] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:40.842323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:40.869692 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:40.901859 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 184/366] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:41.005016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f8fdb-6462-4655-8f1e-9caf14fa2771 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.048859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.049489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.049767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.050037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.050711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:41.051010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.052438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.060859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 183/367] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:41.066368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.182501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.192701 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.226029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60f883-546f-46f2-a2fb-9194b1a706a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.294044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.294685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.294958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.295225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.304272 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.314446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.316001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-5ecf993c-034e-4a56-b9aa-a6ef038f7aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:41.338807 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:41.339973 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:41.341015 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:41.341015 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:41.341015 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:41.343671 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 185/368] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:41.349161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0736b-375c-4892-802c-1233ce2f0850 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.350418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272d98-7e58-4713-a956-4e42c1523920 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.352599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272d98-7e58-4713-a956-4e42c1523920 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.353139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c272d98-7e58-4713-a956-4e42c1523920 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.354858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 186/369] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:41.355820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c272d98-7e58-4713-a956-4e42c1523920 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.401671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.402450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.402823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.403189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.420905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-9a6c99ab-8d55-4c77-a035-602286a3f038 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:41.428466 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:41.429546 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:41.430393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 184/370] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:41.431742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b107-0e70-4c33-a718-9b0f8c4d9d93 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.432021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b107-0e70-4c33-a718-9b0f8c4d9d93 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.432293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b107-0e70-4c33-a718-9b0f8c4d9d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.463139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f589b107-0e70-4c33-a718-9b0f8c4d9d93 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:41.465361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f589b107-0e70-4c33-a718-9b0f8c4d9d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:41.484126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c272d98-7e58-4713-a956-4e42c1523920 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.522699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.523330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.524135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.524454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.525094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:41.525750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.526801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.528472 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.544260 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 187/371] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:41.544456 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 185/372] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:41.544546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.544619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048239-980b-4273-b497-26bb8c4ad2c6 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.544619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048239-980b-4273-b497-26bb8c4ad2c6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.544619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab048239-980b-4273-b497-26bb8c4ad2c6 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.549179 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 186/373] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:41.549179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048239-980b-4273-b497-26bb8c4ad2c6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.635263 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.666117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fb518-81f1-41f3-a3d4-ef5ec21b5f1e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.676720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab048239-980b-4273-b497-26bb8c4ad2c6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.703077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.704051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.704784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.705324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.706212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:41.706790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.708476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f321b7-6d18-429f-b093-ed22a39b5fb9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.714403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.715061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.715375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.715704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.720910 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 188/374] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:41.722461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.722962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.723428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.728243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.729788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.742349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:41.743779 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:41.744703 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:41.746049 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:41.746849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:41.749781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 187/375] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:41.751147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.801194 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.819756 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 189/376] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:41.826412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.867527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9847-b474-40c4-926b-361d726fe158 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.895475 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:41.908275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.908905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.909185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.909506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.921040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.922535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:41.938558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:41.939695 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:41.940742 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:41.940742 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:41.940742 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:41.942971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d68a-1a32-4558-a3a0-e8424ef931ce None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:41.944293 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 188/377] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:41.945253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:41.981502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:41.982344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:41.982880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:41.983292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:41.984218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:41.984673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:41.986372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.028489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 190/378] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:42.029670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.058350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2be145-3cdd-480b-a8d2-69fcddffb54a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.097600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.098531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.099137 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.099871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.100820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.113952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:42.120706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:42.121926 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:42.122875 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:42.126295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 189/379] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:42.127533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.162959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a65667-7c22-42f8-beb9-0d5edef29973 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.167322 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.201922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.202613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.202794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.203101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.203773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:42.204071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.205992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.218809 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 191/380] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:42.219743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.243204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe21f-ddbe-45e3-b128-fd84ad3e551a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.276979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.277656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.277933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.278208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.288743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.290851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:42.304747 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:42.305736 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:42.306600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:42.306600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:42.306600 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:42.306600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 190/381] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:42.306824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.325188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daf587-47f8-4022-a9ae-4d26b2d996e5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.327643 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.358834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.359423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.359697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.359960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.360644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:42.360978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.362842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.375598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 192/382] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:42.376308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.394222 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.409800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282836d6-5b9b-4f5c-b46f-c6017da48151 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.478538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.479155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.479431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.479698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.489564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-9046fe68-a85c-4d61-b587-4429751642fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:42.494911 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:42.496040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:42.497041 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 191/383] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:42.498969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf318-0631-4502-9eea-afecfebba764 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.499259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf318-0631-4502-9eea-afecfebba764 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.499532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddf318-0631-4502-9eea-afecfebba764 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.500790 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 192/384] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:42.501498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf318-0631-4502-9eea-afecfebba764 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.515504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649db25f-d1bb-4d8c-b925-3fbc0e76c499 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.549707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.550328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.550605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.550929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] PATH_INFO: `/v3/users/glance` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.558935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.560370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:42.573396 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:42.574420 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:42.575905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:42.577574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.603726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddf318-0631-4502-9eea-afecfebba764 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.605379 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.637670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.638270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.638551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.638825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.639453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:42.639750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.641133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.653980 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:42.654799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.662999 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.681610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb146-3440-4459-b376-2014f1bf9a6c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.716268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.716885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.717158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.717456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.727748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.729193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-37d6a1ca-a9e9-40fa-baeb-5a85e7f59dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:42.743629 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:42.744549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:42.745520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:42.745520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:42.745520 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:42.745520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 194/387] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:42.745884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.746103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.746373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.760632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813382-2d62-44fc-89a5-6f49f39fadf8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.764256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:42.765463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:42.796628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.797297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.797600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.797872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.798530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:42.798829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.800188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.809931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 194/388] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:42.810740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.835752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 195/389] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:42.836670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:42.846308 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.893415 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:42.926917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d750-ae72-4b38-9a58-69a7f1d1b7b0 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.946637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e499c0-7b03-4212-89de-b3bd4cc7c214 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:42.967791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.968397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.968674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.968945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.969697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:42.969998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.971433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:42.980246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:42.980916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:42.981191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:42.981487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:42.988171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:42.989636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:43.001784 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:43.002697 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 196/390] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:43.003571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.013555 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 195/391] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 30 00:52:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.015191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.075653 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.109384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbe3a-ac8c-4969-a932-d00a71283a03 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.127592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d42dad-ef86-403a-829d-2e87c6700211 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.142893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.143491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.143768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.144033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.144672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:43.144967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.146394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.152565 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.158060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 197/392] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.161657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.166823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.166823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.166823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.166823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.173971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.175404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:43.190471 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:43.191380 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:43.192245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:43.192245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.192245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:43.192245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 196/393] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:43.192469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.264164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e06d-9f78-4dbf-b7da-c7c8ba195ab4 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.290730 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.295950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6271c2-5508-46f1-95e2-d52ebcc40881 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.298180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.298779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.299057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.299330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.300016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:43.300319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.301772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.319710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 198/394] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.320523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.331587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.332243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.332529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.332804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.344816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.346266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:43.361086 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:43.362048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:43.362906 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:43.362906 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.362906 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:43.362906 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 197/395] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:43.363698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.393880 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.422274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2134f8-0718-4055-9f72-7d03215c8d8c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.463174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c75cb-f026-44ae-b6a2-1b25a579f82d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.512037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.512655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.512762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.512935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.513207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.513294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.513614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.513888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.520263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.521696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.524191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.525651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:43.533224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:43.534205 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 198/396] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:43.535172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:43.542862 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:43.543772 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:43.544705 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:43.544705 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:43.544705 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:43.544705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:43.544931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.588938 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.633023 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.643014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41382-da7b-4462-89ed-f8ee1ddd57af None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.648366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ebe53-5d0b-4360-9033-4bfdc8bfccc9 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.676844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.677468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.677754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.678030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.678660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:43.678957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.680843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.681727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.682372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.682642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.683368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.692306 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.693091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.698059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=1449e0ef893c420e93cf26910f4a6a1f, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.699644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.778848 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 200/399] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:43 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:43.779577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.797846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a147c-ce17-4129-ab98-0cf81ebfb0f8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.839577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.840195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.840467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.840735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.841452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:43.841760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.843223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.856461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 200/400] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.857726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.873040 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.904105 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.915149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc83f-7c45-4b7d-bfab-338a3a9bce9f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:43.953751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:43.954615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:43.954978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:43.955208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:43.955936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:43.956236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:43.958441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:43.977422 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 201/401] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:43.978441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:43.996150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039bacf-9d20-4343-8fbe-025f485e1bf2 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.030830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.031351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.031629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.031899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.032549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:44.032846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.034261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.047520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 201/402] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:44.048353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.087559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a87cc-4d63-44d8-b4c0-77c91413be5e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.123041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.123675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.123892 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.124009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.124478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.131560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.133024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:44.145378 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:44.146349 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 202/403] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:44.147262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.160710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643738e-37bc-4f0f-9828-1a46fe323427 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.166657 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.196654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.197280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.197648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.197921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.205587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.207638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:44.221646 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:44.222551 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:44.223400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:44.225482 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 202/404] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:44.226280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.269205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37754e-99dd-4be1-800d-b17885128f5a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.302020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.302561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.302835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.303105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.314306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.315769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:44.330822 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:44.331741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:44.332605 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:44.332605 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:44.332605 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:44.332605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 203/405] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:44.332834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.343313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b901-1ebc-44e8-b1e3-ec4d6d15ceb1 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.376594 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.384038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.385448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.385448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.385448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.386106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.388173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.393994 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.434652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74badd9c-5a71-4f12-87da-bca7620b61b1 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.467819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.468416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.468689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.468955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.469739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:44.470041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.471470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.489523 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 204/406] 10.222.0.13 () {56 vars in 1139 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:44.490336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.533441 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 203/407] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:44 2022] POST /identity/v3/users => generated 247 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:44.533441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.613387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a807-9ef2-4c7f-823b-adb98eca8565 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.635120 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.658964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.659602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.659883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.660453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.661175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:44.661505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.664020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.673712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428d19-d898-4979-9fea-744fccaf9936 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.686118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 205/408] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:44.687642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.731825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.732833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.732833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.733185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.733987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:44.734289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.736477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.749686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 204/409] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:44.750491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.816453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3218c-5731-499f-8280-cc8d5feb60f9 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.817778 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:44.863090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.863768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.863989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.864252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.876267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c715a-062a-4417-979c-357ad617aa57 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:44.877728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.881403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:44.901256 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:44.902293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:44.903131 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:44.903131 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:44.903131 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:44.907977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 206/410] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:44.908109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:44.924232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:44.925293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:44.925734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:44.926022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/82ec9bbb37ef44fe8cf300e8f298498f/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:44.944621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=82ec9bbb37ef44fe8cf300e8f298498f, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:44.947280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:44.948690 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.020944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df7bf-8932-4494-9408-36db6d2b95fb None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.057704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 205/411] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:44 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/82ec9bbb37ef44fe8cf300e8f298498f/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:45.059117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.065904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.066629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.066905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.067175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.078779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.080716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:45.095142 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:45.096086 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:45.097180 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 207/412] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:45.102578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.261215 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.264407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7a43-1e73-4929-b1dd-7f0f6cb3238e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.278362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.293464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee571629-5fcb-4fbe-8c68-aaa0c2af31a8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.302670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.303274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.303552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.304053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.304517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:45.305258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.307212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.320897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 206/413] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:45.326367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.337536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.338511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.339020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.339493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.340388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:45.340894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.342805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.363216 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 208/414] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:45.370490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.455350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dabd15-323a-434f-97fe-8fbc003e3e76 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.492559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.493680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.494195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.494673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.502598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.504447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:45.517557 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:45.518439 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:45.519297 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:45.521808 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 207/415] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:45.530741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.598712 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.615587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca0e1f-03ce-438a-9e2b-1739f8a18755 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.665664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa28ac-45e8-4ada-8a32-cbe1ab978175 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.675184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.675898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.676176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.676442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/135b054aaaae4c84b280fe4e9908e240/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.692225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=135b054aaaae4c84b280fe4e9908e240, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.693696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebbff4-ecf6-41af-a1d8-d5c28c05e0e9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.725131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.725812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.726132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.726407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.727354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:45.727665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.729190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:45.748602 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 208/416] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:45.754649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:45.764539 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.769033 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 209/417] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:45 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/135b054aaaae4c84b280fe4e9908e240/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:45.876476 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:45.915818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d8668-a729-4ea7-8e75-6fccb9b6a090 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:45.966952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:45.967611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:45.967887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:45.968156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/85f46542ac5a496285440fb9421b1fab/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:45.983851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=85f46542ac5a496285440fb9421b1fab, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:45.985289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1956-5579-4819-94c6-459567aa6be0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:46.048811 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 209/418] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:45 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/85f46542ac5a496285440fb9421b1fab/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:46.255809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fa11-c9d8-4100-b0b8-5b2e9a4ee099 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:46.256180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fa11-c9d8-4100-b0b8-5b2e9a4ee099 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:46.256378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933fa11-c9d8-4100-b0b8-5b2e9a4ee099 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:46.257979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 210/419] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:46.263287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:46.263566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:46.263831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:46.286426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:46.287635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:46.362714 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 210/420] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:46.685887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fa11-c9d8-4100-b0b8-5b2e9a4ee099 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:46.806801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933fa11-c9d8-4100-b0b8-5b2e9a4ee099 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:46.843565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:46.844188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:46.844461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:46.844722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:46.857685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:46.862731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:46.863741 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:46.864540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 211/421] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:46.872052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:46.937901 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:46.978561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897330-034f-404c-9616-096dcf969aa5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:47.015081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:47.015696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.015968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.016236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.016915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:47.017214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:47.018628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345be13-5b3d-4742-8e89-a8a8cc2454ed None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:47.028429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 211/422] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:47.034264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:47.110218 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:47.162018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847cc28-beae-497e-8c34-15929b459388 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:47.221470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:47.222017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.222292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.222560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.236901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:47.238372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:47.248100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7863-74a0-4207-bf41-f2322f60aa7e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.248380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7863-74a0-4207-bf41-f2322f60aa7e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.248637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7863-74a0-4207-bf41-f2322f60aa7e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.249996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 212/423] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:47.255233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.255588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.255870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:47.257719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:47.258646 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:47.260539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:47.260539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:47.260539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:47.260539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 212/424] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:47.264228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:47.291586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:47.295019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:47.427810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da331d-7a58-4f14-b285-a56d27bcd9a5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:47.443767 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:47.446072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 213/425] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:47.466834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:47.467769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.468241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.468708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.469701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:47.470306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:47.472010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20b0e-da5c-4d69-aa09-db45c40d8603 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:47.485481 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 213/426] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:47.491156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:47.548182 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:47.605955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53c85a-9edd-4e7c-8012-d8b48675e77b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:47.642910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:47.643895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.644369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.644881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.652756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:47.654725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:47.662736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc270-047b-4e3a-abe7-05da249de68f None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.663297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc270-047b-4e3a-abe7-05da249de68f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.663783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dc270-047b-4e3a-abe7-05da249de68f None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.666610 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 214/427] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:47.673365 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:47.674462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:47.675382 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 214/428] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:47.678189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.678724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.679250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.689118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:47.716296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:47.719925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:47.825852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d25459-23a6-4b87-a87d-b39d75f87529 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:47.836381 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:47.862199 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 215/429] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:47.863288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:47.863759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:47.864675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:47.865126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:47.865674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:47.866794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:47.867263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:47.868970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:47.898014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 215/430] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:47.910526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.061449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b3e4-b696-4155-97da-a948970dfc6c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.089569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a088d-e91b-4b34-a7e0-fb9ebb669872 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.091189 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.099370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.099969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.100243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.100511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.139188 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.159482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.160959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.161762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.162308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.181922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:48.183221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.184656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:48.189154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:48.190212 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:48.191100 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:48.193985 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 216/431] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:48.199675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.312151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85346df-a502-41cb-a414-2d4b61220f6b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.330132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 216/432] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:48.331979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.361535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.362089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.362458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.362752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.375543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:48.380932 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:48.381875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:48.382875 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:48.385606 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 217/433] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:48.386493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.415267 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.435055 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.479122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ea17-271b-40d1-9e1f-94ef01a38918 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.499343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0085-8d53-4e0e-8d0d-48cb0cae77fa None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.519049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.519664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.519943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.520213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.521388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:48.521850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.523696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.537631 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 217/434] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:48.537631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.542165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.542801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.543082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.543352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.555782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.557232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-d78cb8ba-ebee-4cba-8074-ac892778e730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:48.575682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:48.576640 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 218/435] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d1b-87cf-4341-95d4-f4d69b6677ac None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d1b-87cf-4341-95d4-f4d69b6677ac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38d1b-87cf-4341-95d4-f4d69b6677ac None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 219/436] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:48.582483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38d1b-87cf-4341-95d4-f4d69b6677ac None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.652894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302bed9-f8e2-47ae-8fc6-dab4844ab6d8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.666227 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.680726 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.689169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.689810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.690092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.690367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.691025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:48.691185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38d1b-87cf-4341-95d4-f4d69b6677ac None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.691349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.692851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.702945 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 218/437] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:48.707933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.732342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.733120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.733268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.733556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.745279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.746762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f0d3cd13-ee17-44a8-b595-7b2f5660ec36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:48.762200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:48.763237 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:48.764165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:48.764165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:48.764165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:48.764165 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 220/438] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:48.764422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.764812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.764948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.782523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:48.783710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:48.824550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b859f-805f-4b9a-99b3-69bda11a7bbd None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:48.853079 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 221/439] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:48.854489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.866192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:48.867251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:48.868291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:48.868710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:48.869716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:48.870261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:48.871904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:48.888944 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 219/440] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:48.892807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:48.936655 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.952373 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:48.984335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd4a3-00f3-41bf-a930-4b46296cb379 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.012069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900e1e4-00dc-487e-a75d-a3d28040738b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.028287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.028921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.029358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.029651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.043851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.045301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.047657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.048576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.048863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.049187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.049885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.050217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.051567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac178a-7a41-4539-85ea-bae6753ba2a7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:49.062054 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.063037 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:49.063904 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:49.063904 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:49.063904 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:49.064680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 222/441] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.065027 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 220/442] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.066067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.066336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe757-7e68-4a44-8b20-6c961882384c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.066628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe757-7e68-4a44-8b20-6c961882384c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.066904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe757-7e68-4a44-8b20-6c961882384c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.072880 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 221/443] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:49.073875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe757-7e68-4a44-8b20-6c961882384c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.176971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed4d82-bf2e-4346-b29d-224363f5f941 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.179192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe757-7e68-4a44-8b20-6c961882384c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.186406 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.190559 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.210806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.211427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.211728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.212001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.213421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.214056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.214333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.214601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.215237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.215539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.216904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.219151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.220599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.229473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 222/444] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.230323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-328946c9-3bed-4dde-b97f-d358d58041f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:49.232496 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.233322 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:49.234906 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 223/445] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.235434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.235434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.235621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.253928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:49.255123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:49.322319 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 224/446] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:49.323161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.333539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6aa95-a1af-4b98-9b8b-0bf2be9a577f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.372504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.373127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.373441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.373704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.381426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.383994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:49.394028 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.394928 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 223/447] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.395951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.431513 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.432332 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.436640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9e4c4-3c81-4273-b58a-8a32880f90f0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.471706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.472258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.472535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.472803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.483667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:49.488747 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.489685 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:49.490484 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 225/448] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.491910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.509556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee84863-5ae3-4bb1-b0eb-8f85a7a396e5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.549220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.549876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.550180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.550444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] PATH_INFO: `/v3/users/glance` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.558364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.559946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:49.571971 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.572945 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:49.574868 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 224/449] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.578609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.609571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ea6bd-ee41-40bb-ab15-c4c99bec6ba2 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.643508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.644371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.644645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.644909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.645691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.645989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.647420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.659502 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 226/450] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.660284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.672888 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.680435 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.681829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0dbcd-eb89-462b-92bf-c332d431d39e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.716600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.717194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.717553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.717826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.718533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.718832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.720238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.737703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 225/451] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.738442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.760438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8a408-d58b-4408-9f15-87d64f726578 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.794029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.794627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.794908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.795180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.795896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.796195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.797627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.805823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 227/452] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.810790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.839366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1ef26-5918-458c-ac22-f075fd81d0b8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.873049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.873686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.873963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.874231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.874944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:49.875272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:49.878792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:49.887135 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.894891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 226/453] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:49.900920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.903599 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:49.907091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfb742-64ec-43bf-8f6b-f95184ad10a8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:49.940335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:49.940954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:49.946541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:49.946541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:49.951978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:49.957391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:49.958361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:49.959144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 228/454] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:49.959810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:49.995877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589521bc-1d18-4f7a-ad46-a5a6001666c7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.031079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.031691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.031963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.032232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.032940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=1449e0ef893c420e93cf26910f4a6a1f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:50.033238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.034679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.040459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 227/455] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/role_assignments?user.id=1449e0ef893c420e93cf26910f4a6a1f&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:50.041276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.067315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00b950-a5d8-4d94-94c8-d5a0464f2371 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.109524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.110416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.110869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.111280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.121538 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.121826 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.124517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.126102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:50.142213 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:50.148560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:50.150287 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:50.150287 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.150287 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:50.150287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 229/456] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:50.150287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.165316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4b5a-85c3-4478-8847-921b67587c3f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.205711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.206387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.206638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.206914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.219269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.220726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:50.237767 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:50.238776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:50.239652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:50.239652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.239652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:50.239652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 228/457] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:50.239878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.276761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24f8f6-33bf-44c2-ba62-a7a8beb9669e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.311254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.311972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.312315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.312644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.356159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431b853-fa33-4920-9a3d-730d83e7ce8e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.374728 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.384758 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.388399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.389962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.395109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.395897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.396245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.396577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.397301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:50.397693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.399618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.413673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 229/458] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:50.416108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.501261 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 230/459] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:50.501261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.530385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724420-2fa7-4f48-9783-2096a06ebf2f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.572255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.572993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.573274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.573603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.574257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:50.574559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.575934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.593500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 230/460] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:50.594436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.600879 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.610617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fff96-8839-47e8-a22e-39549d31e6f3 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.644701 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.647011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.647615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.647894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.648165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.648807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:50.649683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.651054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.663095 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 231/461] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:50.663710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.711085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaee1c-bf51-49b2-b154-6dd3b1a2942c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.750788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.751981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.752412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.752682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.765066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.766600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.773652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637832c-462b-4149-bd1e-146e6e0de5e8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:50.781817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:50.782699 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:50.788665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:50.788665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.788665 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:50.788665 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 231/462] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:50.788665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.815603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.816476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.816869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.817137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.829171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.830945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:50.846840 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:50.847849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:50.848700 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:50.848700 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:50.848700 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:50.848700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 232/463] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:50.848924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.853975 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.892829 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:50.902504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed770-06b1-42a3-af0c-f3dbd94d7152 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.939583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.940505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.941112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.941407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:50.949250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:50.950907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:50.957647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b80ba-5009-491b-b09e-549102a1e076 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:50.964187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:50.965123 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:50.966327 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:50.970060 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 232/464] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:50.970894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:50.997829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:50.998696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:50.999214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:50.999214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.007168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.009221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:51.021137 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:51.022108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:51.023016 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 233/465] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:51.023580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.086880 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.089425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd785ae-6c62-44c0-8d54-4a8d571eed36 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.127290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.127890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.128170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.128441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.128940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c446-7619-464f-9cbd-f859c28b19e7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.129132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:51.129464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.130818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.143950 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 233/466] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:51.144722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.163016 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.168080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.168792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.169165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.169570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.170277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:51.170641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.172074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.189208 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 234/467] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:51.189208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.251044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832404d-3bdb-426a-957f-7c6a0956df97 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.293635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.294249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.294532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.294807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.295498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:51.295805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.297236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.301514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abaa23-356a-47a4-860a-0d5ba294a902 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.308957 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 234/468] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:51.309995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.332248 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.344554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.345229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.345718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.346028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.346852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:51.347254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.349300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.371860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 235/469] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:51.371860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.394378 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.417530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af89e32-1c8e-4147-929c-e5cb58786f50 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.450240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.450853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.451127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.451392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.459109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.461149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:51.472980 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:51.474084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 30 00:52:51.474972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:51.479014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 235/470] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:51.479706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.520036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d92a-0969-48e3-bda9-9eb42c6d3117 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.555938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.556779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.557203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.557644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.565805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.567586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:51.580779 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:51.581702 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:51.582563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 236/471] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:51.583025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.590779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e1ae-c193-445b-aaa5-6cd3c2b3e4e3 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.626836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.627419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.627697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.627966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/88425fb345824272be839024c9316741/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.631368 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.631851 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.644796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=88425fb345824272be839024c9316741, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.646266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.690825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d52368-e0c5-42f3-afa8-82d23a829cd4 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.725277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.725909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.726189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.726460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.737549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 236/472] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:51 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/88425fb345824272be839024c9316741/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:51.746378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.824101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.825800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.873509 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.874702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a25a-fb7b-46c5-9eab-6f019b43fadf None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:51.916603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:51.917498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:51.918003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:51.918282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:51.919014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:51.919321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:51.920772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:51.940771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 237/473] 10.222.0.13 () {56 vars in 1139 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:51.941293 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 237/474] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:51.941919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.950828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:51.991067 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.046785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ac250-0c0b-4d58-8b25-585f7ca84f8c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.086167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cf787-3554-44a8-bca9-7d40a4b2e4ff None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.088016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.088628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.088907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.089179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.090005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:52.090541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.091733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.104773 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 238/475] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:52.105751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.127375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.127981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.128306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.128579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.141417 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.226825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f83c-642b-44b9-91a5-a007f025b62f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.229025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.230598 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.232936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bfd2d-f958-4816-ba07-466bb433e646 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.275763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.276763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.277260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.278268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.293362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.296196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:52.314271 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:52.315245 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:52.316229 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:52.316229 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:52.316229 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:52.317150 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 239/476] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:52.317379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.349392 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 238/477] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:52.349392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4e58-3368-4ae3-acc7-9cc59f481f11 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.349392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4e58-3368-4ae3-acc7-9cc59f481f11 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.349392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4e58-3368-4ae3-acc7-9cc59f481f11 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.350133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 239/478] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:52.350593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4e58-3368-4ae3-acc7-9cc59f481f11 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.401361 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.429249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a392f-4ead-44b5-9a49-0862cfedb302 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.466120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4e58-3368-4ae3-acc7-9cc59f481f11 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.467128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.467734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.468015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.468283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.469015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=82ec9bbb37ef44fe8cf300e8f298498f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:52.469326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.470865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.485441 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/role_assignments?user.id=82ec9bbb37ef44fe8cf300e8f298498f&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:52.485441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.507354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.507974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.508251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.508552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.509994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:52.510308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.511736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed497a-ac5e-4c71-bee1-90b7f1109b1b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.528891 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:52.528891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.528891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.528891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.543715 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.546920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:52.548173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:52.615938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2312c-b497-40ad-a858-495a72a518c1 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.625428 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 241/481] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:52.626365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.654922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.656062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.656556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.657055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.658707 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.671262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.673188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:52.699139 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:52.700111 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:52.700942 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:52.700942 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:52.700942 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:52.703113 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 241/482] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:52.708703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.744452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c8c4-3fc4-4f82-a5c9-cc2440110f5e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.793740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.794889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.796004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.796495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.805160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.807598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.818666 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:52.822777 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:52.823826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:52.825108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:52.833003 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 242/483] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:52.834435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.859036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e2720-427a-4e6a-9512-ed21d647510f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.902069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.902968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.903453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.904023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.904981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:52.905543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.907197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.921737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 242/484] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:52.927237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:52.931889 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:52.940944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083c73-634e-4af1-b3dc-c866b61ca7a6 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:52.976292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:52.976908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:52.977190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:52.978003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:52.978701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:52.979004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:52.980433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:52.992633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 243/485] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:52.999806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.049822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15d4a-055f-4153-87ac-31a0661fe5ba None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.088657 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:53.098620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.100233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.101619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.101619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.111545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.114304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.123893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1888e8c-9d95-4f17-a827-c3995b6e5915 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:53.130765 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:53.131605 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:53.132474 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:53.134704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 243/486] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:53.136068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.168446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.169181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.169567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.170032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.170958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=135b054aaaae4c84b280fe4e9908e240) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:53.171315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.172920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.181816 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 244/487] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:52 2022] GET /identity/v3/role_assignments?user.id=135b054aaaae4c84b280fe4e9908e240&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:53.183067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.204150 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:53.276828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210585-6235-44eb-9678-f132c2046310 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.318933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.319954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.320434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.320904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.336670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:53.341910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbc65-71cd-47eb-8130-4a1b983325d0 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:53.343847 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:53.344718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:53.345524 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:53.348737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 244/488] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:53.357448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.410177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.410870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.411154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.411427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.412141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:53.412446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.414036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.433780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 245/489] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:53.439930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.484542 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:53.548266 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:53.555435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc1f7a-990e-47a5-96e6-cdd2f2a4102a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.580602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad86e8-3b19-40fa-b575-4973e90a117a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.606467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.607940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.608739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.609212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.610361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:53.611399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.613518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.623320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.624598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.625124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.625438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.626196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=85f46542ac5a496285440fb9421b1fab) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:53.626479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.626826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 245/490] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:53.628020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.631819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.636416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 246/491] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/role_assignments?user.id=85f46542ac5a496285440fb9421b1fab&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:53.748024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c6192-ce33-434b-a608-d2548a7ca306 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:53.764836 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:53.787687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:53.788740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:53.789254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:53.789762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:53.802529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:53.804446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:53.822200 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:53.823561 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:53.824472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:53.824472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:53.824472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:53.826758 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 246/492] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:53.832499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:53.986685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a93c7-23f7-4632-b8cc-bdcc5769f26f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.025630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26395226-b006-47ab-9416-322a46cab51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:54.026239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395226-b006-47ab-9416-322a46cab51d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.026518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395226-b006-47ab-9416-322a46cab51d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.026790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26395226-b006-47ab-9416-322a46cab51d None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.027459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395226-b006-47ab-9416-322a46cab51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:54.027759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395226-b006-47ab-9416-322a46cab51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:54.029514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26395226-b006-47ab-9416-322a46cab51d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:54.040660 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:54.045154 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 247/493] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:54.050484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.100376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9728-4cd2-4f68-b2e6-6a5852caa02e None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.100675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9728-4cd2-4f68-b2e6-6a5852caa02e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.100901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f9728-4cd2-4f68-b2e6-6a5852caa02e None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.103031 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 248/494] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:54.109020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.109308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.109605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.130961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:54.132389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:54.183554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef56e97-5734-40c2-9280-517f7acce4d8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.242277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 249/495] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:54.249933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:54.250653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.251007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.251350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.260072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:54.261692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:54.273284 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:54.274502 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:52:54.275601 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:54.281383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 247/496] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:54.282614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.433033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c7b01-bd4b-4df5-b777-e95e1797e5fb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.465983 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:54.472252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:54.472918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.473202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.473590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.474320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:54.474622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:54.476061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:54.498571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 250/497] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:54.504299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.550477 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:54.565702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.658434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13464989-7991-4ebb-8d1e-f8eff594f647 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.705303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:54.706323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.706914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.707190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.730867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:54.733951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:54.757966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e482c-6698-4234-8356-c4fd82d01660 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:54.761751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:54.762652 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:54.763525 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:54.763525 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:54.763525 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:54.769913 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 248/498] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:54.781408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.823309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:54.823942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:54.824220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:54.824491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:54.846026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:54.850922 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:54.851918 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:52:54.853750 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:54.855716 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 251/499] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:52:54.860054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:54.920872 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:54.942854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f497b6f-6309-4b0f-a75e-9aa5b6d08b88 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:54.960065 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.013421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.014036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.014316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.014588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.015229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:55.015531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.016909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.046119 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 249/500] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:55.050514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.053820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d63439-c6bd-4a0e-9772-d8caec04315d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.092098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.092707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.092986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.093258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.093962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:55.094261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.101384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.104377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 252/501] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:55.130390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.194340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06fddc-ad0a-49da-8b55-3c75bf568284 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.243601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.244166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.244447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.244723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.259541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.260988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.267200 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:55.282568 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:55.284583 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:55.285489 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 250/502] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:55.289973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.349026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07ac8-ec83-4e47-bb9f-a9c01c833bdf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.365506 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.393741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.394811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.395186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.395801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.409571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.413358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.416443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb45c6-f0e8-4d95-af29-3deb7c2aab4e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-fe8deafc-d6fc-418e-87cc-cdc13d8f7377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:55.430698 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:55.431805 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:55.433305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:55.433305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:55.433305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:55.433305 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 253/503] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:55.437409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017d87-886a-4506-a0d8-06defe50758e None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.437409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017d87-886a-4506-a0d8-06defe50758e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.437409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017d87-886a-4506-a0d8-06defe50758e None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.440134 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 254/504] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:55.440134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017d87-886a-4506-a0d8-06defe50758e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.460215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.460970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.461246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.461581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.463145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:55.463280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.464777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e01a5f-f77a-4071-b576-3b26db9cabd9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.478608 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 251/505] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:55.479969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.480308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.480627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.500761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:55.501784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:55.560532 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.564554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017d87-886a-4506-a0d8-06defe50758e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.581625 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 252/506] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:55.582842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.605530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.606423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.606707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.607030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.607690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:55.607992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.609641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.624907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 255/507] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:55.634928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.661043 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.796234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43144d72-6e7d-453c-aadd-dda12414ca9a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.800371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85146d8e-7dd7-4acf-971e-65935e013f45 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:55.844113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.846049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.846533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.847890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.854782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=1449e0ef893c420e93cf26910f4a6a1f, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.856442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.881203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:55.882559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:55.883043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:55.883494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:55.896299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:55.897865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:52:55.910941 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:55.911946 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:55.912872 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 256/508] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:55.913521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:55.934332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 253/509] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:52:55 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:52:55.935474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.034318 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.052501 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.058977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8d90a-c8b3-46c2-b991-71fbe6d3fc90 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.098821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.099463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.099742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.100066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.113909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.115412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-62641c3e-4ad0-45b5-802e-17f6066b0062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:56.132044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:56.133036 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:56.134072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:56.134072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:56.134072 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:56.134072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 257/510] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:56.134876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948dca-fbd8-4b63-9e16-ef47ccc16559 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.134876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948dca-fbd8-4b63-9e16-ef47ccc16559 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.135979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948dca-fbd8-4b63-9e16-ef47ccc16559 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.137592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 258/511] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:56.140990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81948dca-fbd8-4b63-9e16-ef47ccc16559 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.152619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a80c6f-9863-4574-b4a3-a841641c8e91 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.194866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.195524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.195772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.196482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.197254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:56.197602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.199494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525010fb-56cf-4f4b-9271-f7d211a64e31 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.223339 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 254/512] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:52:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:56.225058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.229952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.230294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.250102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:56.251696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:56.279116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81948dca-fbd8-4b63-9e16-ef47ccc16559 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.325458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.326377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.326842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.327243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 255/513] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:56.327557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.328162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.328718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:56.329201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.331331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.334116 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.349422 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 259/514] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:56.355702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.375828 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.460174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5d60-ab81-4004-9f6c-79ce99063f4c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.477224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce27ea-2261-49a5-b33f-70ea44c50f52 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.515329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.516483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.517748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.518928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.534774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.535766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.536322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.536808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.537694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.541593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d27b8-a62e-42f8-a0ef-fb817992e545 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.613269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.615213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.626302 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 260/515] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:52:56 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:52:56.635604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf3bc-584c-4105-b2c5-71eef8ddec49 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.636258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf3bc-584c-4105-b2c5-71eef8ddec49 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.636691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf3bc-584c-4105-b2c5-71eef8ddec49 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.639367 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 261/516] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:56.652582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.653262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.653789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.666590 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.684706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:56.686261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:56.756657 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 256/517] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:56.757348 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.757566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.785682 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 262/518] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:56.786641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:56.913362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866822e-a713-4285-8354-812ea8cdcb7e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.939201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda9f1-1b28-4102-960f-a848f277288a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:56.956695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.957850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.958135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.958404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.973597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.975675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.981829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:56.982462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:56.982796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:56.983073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:56.983657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:56.985009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:56.990443 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:56.994497 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:56.995453 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:56.996446 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:56.996446 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:56.996446 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:56.996446 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 263/519] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:56.998778 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:57.004166 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:57.006288 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 257/520] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 30 00:52:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:57.008181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.008270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.098423 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.124329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4c602-6b2d-46d7-a781-42576e337900 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.162452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.163058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.163334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.163605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.164230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.164529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.166316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.171803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 258/521] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:57.172232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.196147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1af02-f4ad-4bec-830a-9bf1f1104d54 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.243125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.244879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.245794 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.247410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.247891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.248762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.249503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.251899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.268274 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 264/522] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:57.270189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.288868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d682444-8e5c-452c-83b8-c651472e4587 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.328460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.329115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.329488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.329762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] PATH_INFO: `/v3/services/network` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.330596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.332161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:57.342521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:57.343589 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:57.344477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 259/523] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:57.345283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.391979 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.401970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d364b-bc95-4642-a914-661170c56c0c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.439820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.439820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.439820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.439820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.440255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.440255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.441586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.448452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 265/524] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:57.449465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.465233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc48e7-93d6-487a-8db8-9f63ddd7aa90 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.497208 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.522279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.522930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.523205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.523474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.540611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.545165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:52:57.569204 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:57.570233 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:57.573446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 260/525] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:57.579876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.645015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af636-c35e-4829-9b17-3bbd4843e896 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.695473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.696043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.697310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.697628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.698265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] RBAC: Adding query filter params (name=network) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.698566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.700393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.706710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 266/526] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:57.713463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.739443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8598e4-0cab-46bd-ac6c-86b8bd8400ad None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.762540 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.795866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.796634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.796916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.797196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.797948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.798261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.799733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.821109 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 261/527] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:57.828161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:57.906087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868969-148d-411a-9202-00ffc15ae23d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:57.921209 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:57.976555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:57.977090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:57.977363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:57.978187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:57.978833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:57.981373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:57.981373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faedc0a-849c-428c-9f7f-76a95ad8f2f6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:57.986157 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 267/528] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:58.031902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbc4ef-99ef-4532-8870-3263430dea9b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:58.085989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:58.086610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:58.086891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:58.087741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:58.088483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=88425fb345824272be839024c9316741) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:58.088791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:58.090276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d794d7-75a5-4071-b6b5-713468cb3f8a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:58.103446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 262/529] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:52:57 2022] GET /identity/v3/role_assignments?user.id=88425fb345824272be839024c9316741&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:52:58.430386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ac17-b015-4a13-a2c5-5e3c608e1ffe None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:58.431768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ac17-b015-4a13-a2c5-5e3c608e1ffe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:58.432259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ac17-b015-4a13-a2c5-5e3c608e1ffe None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:58.434110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 268/530] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:52:58.439568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:58.440423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:58.440924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:58.461165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:58.463226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:58.541279 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 263/531] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:58.884541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ac17-b015-4a13-a2c5-5e3c608e1ffe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:59.001214 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:59.022156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5ac17-b015-4a13-a2c5-5e3c608e1ffe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:59.069146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:59.069804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.070082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.070354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.086497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-20779fc8-b4c1-4bf4-8de4-2213df7166ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:52:59.091974 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:59.092905 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:52:59.093765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 269/532] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:59.105866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:59.200898 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:59.279377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9829f4d-cdc9-4365-857b-1ae90f5373da None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:59.282018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ef6e-daf6-4fe7-86d5-74c4def7e175 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.282522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ef6e-daf6-4fe7-86d5-74c4def7e175 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.283322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505ef6e-daf6-4fe7-86d5-74c4def7e175 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.285102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 270/533] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:52:59.290956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.291504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.291984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.314249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:52:59.315821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:52:59.345480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:59.346467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.347230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.347742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.349658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:59.350177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:59.352052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:59.369789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 264/534] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:59.376116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:59.468036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 271/535] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:52:59.511028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926068-d4d5-478a-a76b-c4427b0a09e6 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:59.514183 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:59.563532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:59.564164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.564443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.564715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.582450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:59.584301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:52:59.600517 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:52:59.601527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:52:59.602520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:52:59.602520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:52:59.602520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:52:59.605226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 265/536] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:52:59.610631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:59.737865 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:59.774669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003db60-fcea-4f24-b15a-ff99e7749c9b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:52:59.816070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:52:59.816672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:52:59.816946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:52:59.817214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:52:59.817877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:52:59.818174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:52:59.819542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:52:59.835892 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 272/537] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:52:59.842142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:52:59.887749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.011405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058c61-b652-431c-bcef-dbe31861c9f3 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.040960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a201-7e42-442b-874d-a8883930ea4c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.063627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.064322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.064604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.064875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.068377 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.090870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:00.096115 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:00.097181 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:53:00.098144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:00.102052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 273/538] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:00.104039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.122799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.123429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.123707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.123983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.139722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.144558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:00.172916 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:00.173998 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:00.174952 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:00.176560 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 266/539] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:52:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:00.180991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.215694 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.264882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae490-302e-4cf3-bc16-89df0415dd96 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.307727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.309301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.309615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.310189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.310928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:00.311233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.312620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0da0d-f764-4a7f-8e05-1872477e99b1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.323946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 274/540] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:00.325190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5347-6457-4a4f-bd5c-ec1d921a1eeb None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.325638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5347-6457-4a4f-bd5c-ec1d921a1eeb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.325916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd5347-6457-4a4f-bd5c-ec1d921a1eeb None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.327126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 275/541] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:00.332557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd5347-6457-4a4f-bd5c-ec1d921a1eeb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.347283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bae67a-16d7-4895-be3d-e50eac42ff5c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.387515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.388130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.388409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.388686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.389548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:00.389863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.391371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc3e16-a410-4c4d-be73-0b965ef46ce2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.396695 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.419859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 267/542] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:00.419859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.419859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.419859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.451157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd5347-6457-4a4f-bd5c-ec1d921a1eeb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.524420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:00.526253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:00.547170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.548238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.548767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.549224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.560955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.562767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:00.580174 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:00.581587 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:00.582509 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:00.582509 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:00.582509 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:00.589972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 276/543] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:00.591268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.610532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 268/544] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:53:00.611467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.615246 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.748444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5dd3-dc73-42bb-956a-fa76edd00f54 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.758555 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.770423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ba3c3-0d67-4b4e-834e-15dec3e715f0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:00.786891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.787534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.787912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.788284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.812666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:00.813841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.814385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.814812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.815642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:00.816115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.817858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3a2e9-6249-46dc-b01d-8c63424fa1d7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.832498 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 269/545] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:00.834137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10616d9a-33cc-46e0-abc1-d26903db9ab8 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.834634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10616d9a-33cc-46e0-abc1-d26903db9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.835128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10616d9a-33cc-46e0-abc1-d26903db9ab8 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.836576 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 270/546] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:00.842142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:00.842791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:00.843285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:00.863014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:00.864529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:00.873823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:00.875028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:00.933657 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:00.941933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 271/547] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 00:53:00.960049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.980561 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 277/548] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:00.986163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:00.996119 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.051050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d1354-6a80-42ad-a86b-797dfcf55ca9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.085640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.086266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.086540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.086808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.094571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.095994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.099452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d306f3d-fdbf-45a9-b722-191b42d4c694 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c144335a-9d04-4efc-88c7-02c6e3db4ef4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:01.108085 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:01.109059 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 272/549] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:53:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1e96-9e7a-4b59-bbe0-0b6a69218cff None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.115247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1e96-9e7a-4b59-bbe0-0b6a69218cff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.115979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1e96-9e7a-4b59-bbe0-0b6a69218cff None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.116654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 273/550] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:01.117303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1e96-9e7a-4b59-bbe0-0b6a69218cff None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.143645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.144598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.144948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.145227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.145896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.147285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.177625 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.222632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1e96-9e7a-4b59-bbe0-0b6a69218cff None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.249791 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 278/551] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:00 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:01.250800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.278149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.278810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.279093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.279360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.291407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.292857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-d6a1bbe0-5b3f-4d16-8dc4-baf1a927afa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:01.308972 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:01.310092 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:01.310979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:01.310979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:01.310979 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:01.310979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 274/552] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:01.312370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.312654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.312926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.334053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:01.335387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:01.342726 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.385643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00906a-912a-4b74-862e-7346a249383f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.421378 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 275/553] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 00:53:01.421378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.424780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.425547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.425831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.426104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.426840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:01.427150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.428588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.450805 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 279/554] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:01.451976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.465101 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.552061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c86f4-eacd-4704-9339-5683f9c0092e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.582400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededcffc-5142-4464-beee-a1cb3106db16 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.589658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.590264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.590540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.590812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.591462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.592810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.613922 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.624429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.625247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.625690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.626148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.626934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:01.627447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.629026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.641754 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 280/555] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:01.642813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.674169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 276/556] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:01 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:01.675376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.771891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1be0-813f-4f31-8d37-d3c00a6a9288 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.797991 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.815233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ee60-8ea0-4404-89d3-40ddb3fe8388 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:01.821316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.822614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.822887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.823152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.835853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.837359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:01.854108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:01.855127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:01.856043 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:01.856043 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:01.856043 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:01.856043 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 281/557] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:01.856814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.863964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:01.864934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:01.865467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:01.866105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:01.875434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:01.877163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:01.895712 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:01.896694 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 277/558] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:01.898776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:01.911682 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:01.985455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9558b-c9f4-4b08-a273-5ba020141397 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.025101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.026024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.026301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.026609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.042418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:02.042903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8887d3-db31-4a5b-871c-45bbdda568d6 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:02.049132 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:02.050393 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:02.051225 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 282/559] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:02.052838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.089481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.090013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.090291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.090559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.091203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.091666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.093707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.109192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 278/560] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.113830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.130316 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.169611 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.178050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23387288-5ef8-4991-9ee6-0a87695f48d8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.215146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.216001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.216465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.216932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.217796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.218243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.220048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.233284 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 283/561] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.235086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.243345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1b96d-c4cb-47da-9336-7f5c0064d9cd None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.287922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.288719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.289100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.289602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.290535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.290993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.292516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.302602 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 279/562] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.303691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.347282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b97376-14a2-4949-ba4d-ceaad3f54b43 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.381223 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.383809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.392480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.392480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.392480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.392480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.394094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:02.405906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:02.406815 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:02.407724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 284/563] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:02.408227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.419174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea584aa-9f58-4920-bc61-cb6048738426 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.427453 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.458585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.459677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.460228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.460684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.461605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=1449e0ef893c420e93cf26910f4a6a1f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.462084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.464278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.471703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 280/564] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/role_assignments?user.id=1449e0ef893c420e93cf26910f4a6a1f&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.472916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.523346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d07418-dcd9-406a-90f5-4aa0006502b6 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.562203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.563055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.563219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.563612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.576180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.577810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:02.594532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:02.595549 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:02.596443 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:02.596443 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:02.596443 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:02.596443 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 285/565] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:02.601892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.606127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db10df-798f-46df-bfc0-e428ce5f45c5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.656306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.657325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.657877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.658359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.659290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.659807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.661531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.664574 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.677841 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 281/566] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.693709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.702071 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:02.767473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044b6a-3dcd-4aff-b3d7-a9b1285b4fc3 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.813015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.813659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.813931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.814195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.814830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:02.815124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.816483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.833137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 286/567] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:02.838598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:02.846962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c464e-1a2d-498f-b75c-00beb9151d44 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:02.903763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:02.904844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:02.905117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:02.906491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/9833a132beb6400aa12dd449c3bca42c/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:02.926286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=9833a132beb6400aa12dd449c3bca42c, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:02.927710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:02.983193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b3d9a-7b4b-43be-9f11-d54f932d2477 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:03.021500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 282/568] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:02 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/9833a132beb6400aa12dd449c3bca42c/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:03.023678 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:03.034276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:03.035151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.035436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.035769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.044688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:03.046385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:03.059839 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:03.062195 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:03.064406 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 287/569] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:03.075851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:03.148636 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:03.220554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5000-ed58-476d-9cdc-56f7080c3720 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:03.268441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:03.269475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.269992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.270463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.271392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:03.271895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:03.273583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:03.293782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 283/570] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:03.301250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:03.450124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869564d-443b-46e2-a9f7-d9e2556eea28 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:03.485893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:03.486528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.486806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.487080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.498400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:03.499921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:03.514812 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:03.515849 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:03.516795 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:03.516795 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:03.516795 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:03.516795 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 288/571] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:03.521577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:03.684620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba4184-8a1c-4077-8358-9d6597e2fef8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:03.686251 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:03.725117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:03.726033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.726493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.726968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.728120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:03.728611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:03.730174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bf1ca-399e-4fa9-83b3-21ef359ecce1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:03.747150 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 284/572] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:03.753067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:03.807946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877cc2-24a5-46d6-bba3-457e810e7e18 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.808665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877cc2-24a5-46d6-bba3-457e810e7e18 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.809176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877cc2-24a5-46d6-bba3-457e810e7e18 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.811043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 285/573] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:03.813925 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:03.818505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.819021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.819519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.842878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:03.844150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:03.904391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bdc62-5a16-4443-a574-b6fb7d28166c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:03.955303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 286/574] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:03.969656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:03.970285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:03.970564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:03.970831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:03.977862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:03.979407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:03.991066 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:03.991995 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:03.992888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 289/575] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:03.999717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:04.115237 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:04.124952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189e6d-f0d2-4c86-b1c4-3f6b067e589f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:04.160141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:04.160812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.161101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.161402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.162287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:04.162602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:04.164050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24105c6a-e55f-44da-ac2a-63613a4d0373 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:04.177025 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 287/576] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:04.183681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:04.292125 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:04.297983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cf474-ec5d-4e13-8875-5aeb0f74bf95 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:04.336409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:04.337047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.337365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.337659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/88425fb345824272be839024c9316741/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.340054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=88425fb345824272be839024c9316741, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:04.341514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:04.424653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d585-48e7-4ea8-9252-dd967465de28 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.425056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d585-48e7-4ea8-9252-dd967465de28 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.425244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90d585-48e7-4ea8-9252-dd967465de28 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.426910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 288/577] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:04.432120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.432407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.432683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.446623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 290/578] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:04 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/88425fb345824272be839024c9316741/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:04.462129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:04.463902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:04.482622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:04.652714 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 289/579] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:04.729784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb09e8-3a71-412f-94e8-e0d40b1b5f7d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:04.764929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:04.765583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.765859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.766127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.766707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:04.768066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:04.779791 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:04.780884 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:04.781978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 291/580] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 30 00:53:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:04.786843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:04.906367 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:04.933563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063009a3-cb93-4e1e-a7ed-9874bcdcbb52 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:04.982959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:04.983575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:04.983851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:04.984120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:04.984745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:04.985040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:04.986422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:04.993198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 290/581] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:53:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:04.999032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.024231 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.065856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.163592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b5ea2-0968-4867-8508-c92d7816d6cc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.185111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7ff28-f39d-4c3d-9e41-a804a78b6295 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.223724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.225322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.225876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.226519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] PATH_INFO: `/v3/services/network` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.227320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.229713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:05.240021 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:05.241093 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:05.242014 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:05.244846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 291/582] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:05.251917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.281752 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.290029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.291213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.291529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.291840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.292407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:05.292703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.294104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.311802 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 292/583] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:53:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:05.317483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.371988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9186ff-abe6-469a-a4e4-68f2af665013 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.412730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.413818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.414407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.414880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.416310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] RBAC: Adding query filter params (name=network) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:05.416811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.418523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.424333 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 292/584] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:05.431146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.532838 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.533670 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.550097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccbdb-cb3b-492e-8478-a8bc6c419f4b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.555025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2602-587d-4d4d-ab62-4c0317a910c6 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.588866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.589804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.590356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.590635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.591307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] RBAC: Adding query filter params (type=network) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:05.591611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.592977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97102-eabf-4903-a6e4-73cece9dfd7c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.594973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.595580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.596204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.596479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.597543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] RBAC: Adding query filter params (interface=public, service_id=13bba6ed35c049cab3667f560ba05487, region_id=RegionOne) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:05.597848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.599745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 293/585] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:05.600941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b638776-295d-4870-bf84-3e039739d907 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.601223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b638776-295d-4870-bf84-3e039739d907 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.601556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b638776-295d-4870-bf84-3e039739d907 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.602907 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 294/586] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:05.604628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94067aa9-8c96-44eb-855b-514c2642daf7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.606462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab79b0-514b-4df9-94ba-b8d5f1d44b20 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.606967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab79b0-514b-4df9-94ba-b8d5f1d44b20 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.607507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab79b0-514b-4df9-94ba-b8d5f1d44b20 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.608916 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 295/587] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:05.612676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 293/588] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/endpoints?service_id=13bba6ed35c049cab3667f560ba05487&interface=public®ion_id=RegionOne => generated 194 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:05.617407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e841da-2eae-44e1-8443-2260d094bfdd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.617551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab79b0-514b-4df9-94ba-b8d5f1d44b20 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.617633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e841da-2eae-44e1-8443-2260d094bfdd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.617633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e841da-2eae-44e1-8443-2260d094bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.636293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-75e841da-2eae-44e1-8443-2260d094bfdd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:05.637524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75e841da-2eae-44e1-8443-2260d094bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:05.721456 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 294/589] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:05.721456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.721456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.721456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.736951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab79b0-514b-4df9-94ba-b8d5f1d44b20 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.737719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:05.739083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:05.778512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.779288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.779648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.780048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.780839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] RBAC: Adding query filter params (interface=public, service_id=ce3bd7dd0d2142b091aa4cb4259c5ec6, region_id=RegionOne) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:05.781321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.783083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.792475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 296/590] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/endpoints?service_id=ce3bd7dd0d2142b091aa4cb4259c5ec6&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:05.793462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.796460 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.824222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 295/591] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:05.825739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:05.841475 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.915391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a6d33-d216-4044-a656-8436f916dd8d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.953892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf9b9-47b2-4f10-ba4a-6867612c2ab7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:05.993451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.994880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.995320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:05.995733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:05.996293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:05.996693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:05.997115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:05.998392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:05.999642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.000034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.001006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.002651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.005143 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 296/592] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:06.015518 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 297/593] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:05 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:06.135584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.170758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.252416 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:06.276942 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:06.282860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbe288-1ed5-45a0-b21f-ee4344b852a3 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.317860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb936de-2383-4c76-b869-11c2df2d753d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.326621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.327542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.328005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.328504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.343327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:06.350333 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:06.351316 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:06.352160 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 297/594] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:06.360362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.365119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.365996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.366451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.366874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.367604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.369156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:06.379330 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:06.380521 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:06.381620 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:06.383327 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 298/595] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:06.390313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.540191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d38d7-0612-435c-9432-07cd199c544c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.553867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c141d3-71ac-4750-81f3-20daf13cb0f7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.579560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.580168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.580439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.580707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.581667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:06.581962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.584063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.585816 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:06.595581 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 298/596] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:06.606308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.612254 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:06.618137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.618941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.619209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.619537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.620172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:06.620471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.621876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.631510 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 299/597] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:06.633365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.747709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5cf0b-f66e-408e-a6d0-05eee6a81fca None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.785242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.785927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.786223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.786510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.795724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d932-c5f6-420a-9ebe-44e940d1e68f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:06.797154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.798634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:06.823614 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:06.824667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:06.826071 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:06.826071 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:06.826071 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:06.826071 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 299/598] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:06.830742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:06.845548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:06.846587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:06.847083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:06.847554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:06.848406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:06.848911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:06.850549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:06.856138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 300/599] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:06.918807 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:06.981829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f51bc-8fd9-4a08-aed4-b2f550d80e7a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:07.021512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:07.022133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.022408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.022676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.023342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:07.023640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:07.025657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785797da-85c7-4224-b7f4-66a39c29b8ec None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:07.044717 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 300/600] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:07.046320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:07.129793 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:07.155775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096a55-5f31-4379-93b9-201adc149b52 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.156099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096a55-5f31-4379-93b9-201adc149b52 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.156316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096a55-5f31-4379-93b9-201adc149b52 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.161391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 301/601] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:07.167064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.167345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.167615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.176305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69976d82-9015-47b4-90d0-dc1f30fbf600 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:07.188538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:07.189792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:07.220724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:07.221895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.222500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.222972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.232623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:07.234441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:07.248811 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:07.249846 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:07.250802 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:07.253105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 301/602] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:07.259989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:07.283726 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 302/603] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:07.391783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525798-d261-45c2-ae8b-51f29b6529fa None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:07.403377 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:07.421875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:07.422812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.423287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.423767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.424664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:07.425123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:07.426722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:07.446846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 302/604] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:07.454488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:07.507548 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:07.580516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f16d-7669-4ef2-93c9-7f49832ec667 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:07.630931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27f06-c852-479f-a094-91f527815724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:07.631796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27f06-c852-479f-a094-91f527815724 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.632251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27f06-c852-479f-a094-91f527815724 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.632687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d27f06-c852-479f-a094-91f527815724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.703777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:07.739400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d27f06-c852-479f-a094-91f527815724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:07.740861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d27f06-c852-479f-a094-91f527815724 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:07.797794 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:07.865649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af4bb-16d0-4df0-8747-f9c2f8fb8304 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:07.905922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:07.906569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:07.906846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:07.907116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:07.918975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:07.924989 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:07.926161 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:07.927216 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 303/605] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:07.937849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:07.944016 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 303/606] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:53:07.953302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27f06-c852-479f-a094-91f527815724 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.029774 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.105799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b85425-0e97-4683-a866-027dbb46838c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.124098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d27f06-c852-479f-a094-91f527815724 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.164281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.164910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.165185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.165521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.173062 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.177515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.179521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:08.195776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:08.210210 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:08.211127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:08.211127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:08.211127 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:08.211127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 304/607] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:08.211127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.211421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.211421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.211421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.211421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.211680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:08.211680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.211680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.230732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 304/608] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:08.236578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.351245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babd4b-0d95-47b8-94d5-ffd114a786d5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.417368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.418097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.418436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.418775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.419491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:08.419945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.420427 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.421555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.429984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40652d38-dd86-4606-b544-d6cca95c06c9 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.439207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 305/609] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:08.440581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.506837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.507473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.507751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.508027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.524039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.526010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.528140 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:08.540809 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:08.542317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:08.543226 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:08.543226 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:08.543226 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:08.543226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 305/610] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:08.547886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.613149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dffda-9f4a-47bc-87e4-39bfde2c6b40 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.649391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.650069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.650349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.650672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.658695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.660272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-bb917e9d-557c-446b-874b-e22db20c65cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:08.673619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:08.674619 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:08.675552 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:08.679952 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 306/611] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:08.680480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe148384-8355-4d5d-8c82-517be79e3ffc None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.682064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c80f3-41d1-458b-9644-1cc0fe62f9af None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.682349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c80f3-41d1-458b-9644-1cc0fe62f9af None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.682734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c80f3-41d1-458b-9644-1cc0fe62f9af None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.684527 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 307/612] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:08.690198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.690582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.690947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.710662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:08.712245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:08.721008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.721768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.722044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.722311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.722943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:08.723240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.724697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.738232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 306/613] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:08.739156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.752306 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.789193 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 308/614] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:08.790484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.838417 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:08.848775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fccb1b-ef83-4f0b-ba3d-c9df2ba98a76 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.903428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.904486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a3361-57eb-4093-be3e-a2d3b01fa05b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:08.904799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.905220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.905681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.906523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:08.907009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.908623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ffa9b-4707-4cbb-aae2-47032b2d8e95 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.922770 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 307/615] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:08.924393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aea1-ed4c-4f19-8314-29ff47d4050b None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.924821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aea1-ed4c-4f19-8314-29ff47d4050b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.925222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50aea1-ed4c-4f19-8314-29ff47d4050b None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.926551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 308/616] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:08.929826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50aea1-ed4c-4f19-8314-29ff47d4050b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:08.954290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:08.955067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.955978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.956598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] PATH_INFO: `/v3/users/swift` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:08.967503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:08.969258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-59d9954a-7796-4f64-827e-dc27c0437dac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:08.983979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:08.985023 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:08.986135 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 309/617] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:08.988220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:08.988565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:08.988901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.013901 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.015051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:09.017154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:09.052118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50aea1-ed4c-4f19-8314-29ff47d4050b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.091616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.092222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.092493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.092764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.093505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=9833a132beb6400aa12dd449c3bca42c) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:09.093808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.095261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.101133 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 309/618] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:08 2022] GET /identity/v3/role_assignments?user.id=9833a132beb6400aa12dd449c3bca42c&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:09.102001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.102230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 310/619] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:09.103289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.148760 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.270853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db22d5-21a7-479c-951f-142cbf2a07d8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.324638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783df3a-299c-47ba-8b36-e39627a0b6d4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.342798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.343433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.343712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.343982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.344671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.346170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:09.359863 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:09.361188 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 30 00:53:09.362293 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:09.365481 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 311/620] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:09.367100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.376570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.377481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.377928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.378348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.379243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:09.379705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.381272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.385657 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.404230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 310/621] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:09.406431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.493918 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.502048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91033a75-739c-4357-a7db-a8dfc6bceb9b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.538829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c2f41-179e-4068-9b0b-afeca74512c8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.547264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.548098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.548604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.549073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.549984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:09.550486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.552159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.558098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 312/622] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:09.559257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.578221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.578890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.579171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.579439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] PATH_INFO: `/v3/services/network` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.580217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.581762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:09.591511 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:09.592591 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:09.598649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 311/623] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:09.599448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.657697 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.681273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422d72-519d-4223-b3f7-38e73a66851b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.708057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3449-e17f-4086-9534-d064bec10def None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.719808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.720784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.721321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.721853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.745564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.746167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.746446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.746713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.747337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:09.747636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.749092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.754558 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.754853 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 312/624] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:09.756458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.800684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.802266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.863819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcee435-f15c-4c76-97d6-e1edfe74e597 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:09.890540 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.907339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:09.936006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.936006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.936006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.936006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] RBAC: Adding query filter params (name=network) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:09.936006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:09.936434 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 313/625] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:53:09.936512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522701-808d-4e45-8f5f-d60c4ee79e6a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:09.936581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 313/626] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751437e-d2a1-49df-afb0-85e305bafd6f None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751437e-d2a1-49df-afb0-85e305bafd6f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751437e-d2a1-49df-afb0-85e305bafd6f None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 314/627] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:09.936650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751437e-d2a1-49df-afb0-85e305bafd6f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:09.977891 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:10.021949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba8489-543e-433d-84b7-21278c4df661 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.038807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751437e-d2a1-49df-afb0-85e305bafd6f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.058693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.059329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.059606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.059876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.060557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.061946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a40a31-85f2-4e7b-b270-55590d0aed69 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.075314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.075932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.076214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.076460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.088265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.089788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:10.104533 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:10.105714 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:10.107001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:10.107001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:10.107001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:10.107001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 315/628] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:10.107001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.147127 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:10.176778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 314/629] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:10.178493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.181529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.181529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.203941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:10.205208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:10.238899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3ceef-018e-4456-9f20-c2102ab28d8e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.288986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.290114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.290571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.291079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.293376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 315/630] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:10.293376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.298043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] RBAC: Adding query filter params (type=network) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:10.298362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.300085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.312177 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 316/631] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:10.318114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.352181 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:10.426462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7a04b-fde9-425d-9186-55272fbb976f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.467941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.468619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.468996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.469397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.470147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:10.470542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.471228 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:10.472314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.479439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e69b-d180-41e6-85a3-cae655c28949 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.485991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 316/632] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:10.491000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.523527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.524686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.525143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.525739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.526900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.528890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.626431 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 317/633] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:10.638342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e106f-c471-4d49-a8bd-cacfd58cd0e1 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.641448 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:10.641568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.703450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.704385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.704663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.704986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.713684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.715210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:10.727667 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:10.728796 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:10.729878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 317/634] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:10.734669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.791265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66b994-aa91-4e96-b20e-181aeade6979 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.845109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.846141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.846636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.846945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef1699-b89d-4b83-9737-268416bd4d0d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:10.847332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.848195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.851337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfe91a-c028-4e0d-b064-f5bb822dc3d1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.892162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:10.892784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:10.893097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:10.893487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:10.894191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:10.894587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:10.896399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:10.913220 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 318/635] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:10.920375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:10.944985 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 318/636] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:10 2022] POST /identity/v3/services => generated 269 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:10.945516 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:11.044649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d073-bb7d-464b-bf10-9a3bcb903b39 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:11.093763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:11.094827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:11.095392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:11.095862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:11.096811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=88425fb345824272be839024c9316741) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:11.097323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:11.099112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081ccc-4618-440f-a862-3183fa6e0a27 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:11.107260 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 319/637] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:10 2022] GET /identity/v3/role_assignments?user.id=88425fb345824272be839024c9316741&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:11.466995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecd7d-b302-4ab8-92d5-a6d937667c1d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:11.467379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecd7d-b302-4ab8-92d5-a6d937667c1d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:11.467556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ecd7d-b302-4ab8-92d5-a6d937667c1d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:11.469127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 319/638] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:11.474574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52784-f139-47cc-9379-dff30a103139 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:11.474856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52784-f139-47cc-9379-dff30a103139 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:11.475123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c52784-f139-47cc-9379-dff30a103139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:11.494533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99c52784-f139-47cc-9379-dff30a103139 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:11.495737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99c52784-f139-47cc-9379-dff30a103139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:11.568929 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 320/639] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:11 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:11.834714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ecd7d-b302-4ab8-92d5-a6d937667c1d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:11.851360 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:11.949678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ecd7d-b302-4ab8-92d5-a6d937667c1d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:11.988275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:11.988900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:11.989179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:11.989472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.001116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:12.005883 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:12.006831 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:12.008222 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 320/640] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:53:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:12.013484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c52784-f139-47cc-9379-dff30a103139 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.025108 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:12.116147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c52784-f139-47cc-9379-dff30a103139 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:12.149968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:12.150585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.150862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.151127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.151776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:12.152068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:12.153532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:12.161582 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 321/641] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:12.170397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.248170 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:12.279645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51e65b-fd88-46c3-8746-fe1550b83c05 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:12.314460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:12.315092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.315370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.315642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.326708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:12.328144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:12.343640 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:12.344740 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:12.346191 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:12.346191 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:12.346191 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:12.346191 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 321/642] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:12.350601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.429775 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:12.460596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ebdf2-13af-4359-ac33-62c7fe7de494 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:12.496477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:12.497127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.497363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.497640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.498338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:12.498688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:12.500091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:12.512325 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 322/643] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:12.518424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.629041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9242c3a-c07f-4e83-a870-9c02089e5695 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:12.651977 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:12.662774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:12.665726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.665726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.665726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.672383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:12.673857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:12.686164 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:12.688343 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:12.689819 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 322/644] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:12.697367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.800802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2199f41-e8b6-47b1-9a20-de34f0e26e4a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:12.832028 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:12.837534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:12.838633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.838911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.839180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.839908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:12.840268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:12.841711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d3194-17af-4058-b725-cf030bc5204f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:12.861633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 323/645] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:12.867329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:12.913099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055cf9-d6db-463e-b363-23e1110deb02 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.913099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055cf9-d6db-463e-b363-23e1110deb02 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.913099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055cf9-d6db-463e-b363-23e1110deb02 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.913736 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 324/646] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:12.919765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:12.920292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:12.920771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:12.940098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:12.941705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:12.976191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32117-2ac0-490c-8381-1f0d36fd809c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.016238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.016871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.017146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.017459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.021005 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 325/647] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:12 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:13.041911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.043414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:13.058751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:13.059776 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:13.061770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:13.061770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:13.061770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:13.061770 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 323/648] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:13.065435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.168590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb7d1-52d4-49d2-b656-e0e1367777e0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.188840 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:13.203690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.204227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.204531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.204799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.205470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:13.205766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.207368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.221919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 326/649] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:13.228759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.269640 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:13.334064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.345022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d1df-9265-4dd1-824b-a9f2bce25e68 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.380179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.380801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.381084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.381368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.388864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.390321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-98fa1dc5-1d14-4ada-99c0-6d7ab05f38e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:13.402565 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:13.403487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:13.404379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 324/650] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:13.409485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6be9a-7424-45be-8abd-867d708fc090 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.409768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6be9a-7424-45be-8abd-867d708fc090 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.410048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6be9a-7424-45be-8abd-867d708fc090 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.411484 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 325/651] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:13.412021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6be9a-7424-45be-8abd-867d708fc090 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.450372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a841-76c5-454f-b5a1-7d8c4ba21da9 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.486027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.486878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.487150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.487416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.487986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.489498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b92459d1-15dd-4f02-a3ae-a355270b8d9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:13.498654 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:13.499739 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:13.500585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 327/652] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:13.501446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.501446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.502081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.512843 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:13.519575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6be9a-7424-45be-8abd-867d708fc090 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.519841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:13.521010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:13.553138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.553767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.554049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.554347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.555106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:13.555415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.557376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160c9b-2d13-4503-a9d4-225ab15c191c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.560239 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:13.569651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 326/653] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:13.570856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb596e8-80a3-4a0f-9b64-f2ea5851dc13 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.571145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb596e8-80a3-4a0f-9b64-f2ea5851dc13 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.571420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb596e8-80a3-4a0f-9b64-f2ea5851dc13 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.573221 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 327/654] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:13.573923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb596e8-80a3-4a0f-9b64-f2ea5851dc13 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.613365 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 328/655] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:13.613365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.731817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb596e8-80a3-4a0f-9b64-f2ea5851dc13 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.746720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325980-0923-49c0-ac85-c5f7e6a16108 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:13.776593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.777200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.777521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.777795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.778416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:13.778719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.780102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b4765-c78b-43bf-bb7b-b4f3530f5205 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.784838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 328/656] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:13.785152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:13.785973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.786075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:13.786267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.786538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.786792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:13.787182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/9833a132beb6400aa12dd449c3bca42c/roles/5da97468a2f74013aff800db631e01df` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:13.789835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=9833a132beb6400aa12dd449c3bca42c, role_id=5da97468a2f74013aff800db631e01df)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:13.792043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:13.805566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:13.807276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:13.820752 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:13.872217 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 329/657] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:13.872956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.902201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 329/658] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:13 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/9833a132beb6400aa12dd449c3bca42c/roles/5da97468a2f74013aff800db631e01df => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:13.903408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:13.958919 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.012227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6c55-2d6f-4a29-9618-d49c2fa135fd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.052615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57472f2-7691-45fa-84e4-c147d2e3b18a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.066031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.066991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.067271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.067544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.068429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.068670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.070822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.076950 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 330/659] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:14.091110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.091755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.092029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.092321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.092910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.094360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:14.106530 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:14.107539 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.108471 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 330/660] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 30 00:53:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:14.113473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.132364 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.148539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.269457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254d3e6-3290-42e3-a356-a1d41a9ed3f8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.292610 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.298764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25378ca7-7113-4233-bf58-7531b21f5d94 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.327228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.328140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.328625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.329145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.329977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.330453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.332254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.343757 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 331/661] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:14.348202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.361851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.362866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.363208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.363410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.363991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.370045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:14.390259 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:14.391759 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:14.392621 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:14.396598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 331/662] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:14.404384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.494845 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.561772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16773-ee19-4ef8-87c5-4a7476e240d2 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.562534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501423e-ef86-47cc-8974-3f8dc26af742 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.622900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.623518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.623852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.624117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.624897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.625203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.626864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.641376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 332/663] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:14.643838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.657371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.657988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.658263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.658537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.659195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.659495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.663514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.675922 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 332/664] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:14.681195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.704130 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.787549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f60280-8dc1-448f-8504-7a63482ec2b8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.806589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279860-cfdd-4d68-bbfa-f0576371fbd7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:14.824872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.825470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.825818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.826089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.826767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.827093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.828724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.841474 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 333/665] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:14.848757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:14.849432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:14.849721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:14.850008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:14.850818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] RBAC: Adding query filter params (interface=public, service_id=9fedefe24001458ba9794a5a2d22694e, region_id=RegionOne) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:14.851177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:14.852896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6c132-26ec-4706-b7fc-250953f25eba None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:14.860283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 333/666] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/endpoints?service_id=9fedefe24001458ba9794a5a2d22694e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:14.866227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:14.973641 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:14.985221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4827a-cc9d-4031-855f-e0c59cf581aa None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:15.024103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:15.024710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:15.024987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:15.025257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:15.026426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:15.027866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd34c0-4968-45de-9356-3feed7f83bb9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:15.033913 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 334/667] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:14 2022] GET /identity/v3/services => generated 1029 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:16.278846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765c63-9301-4bd1-a1a7-42ce6d007b96 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.279367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765c63-9301-4bd1-a1a7-42ce6d007b96 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.279367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765c63-9301-4bd1-a1a7-42ce6d007b96 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.280959 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 334/668] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:16.286582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.287005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.287201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.305803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:16.307122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:16.360235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3679-75aa-4442-916a-97964db1f57a None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.360514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3679-75aa-4442-916a-97964db1f57a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.360776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3679-75aa-4442-916a-97964db1f57a None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.362349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 335/669] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:16.367416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.367699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.367969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.379102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 335/670] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:16.381050 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:16.387464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:16.388721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:16.460021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 336/671] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:16 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:16.662854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:16.745975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:16.752588 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:16.769223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d832cc7-e4a2-42d3-bb72-8046dfdbd47c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:16.812037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:16.812931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.813209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.813749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.828779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:16.835882 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:16.836846 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:16.837719 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:16.838402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 336/672] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:53:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:16.843380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:16.859165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7f6a3-c331-4469-8c4d-a081ef02d8b2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:16.906911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:16.907961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:16.908444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:16.908913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:16.909904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:16.911635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:16.918053 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:16.976626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a6f71-1d2f-4c75-b682-dd2c1139e899 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.012189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.012785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.013060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.013326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.014005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:17.014358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.015728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d347cc-f95a-4760-86f2-7adbef85ecc1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.020446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 337/673] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:16 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:17.030427 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 337/674] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 30 00:53:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:17.041080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.075417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0795-a180-456c-b26a-387036812c75 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.075753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0795-a180-456c-b26a-387036812c75 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.076006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0795-a180-456c-b26a-387036812c75 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.077696 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 338/675] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:17.089294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0979e-cede-47e6-8756-b37ed074fd9e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.089747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0979e-cede-47e6-8756-b37ed074fd9e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.090116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0979e-cede-47e6-8756-b37ed074fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.107957 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:17.116428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f9f0979e-cede-47e6-8756-b37ed074fd9e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:17.118508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9f0979e-cede-47e6-8756-b37ed074fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:17.188304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595b412-cba8-4721-b3de-9a29f95b00ed None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.220628 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 339/676] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:17.235756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.236391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.236671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.236942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.248894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.251222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.267380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf557-14b4-41d3-a388-9f9227b27038 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.267659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf557-14b4-41d3-a388-9f9227b27038 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.267928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bf557-14b4-41d3-a388-9f9227b27038 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:17.268520 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:17.269828 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:17.271364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:17.271364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:17.271364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:17.271546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 340/677] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:17.271649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 338/678] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:17.274302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.274576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.274837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.276147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.296978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:17.298197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:17.332294 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:17.381409 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 341/679] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:17.390906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79fbbf-90c8-4386-84f6-97c1b554dc7e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.425425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.426135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.426487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.426828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.427536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:17.427915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.429366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.442569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 339/680] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:17.448463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.513235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.516106 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:17.563098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbe78e-3b37-477b-9caf-6937fa5837cc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.607925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.608555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.609286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.609745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.620267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.622397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.635941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d84cc-6e62-4b0c-8efd-afaa7d58fc87 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:17.640709 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:17.641658 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:17.642610 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 342/681] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:17.645286 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:17.649268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.683420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.684030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.684375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.684648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.685212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.686629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.750848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c020f9-6721-41d6-8eeb-e193f5a5f890 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.766683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 340/682] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:17 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:17.767702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.788805 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:17.805558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.806239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.806612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.806806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.807534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:17.807839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.809586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.836874 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 343/683] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:17.838984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:17.920040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d40f-7adf-4a97-8795-a3ff15ad4b6c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.971505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:17.972131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:17.972405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:17.972938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:17.973248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:17.974627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:17.979768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dd611-0de7-44d0-9553-9c2f13ba1fdf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:17.984185 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:17.985296 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:17.986267 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 341/684] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:17.991422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.030322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.030523 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.030621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.030621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.030790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.085671 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.105483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.107239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.117744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9998-75f2-4013-a981-76117e9808ca None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.154098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.154996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.155427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.155846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.156634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:18.157096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.158632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.163780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 342/685] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:18.170850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.226358 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 344/686] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:53:18.229124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.287633 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.299655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc4d64-0966-49fc-bf22-6e7161e5ab85 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.334449 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.348876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.349776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.350153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.350932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.351730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:18.352284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.355027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.360432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102f603-faf0-487a-9a0e-598cff7a6a16 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.365479 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 343/687] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:18.367296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.407709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.409068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.409809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.410292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.424088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.426291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:18.446762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:18.448318 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:18.449261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:18.449261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:18.449261 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:18.451438 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 345/688] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:18.456806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.497207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee94-c86c-4014-9c53-64692056edc8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.533326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.534196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.534645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.535063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.535866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.537467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.568366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939e92-8e65-44c2-9bd3-e43530107c30 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.601113 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.606483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.607083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.607360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.607621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.608255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:18.608553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.610025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.622032 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 346/689] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:18.627223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.647532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 344/690] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:18.746886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e8409-c660-488c-b924-68c65091fda9 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.793980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.795054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.795531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.795993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.803901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.805749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:18.823801 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:18.824767 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:18.825744 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 347/691] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:18.831623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:18.850004 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:18.946974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ff09-e9f2-4334-b6f5-d1a97092f6dc None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:18.984152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:18.984763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:18.985042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:18.985444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:18.986088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:18.986444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:18.987881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e6d1-732a-4ce8-ab31-f3af17b306e6 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:19.000725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 345/692] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:19.006699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:19.059493 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:19.115556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453df569-87c9-4ceb-9c2a-c28d055f9f70 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:19.151696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:19.152489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:19.152773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:19.153048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:19.153855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] RBAC: Adding query filter params (role.id=5da97468a2f74013aff800db631e01df, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=9833a132beb6400aa12dd449c3bca42c) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:19.154165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:19.155589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869fdb-f462-4da2-be47-43593a136811 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:19.162230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 348/693] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:19 2022] GET /identity/v3/role_assignments?user.id=9833a132beb6400aa12dd449c3bca42c&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=5da97468a2f74013aff800db631e01df => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:19.365753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec55-722c-4048-9505-4678d02f648a None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:19.366255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec55-722c-4048-9505-4678d02f648a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:19.366255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4ec55-722c-4048-9505-4678d02f648a None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:19.367907 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 346/694] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:19.373222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:19.373671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:19.373841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:19.393593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:19.394883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:19.469326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 349/695] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:19.745637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4ec55-722c-4048-9505-4678d02f648a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:19.819701 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:19.850578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4ec55-722c-4048-9505-4678d02f648a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:19.901069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:19.902055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:19.902541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:19.903015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:19.903822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:19.905423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-6e6cec08-de19-4d3f-afd9-cdfcb40beb25 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:19.915160 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:19.916894 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:19.917763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:19.920542 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 347/696] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:19.927082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:19.977252 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.035204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5074-db97-4e58-9124-7429809364a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.052243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69414-f80a-4af8-9b2c-21240c5a2673 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.052555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69414-f80a-4af8-9b2c-21240c5a2673 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.052794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69414-f80a-4af8-9b2c-21240c5a2673 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.054465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 348/697] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:20.060745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.061026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.061610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.074545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.075511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.075999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.076475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.077486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:20.078036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.079420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.084785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:20.085202 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 350/698] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:20.086521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:20.090879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.173429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 349/699] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:20.209109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c4a6-f4c2-4273-ae88-c853b91937de None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.217460 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.245119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.245758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.246036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.246311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.246938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:20.247237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.248694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.253974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 351/700] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:20.260526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.326384 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.370695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a399cd-36b0-4747-8a85-61a691ca71ab None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.413067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.413712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.414232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.414512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.415325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] RBAC: Adding query filter params (interface=public, service_id=be83334b871d489380cc03ff7494488b, region_id=RegionOne) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:20.416077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.417787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.423991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 350/701] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/endpoints?service_id=be83334b871d489380cc03ff7494488b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:20.430105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.467333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.553231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f13f7-6f02-4e75-9527-c9054fd55683 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.601831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.602356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.602632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.603438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.604046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.604690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12220-2eae-4de4-b466-355aca90332e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.605518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.617536 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 352/702] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:20.640478 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.647364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.648430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.648932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.649470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.650852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.652562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:20.663483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:20.664564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:20.665501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:20.668016 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 351/703] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:20.674372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.715801 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.788875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373b15-bb13-4f00-ade3-023ffe50c52a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:20.827240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:20.828104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:20.828379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:20.828648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:20.829268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:20.829593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:20.831199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:20.836183 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 353/704] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:20.842325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:20.967686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e48b20-4c74-4442-af47-6d9d08bb161e None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.003656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.004263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.004538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.004808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.005464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:21.005821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.007239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf584e-5f0a-408c-9c75-9a0ded694b99 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.012724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 352/705] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:21.018666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.044727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6ba42-bd60-4b06-bbfc-f67b5f9d6cf9 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.045042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6ba42-bd60-4b06-bbfc-f67b5f9d6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.045280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6ba42-bd60-4b06-bbfc-f67b5f9d6cf9 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.046809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 353/706] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:21.052191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.052706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.053156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.073622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:21.075116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:21.136487 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:21.140223 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:21.145360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f14bc6-8841-4deb-a587-cb194e596033 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.152773 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 354/707] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:21.182522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.183469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.183897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.184312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.185205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] RBAC: Adding query filter params (interface=public, service_id=62ff2c214a3b4697bb6751e7f7511021, region_id=RegionOne) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:21.185679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.187257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.193119 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 354/708] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/endpoints?service_id=62ff2c214a3b4697bb6751e7f7511021&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:21.199615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.304699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4caa1-5375-42cf-aaef-6a7fb89f3b63 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.341321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.342233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.342658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.343077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.343822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.345347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d570c-617f-4804-bcee-54746896e123 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.352100 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 355/709] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:21.437511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.517176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6e4e-2e6c-4be4-9faa-39e1f849724e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.517734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6e4e-2e6c-4be4-9faa-39e1f849724e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.517824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6e4e-2e6c-4be4-9faa-39e1f849724e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.519436 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 356/710] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:21.525723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.526007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.526279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.547655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:21.548855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:21.553461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8d01-4a5d-43bb-8c35-c526452464ce None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.602866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.603809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.604265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.604736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] PATH_INFO: `/v3/services/compute` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.605076 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:21.605793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.607404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:21.618116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:21.634568 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:21.635438 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 355/711] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:21.636252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.636321 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 357/712] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:21.659140 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:21.744468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5307e-438f-41fd-b024-2f480c05302d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.779595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.780203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.780476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.780742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.781379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:21.781679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.783090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.788152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 356/713] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:21.793918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.908774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126b52-907f-4941-9f9f-c4ad7c2b4daf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:21.944178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:21.950792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:21.951409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:21.951688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:21.951959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:21.952594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] RBAC: Adding query filter params (type=compute) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:21.952894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:21.954823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:21.963300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:22.053143 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:22.064178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289e98-db4c-4c0d-8faa-aebb7b3ce494 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:22.103475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:22.104181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:22.104460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:22.104732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] PATH_INFO: `/v3/services/image` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:22.105416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:22.106868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:22.116652 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:22.117762 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:22.118630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 357/715] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 30 00:53:21 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:22.130483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:22.187109 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:22.241244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb8028-01be-4958-9277-7362b9c4838a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:22.276904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:22.277572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:22.277853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:22.278185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:22.278819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] RBAC: Adding query filter params (name=image) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:22.279164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:22.280528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc892c36-ba9d-40ba-871a-7941cdfadc42 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:22.289114 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 359/716] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:22.291761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:22.397709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577db20-f8ab-486d-9419-8963258cdcdc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:22.432956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:22.433618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:22.433900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:22.434170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:22.434852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:22.435159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:22.436530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f619a8-f995-47a8-b1d5-8564ca9a62b9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:22.445511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 358/717] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:23.048136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc737-d969-4f12-b51f-6272c5f94b70 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.049187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc737-d969-4f12-b51f-6272c5f94b70 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.049715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afc737-d969-4f12-b51f-6272c5f94b70 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.051574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 360/718] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:23.057614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.058139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.058618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.077729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:23.079209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:23.094261 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:23.150695 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 359/719] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:23.423025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afc737-d969-4f12-b51f-6272c5f94b70 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:23.530454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afc737-d969-4f12-b51f-6272c5f94b70 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:23.544479 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:23.573684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:23.574313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.574593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.574872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.575463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:23.576833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-68f59b90-43b3-4151-b08c-8e3efd866348 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:23.586750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:23.587795 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:23.588623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 361/720] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:23.595911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:23.662184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93060-9e90-4f0c-9574-f37ba5c5db0d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.662510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93060-9e90-4f0c-9574-f37ba5c5db0d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.662739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93060-9e90-4f0c-9574-f37ba5c5db0d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.664233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 362/721] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:23.669914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462509-6047-4772-866d-274fedf24656 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.670253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462509-6047-4772-866d-274fedf24656 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.670534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb462509-6047-4772-866d-274fedf24656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.689516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eb462509-6047-4772-866d-274fedf24656 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:23.690621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eb462509-6047-4772-866d-274fedf24656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:23.707394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db00f7-cfa8-4e8c-b12b-7beab2e73619 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:23.750479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:23.751153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.751437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.751700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.752338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:23.752638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:23.755017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:23.762592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 360/722] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:23.767674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:23.768349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 363/723] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:23.785267 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:23.875463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c5b7e-4ee4-432b-88c0-90a7a281be8b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:23.913510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:23.914259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:23.914578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:23.914853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:23.915542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:23.915844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:23.917259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:23.922644 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 361/724] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 30 00:53:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:23.927983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb462509-6047-4772-866d-274fedf24656 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.039212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb462509-6047-4772-866d-274fedf24656 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.041516 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.053136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.076170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.076969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.077444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.078023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.078793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.080412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.138584 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.161576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927433ba-aa44-4d53-9f2d-6cf4a0881fc2 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.174676 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 364/725] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:24.219577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.220231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.220506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.220769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.225382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.225382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b99de838-95c1-4e3f-a3da-b904fa031641 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:24.236080 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:24.237411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:24.238627 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:24.241521 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 362/726] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:24.253567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.323030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7232-37a2-4c24-9795-1bf178e43c83 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.323212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7232-37a2-4c24-9795-1bf178e43c83 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.323485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad7232-37a2-4c24-9795-1bf178e43c83 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.325090 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 363/727] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:24.331158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.331455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.331695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.351673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:24.353600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:24.387565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b469-5847-4603-878b-eb8c1582dc30 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.435478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.436409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.436833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.437258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.438055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:24.439149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.439700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.446712 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 365/728] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:24.451905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.456573 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 364/729] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:24.480266 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.559744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b75e3-ac54-463f-9e6d-6e5153f45343 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.598252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.599241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.599755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.600229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.601052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:24.601583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.603239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.608858 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 366/730] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:24.614379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.691720 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.729610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e3a6-9c7b-4117-9e72-c440a8e6eb5b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.765532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.766142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.766421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.766686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.767363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.768795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d322d0-ee97-4dd2-9bc4-702c392b788d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.769363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:24.857269 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 365/731] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:24.857269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08889-34bc-4481-8bca-c9d0b1382283 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.857269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08889-34bc-4481-8bca-c9d0b1382283 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.857269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08889-34bc-4481-8bca-c9d0b1382283 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.857269 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 366/732] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:24.858604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.858889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.859162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.869138 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.879385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:24.880603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:24.898880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141473-f471-4f56-9641-291f27d28270 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:24.959570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:24.960783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:24.961197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:24.961507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:24.962194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:24.963602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ba15a-2174-4f95-aea1-205a13f2f853 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:24.968219 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 367/733] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:25.056536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 367/734] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:24 2022] POST /identity/v3/services => generated 242 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:25.246344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:25.302010 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:25.351408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb568-74a0-4487-a32e-0d4502f70184 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:25.395229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:25.395849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:25.396124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:25.396392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:25.397056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:25.398495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abea632-05d7-453a-9368-9cc463ad3289 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:25.513972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 368/735] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:25 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:26.459876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed5492-0b93-4be7-a478-7128f7ebbbf7 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:26.460420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed5492-0b93-4be7-a478-7128f7ebbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:26.460420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed5492-0b93-4be7-a478-7128f7ebbbf7 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:26.462803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 368/736] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:26.468731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:26.469244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:26.469244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:26.487927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:26.489091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:26.561736 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 369/737] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:26 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:26.830497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed5492-0b93-4be7-a478-7128f7ebbbf7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:26.937320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed5492-0b93-4be7-a478-7128f7ebbbf7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:26.973411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:26.974299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:26.974740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:26.975169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:26.975972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:26.977612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:26.980384 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.common [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 00:53:26.996190 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:27.031105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.sql.core [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:27.031105 n-d-master-1 devstack@keystone.service[82036]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:53:27.031105 n-d-master-1 devstack@keystone.service[82036]: [parameters: {'id': '256610dd50584271938d478545556836', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:53:27.031105 n-d-master-1 devstack@keystone.service[82036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-3bd62b24-f131-4ad9-8852-78dd4655052f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 256610dd50584271938d478545556836.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 256610dd50584271938d478545556836. Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:27.048668 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:53:27.049791 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application yield resource Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise self.value Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application session.commit() Oct 30 00:53:27.051044 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:53:27.052322 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:53:27.053518 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:27.054918 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [parameters: {'id': '256610dd50584271938d478545556836', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.056062 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:27.057052 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 256610dd50584271938d478545556836. Oct 30 00:53:27.058364 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.060825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 369/738] 10.222.0.13 () {60 vars in 1140 bytes} [Sun Oct 30 00:53:26 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:27.069357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.106446 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:27.177664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90ae87-8133-416d-acd1-725cb87c4fb3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:27.184317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415779-506d-4be7-b836-2050c4d2f7be None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.184888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415779-506d-4be7-b836-2050c4d2f7be None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.185400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415779-506d-4be7-b836-2050c4d2f7be None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.197239 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 370/739] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:27.199604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c56f3-206b-4318-83bb-e54ee8c45a38 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.200137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c56f3-206b-4318-83bb-e54ee8c45a38 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.200621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c56f3-206b-4318-83bb-e54ee8c45a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.216591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:27.217252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.217560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.217835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.227177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:27.227687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d70c56f3-206b-4318-83bb-e54ee8c45a38 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:27.228657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:27.229846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d70c56f3-206b-4318-83bb-e54ee8c45a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:27.242481 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:27.243515 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:27.245052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 370/740] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:27.249402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.325366 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 371/741] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:27.340231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a3a8-8da9-4d7d-a890-d06d68d9cb40 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.341389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a3a8-8da9-4d7d-a890-d06d68d9cb40 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.341683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a3a8-8da9-4d7d-a890-d06d68d9cb40 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.343283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 372/742] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:27.350387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.350722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.351733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.370803 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:27.377321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346fef-ba64-44cd-a9de-9f95a9428bab None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:27.377831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:27.379204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:27.415002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:27.415667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.415948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.416215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.416925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:27.417222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:27.418665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:27.439060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 371/743] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:27.472153 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 373/744] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:27.603487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.719952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af130389-4bfb-49dc-b169-7e11c1bd3814 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:27.749254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.760138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:27.761106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.761594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.762046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.762833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:27.764366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:27.773473 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:27.774487 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:27.775325 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:27.781435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 372/745] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:27.784388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.819738 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:27.825773 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:27.865740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d251cc2-8abb-419b-abac-aa387f26a8f0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:27.906427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe50cd-e0de-4418-9672-6a81aad79a7f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:27.912892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:27.913568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.913968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.914237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.914820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:27.916343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-04bd6941-da66-4753-b658-5a952eb1e3ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:27.925814 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:27.926910 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:27.927764 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:27.932400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 374/746] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:27.933734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27db81-07de-496f-bb0e-7d6ba2d735c0 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.934029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27db81-07de-496f-bb0e-7d6ba2d735c0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.934306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27db81-07de-496f-bb0e-7d6ba2d735c0 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.935765 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 375/747] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:27.936281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27db81-07de-496f-bb0e-7d6ba2d735c0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:27.948938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:27.949910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.950462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.950638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.951274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:27.951577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:27.952937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450cff4-9d3e-4595-9636-2201de314ad6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:27.958287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 373/748] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:27.963036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:27.963614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:27.964231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:27.982322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:27.983436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:28.048111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27db81-07de-496f-bb0e-7d6ba2d735c0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.057184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 374/749] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:28.058171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.072240 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.086809 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.106335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142393-0263-4887-a248-89de02082767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.107708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142393-0263-4887-a248-89de02082767 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.108219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142393-0263-4887-a248-89de02082767 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.109027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142393-0263-4887-a248-89de02082767 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.110208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142393-0263-4887-a248-89de02082767 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.110720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142393-0263-4887-a248-89de02082767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.113014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142393-0263-4887-a248-89de02082767 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.124295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 376/750] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:28.128962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142393-0263-4887-a248-89de02082767 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.188037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ca3d-35de-4c58-90c6-d8e1570f692b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.234372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142393-0263-4887-a248-89de02082767 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.236266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.237151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.237524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.238675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.239465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.239833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.241369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.249378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 375/751] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:28.253773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.289396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.291005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.291473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.291928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.292731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.293521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.296004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.307921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 377/752] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:28.308482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.345584 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.372314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74b93d-dd64-41b9-ad76-013b027e7c32 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.374403 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.410747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.411351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.411632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.411904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.412612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] RBAC: Adding query filter params (interface=admin, service_id=62ff2c214a3b4697bb6751e7f7511021, region_id=RegionOne) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.412917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.414857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.425414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 376/753] 10.222.0.13 () {56 vars in 1249 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/endpoints?service_id=62ff2c214a3b4697bb6751e7f7511021&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:28.425414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.434955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6a358-12d1-4091-8ffa-9ee1fe602d7d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.474781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.475450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.475708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.476560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.477346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] RBAC: Adding query filter params (interface=public, service_id=93282faf8c8244b0b40e3b91abec6afc, region_id=RegionOne) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.477669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.479016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.484790 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 378/754] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/endpoints?service_id=93282faf8c8244b0b40e3b91abec6afc&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:28.490225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.528827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac914d7-b95b-40a4-a7f6-77dc07a70cbf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.565107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.565107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.565107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.565107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] PATH_INFO: `/v3/services/image` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.567854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.568280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:28.577369 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:28.578680 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:28.579964 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:28.583949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 377/755] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:28.584458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.588634 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.616916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8ffd5-88c5-491b-b463-91a33b230ff0 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.635921 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:28.654216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.654821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.655103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.655376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.655974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.657370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.664920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 379/756] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services => generated 1957 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:28.667742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.705830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf008d-790d-4c9f-a7fe-eecbd9695d16 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.748299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.748877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.749154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.749500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.750163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.751882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.765863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 378/757] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:28.817088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd6773-91ce-483f-b8a3-e292f3851b0b None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:28.860272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:28.861202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:28.861666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:28.862120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:28.862927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:28.863389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:28.864939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:28.871705 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 380/758] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:28.878341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:28.970173 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:29.008378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0258-6eb8-4b5b-b093-ffd98fd60cff None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:29.047017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:29.047622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:29.047898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:29.048170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:29.048863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:29.049165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:29.050570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:29.056131 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 379/759] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:29.061834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:29.113363 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:29.168965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b453e-9eaf-4ac5-ad77-f771b08f04a5 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:29.204055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:29.204663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:29.204942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:29.205210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:29.206005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] RBAC: Adding query filter params (interface=public, service_id=6449e9d1400047c59ee19ef19490c8c1, region_id=RegionOne) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:29.206309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:29.207665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5069e64-2e3c-4bf0-a2e3-38df99d961e4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:29.214062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 381/760] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:53:29 2022] GET /identity/v3/endpoints?service_id=6449e9d1400047c59ee19ef19490c8c1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:29.219647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:29.355637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a9c9d-80f2-4f1c-a628-990097d90bc7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:29.386351 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:29.395492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:29.396368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:29.396815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:29.397262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:29.398586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:29.400305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0380dc7-9fc1-40f3-aa3f-1d17b9bbbd8c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:29.407516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 380/761] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:53:29 2022] GET /identity/v3/services => generated 1957 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:53:29.777122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b718-339e-468b-9774-38bdb38669dc None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:29.777698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b718-339e-468b-9774-38bdb38669dc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:29.777698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588b718-339e-468b-9774-38bdb38669dc None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:29.779381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 382/762] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:29.785594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:29.786062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:29.786171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:29.804640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:29.805865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:29.883098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 381/763] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:30.160945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b718-339e-468b-9774-38bdb38669dc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:30.268579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588b718-339e-468b-9774-38bdb38669dc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:30.278265 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:30.303512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:30.304107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:30.304385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:30.304767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:30.305441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:30.306853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:30.356255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.sql.core [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:53:30.356255 n-d-master-1 devstack@keystone.service[82036]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:53:30.356255 n-d-master-1 devstack@keystone.service[82036]: [parameters: {'user_id': 'e091109b8e5e4374913b99606cc97fdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:53:30.356255 n-d-master-1 devstack@keystone.service[82036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:30.364348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:30.365354 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application yield resource Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise self.value Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application session.commit() Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:53:30.366387 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:53:30.367262 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:30.368176 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:30.370002 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e091109b8e5e4374913b99606cc97fdc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:30.372036 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 30 00:53:30.373949 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:30.376117 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 383/764] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 30 00:53:30 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:30.388971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:30.496337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84e36b-65ff-46f8-b5b1-ca39a067ed84 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:30.531926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:30.532937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:30.533479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:30.533969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:30.542086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:30.544025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:30.552519 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a9b8b399-c799-406e-9bf3-c957a4a0112f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:30.558731 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:30.559736 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 30 00:53:30.560770 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:30.562902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 382/765] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:53:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:30.569063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:30.676478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb633ad-d0ca-4bf6-a040-23722008ac63 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:30.713660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:30.714260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:30.714541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:30.714863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:30.715560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:30.715860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:30.717511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85fe1-6ae9-4e62-a6cb-26fbfaa1b570 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:30.758433 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 384/766] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 30 00:53:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:31.018065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a79-2de1-4268-ad94-53f558a89882 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.018603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a79-2de1-4268-ad94-53f558a89882 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.018603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658a79-2de1-4268-ad94-53f558a89882 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.020517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 383/767] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:31.026720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f888-24ef-412b-94f1-bd253f82d013 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.027274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f888-24ef-412b-94f1-bd253f82d013 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.027274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f888-24ef-412b-94f1-bd253f82d013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.047002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7a26f888-24ef-412b-94f1-bd253f82d013 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:31.048794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a26f888-24ef-412b-94f1-bd253f82d013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:31.078939 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:31.126258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 385/768] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:31.133271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87086649-5fb9-4c6b-b857-de155fd3f03d None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.133698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87086649-5fb9-4c6b-b857-de155fd3f03d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.134071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87086649-5fb9-4c6b-b857-de155fd3f03d None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.135615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 384/769] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:31.140809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.141212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.141618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.161572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:31.163286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:31.230160 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 386/770] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:31.392386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87086649-5fb9-4c6b-b857-de155fd3f03d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.498277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87086649-5fb9-4c6b-b857-de155fd3f03d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.502830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.533510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.534072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.534349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.534615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.535190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.536618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:31.545870 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:31.547108 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 30 00:53:31.548013 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:31.552039 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 385/771] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:31.552905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.607048 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:31.612227 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:31.620688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126c2ab-9098-4135-996c-ac97f0defe64 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.656653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.657289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.657598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.657876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.658463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.659838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.661877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e96b-275e-4ef6-947f-fbc2b58d0383 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:31.669371 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:31.670404 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:31.671263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 387/772] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:31.676473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.700806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.701440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.701781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.702059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.702733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:31.703019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.704637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a1eb-2c4b-4ee4-87ef-766e6afc0ab1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.710013 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 386/773] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:31.711144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916eaed-f6c9-4307-a0f4-95315d34dbec None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.711434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916eaed-f6c9-4307-a0f4-95315d34dbec None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.711768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916eaed-f6c9-4307-a0f4-95315d34dbec None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.713166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 387/774] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:31.715595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916eaed-f6c9-4307-a0f4-95315d34dbec None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.781017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc79d20-7b47-43e6-a10b-e617808b54b3 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.815191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.815413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916eaed-f6c9-4307-a0f4-95315d34dbec None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:31.815792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.816070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.816338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.816954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:31.817254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.818629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8ab8e-80a0-42d5-87d4-af17d80a4ff0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.823660 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 388/775] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:31.824603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.824885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.825159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.829878 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:31.843354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:31.844669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:31.849648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:31.850838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:31.851108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:31.851373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:31.852032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:31.852326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:31.853699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:31.856517 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:31.858551 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 388/776] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:31.859328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.918822 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 389/777] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:31.919502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:31.968660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58022ec6-ec4e-4e01-8676-4abcf8e1d39b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.008849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.010368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.010886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.011348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.012645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:32.013155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.015399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.022760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 389/778] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 30 00:53:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:32.028245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:32.037073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4e412-92e3-452d-9f51-3846b9698190 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.073882 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:32.078884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.079689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.080301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.081044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.081912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.089295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.128698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e4ef-e2b8-492c-9865-30ff6b48a7e7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.162204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.162836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.163115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.163383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.164042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.165440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.168658 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 390/779] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:32.191932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:32.201917 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:32.267445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 390/780] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:32.312813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01446ade-d958-444f-ace1-b76a83c11184 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.362103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.362748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.363025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.363298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] PATH_INFO: `/v3/services/image` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.363894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.365301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:32.376841 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:32.378048 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:32.379007 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 391/781] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 30 00:53:32 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:32.384737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:32.496259 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:32.501723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f195fd2-71de-40c8-aa1c-1680b8c24b43 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.535486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.536091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.536374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.536640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.537265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] RBAC: Adding query filter params (name=image) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:32.537627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.539010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.544346 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 391/782] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:32.549630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:32.618806 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:32.657502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9f19-cfd4-4170-9408-02c25e9db311 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.692697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.693293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.694126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.694394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.695012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] RBAC: Adding query filter params (type=image) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:32.695310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.696669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2b31d-4e1f-4da2-9321-6bf1f3156529 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.702299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 392/783] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:32.708955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:32.812844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc849-a635-4703-9171-72a0f14c5860 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:32.849394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:32.849394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:32.849394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:32.849394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:32.849834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:32.851222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93922c7-78a4-4e98-9bfb-047839863fc9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:32.951111 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 392/784] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:53:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:34.389116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764597a2-4893-4146-983d-0d0f7bb29ea2 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.397084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764597a2-4893-4146-983d-0d0f7bb29ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.397084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764597a2-4893-4146-983d-0d0f7bb29ea2 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.397084 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 393/785] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:34.397314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6989d6-aabe-44cb-b919-827caf72feac None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.397314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6989d6-aabe-44cb-b919-827caf72feac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.397314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6989d6-aabe-44cb-b919-827caf72feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.416880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8c6989d6-aabe-44cb-b919-827caf72feac None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:34.418213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8c6989d6-aabe-44cb-b919-827caf72feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:34.433683 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:34.496632 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 393/786] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:34.536302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375d89-82a5-45d2-94e7-def88f3b3886 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.536632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375d89-82a5-45d2-94e7-def88f3b3886 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.536878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375d89-82a5-45d2-94e7-def88f3b3886 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.538413 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 394/787] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:34.543305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.543594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.562453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:34.563641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:34.632605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 394/788] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:34.775711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375d89-82a5-45d2-94e7-def88f3b3886 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:34.884349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375d89-82a5-45d2-94e7-def88f3b3886 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:34.902634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:34.916999 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:34.928145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:34.929013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:34.929120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:34.929373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:34.930488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:34.931933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:34.933685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 395/789] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:34.939481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:34.984879 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.010625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23532d2c-7824-4a7e-8004-19ae466c1283 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.046339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a22c0-e6d4-4492-b4ee-a1e2c695381c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.047349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.048003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.048281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.048548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.061301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:35.066297 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:35.067319 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.068447 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 395/790] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:53:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:35.073699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.089264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.089960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.090239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.090511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.091214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.092645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954265a7-92a5-4ce2-9ce6-c45b9c4f5072 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.174076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ccf1-a9be-48b7-a1b0-8a6c95922556 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.198519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 396/791] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:34 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:53:35.198519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403270b-eec8-470f-b0b6-df026305baea None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.198519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403270b-eec8-470f-b0b6-df026305baea None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.198519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403270b-eec8-470f-b0b6-df026305baea None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.198519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 397/792] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:35.202262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.202262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.202262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.221256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.221921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.222347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.222454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:35.222534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.223244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:35.223549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.223646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:35.225157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.226860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.235152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 396/793] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:35.241694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.277702 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.304527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 398/794] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:35.365375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8ca8e-c0af-4d88-88a9-167ebc77f354 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.406425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.407058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.407317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.407585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.418405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.419846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:35.434599 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:35.435776 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:35.437046 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:35.437046 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:35.437046 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.437046 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 397/795] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:35.441798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.549468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c2916-bd4b-43c4-9b1c-469685913be7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.581729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.589939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.590583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.590859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.591136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.591779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:35.592074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.593511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.609422 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 399/796] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:35.615616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.636532 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.652563 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.703277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf76fb0-d76d-4a3b-b455-de5bd7a294ae None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.721313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027406e4-2d91-41af-9552-56cbe1b64823 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.742315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.742920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.744893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.744893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.744893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.745467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.759534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.760153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.760427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.760696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.768444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.770022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:35.781484 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:35.782472 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:35.783408 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 400/797] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:35.788805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.823371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.sql.core [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:35.823371 n-d-master-1 devstack@keystone.service[82035]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:53:35.823371 n-d-master-1 devstack@keystone.service[82035]: [parameters: {'id': '458c68019d6b49b1a65954718d35e895', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:53:35.823371 n-d-master-1 devstack@keystone.service[82035]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82035) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:35.831094 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 00:53:35.831952 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application yield resource Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise self.value Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application session.commit() Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 00:53:35.832961 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.flush() Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application compat.raise_( Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 00:53:35.833979 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 00:53:35.834885 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application conn.query(q) Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result.read() Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 00:53:35.835688 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [parameters: {'id': '458c68019d6b49b1a65954718d35e895', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 00:53:35.836576 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:35.839431 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 398/798] 10.222.0.13 () {60 vars in 1137 bytes} [Sun Oct 30 00:53:35 2022] POST /identity/v3/domains => generated 190 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:35.841309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.912514 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.918306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb257619-2726-46a4-9b52-00e48cf607ff None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.953545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bcc73-5606-40bf-8435-9f7d497f6a6d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:35.955287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.956783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.957071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.957357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:35.958099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:35.958940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:35.960429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:35.968698 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:35.981018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 401/799] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:35.986825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:35.991768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:35.992393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:35.992668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:35.992933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.003812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.005328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:36.020391 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:36.021985 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:36.022876 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:36.022876 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:36.022876 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:36.022876 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 399/800] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:36.028269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:36.100132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7241cd7-4a31-4638-8c56-615a1e997251 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.138757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe82c-8964-4b30-914b-a0e683119188 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.141007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.142660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.142947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.143226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.155803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.158281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:36.174470 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:36.175507 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:36.176432 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:36.176432 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:36.176432 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:36.176432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 402/801] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:36.180103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.180721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.181000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.181266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.181949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:36.182245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.182586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:36.183622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.192522 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:36.197627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 400/802] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:36.306184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd554808-162f-4165-ac20-bbb7803a2030 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.342565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.343186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.343465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.343737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.344390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:36.344693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.346100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.364731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 403/803] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:36.365860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:36.394806 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:36.473662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4502ac-3bba-4a21-809d-4c2431641fbc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.510757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.511392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.511674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.511941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.518829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.520310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:36.532305 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:36.533368 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:36.534283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 401/804] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:36.540983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:36.607834 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:36.641482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a797e4-2b28-4e19-b973-108b13baf4d9 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.676614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.677218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.677527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.677801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.678480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:36.678782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.680328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01eb2b6-ead1-457c-8e99-df3a03da0b04 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.691600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 404/805] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:36.698070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:36.783642 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:36.799190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bab1b-356e-499c-a325-9a1993143455 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:36.833737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:36.834375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:36.834648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:36.834918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/5da97468a2f74013aff800db631e01df` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:36.837021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=1449e0ef893c420e93cf26910f4a6a1f, role_id=5da97468a2f74013aff800db631e01df)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:36.838470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a71523-b0c7-40cc-890d-b4ec91f4b88e None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:36.932845 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 402/806] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:36 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/1449e0ef893c420e93cf26910f4a6a1f/roles/5da97468a2f74013aff800db631e01df => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:37.434133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86f7a-a3de-444b-b522-4a0c28e04b92 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.434417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86f7a-a3de-444b-b522-4a0c28e04b92 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.434693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86f7a-a3de-444b-b522-4a0c28e04b92 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.436046 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 405/807] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:37.441533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.441813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.442081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.461265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:37.462463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:37.535312 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 403/808] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:37.803077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86f7a-a3de-444b-b522-4a0c28e04b92 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:37.904866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86f7a-a3de-444b-b522-4a0c28e04b92 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:37.930560 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:37.939146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:37.939770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:37.944377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:37.944377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:37.944377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:37.944377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e8239-d8b1-4bc4-8445-bde2c8d62209 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:37.944818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 406/809] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:37.950342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:38.022326 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:38.046600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ad5-4719-4135-a147-230f3c3ba036 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:38.081193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:38.081750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:38.082022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:38.082283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:38.082917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:38.084326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5492a-75f1-4c57-af40-7c02348cb10b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:38.185363 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 404/810] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:53:37 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:39.069206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dbc5-292e-4fbc-9621-2a2214a166af None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:39.069781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dbc5-292e-4fbc-9621-2a2214a166af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:39.069781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dbc5-292e-4fbc-9621-2a2214a166af None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:39.071132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 407/811] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:39.077361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:39.077949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:39.077949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:39.096139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:39.097325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:39.161655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 405/812] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:39.429734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0dbc5-292e-4fbc-9621-2a2214a166af None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:39.531283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0dbc5-292e-4fbc-9621-2a2214a166af None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:39.563650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:39.564274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:39.564553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:39.564823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:39.576779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:39.581575 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:39.582647 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:39.584001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 408/813] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 30 00:53:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:39.589288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:39.647080 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:39.687099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66ecb5-fd96-46ae-bee5-44b347ce76a0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:39.721767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:39.722367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:39.722645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:39.722938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:39.723634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:39.723932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:39.725302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:39.733362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 406/814] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 30 00:53:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:39.739699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:39.794434 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:39.839184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179e05-059f-4d50-afe6-94c6d254fa9a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:39.872841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:39.873473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:39.873754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:39.874027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:39.885944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:39.887500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:39.902287 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:39.903402 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:39.904444 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:39.904444 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:39.904444 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:39.904444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 409/815] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:39.909408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.010338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3f3e3-ce07-4c81-9d50-0b2667b3366f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.032632 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.044364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.045040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.045322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.045622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.046258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:40.046560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:40.047906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:40.059944 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 407/816] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:40.065990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.168078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b709-a8dd-490e-baf5-9740c97aa6f8 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.175217 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.201837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.202459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.202737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.203005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.210569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:40.211989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-fef8e674-403b-46c9-8982-edcb6a0eb916 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:53:40.224919 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:40.226022 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 30 00:53:40.226961 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:40.229535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 410/817] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:40.232309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.334602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15395d-79d0-424b-a270-9406a7b9e852 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.349104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290ba2-d1c6-4555-bb77-22cda22f9ab6 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.349417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290ba2-d1c6-4555-bb77-22cda22f9ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.349692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd290ba2-d1c6-4555-bb77-22cda22f9ab6 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.351046 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 411/818] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:40.356106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.356383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.356658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.370715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.371316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.371592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.371858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.372582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:40.372882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:40.374323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:40.375866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:40.377094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:40.391353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 408/819] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:40.397053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.439694 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.445997 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 412/820] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:53:40.495409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29cbcb-540d-4fa1-9209-db5abeb946de None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.529096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.529683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.529960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.530233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.597384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:40.599274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:40.637291 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.695572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 409/821] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:53:40.701724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.718400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.794333 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.800608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df0eb2-39d9-4341-8fac-90ea982b39dc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.817222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b39fe-2c27-4eea-8dc6-d1d080878285 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.836714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.837365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.837643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.837933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.847957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:40.849914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:40.851929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:40.852543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:40.852817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:40.853083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:40.860388 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:40.863332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:53:40.864658 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:40.865763 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:53:40.867050 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:53:40.867050 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:53:40.867050 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:40.867050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 413/822] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:40.868104 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:40.869251 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:53:40.870347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 410/823] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:40.871380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.875347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:40.975443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e921cf6-f61f-440a-bec1-66b98b5baed3 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:40.976983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9ae2-41ba-4870-8cd5-c4b2db9e123e None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.008058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.008911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.009188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.009495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.010127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:41.010425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.010632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.011227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.011505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.011776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.011883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.012439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:41.012766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.014151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.023014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 411/824] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:41.024344 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 414/825] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:41.028989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.029694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.039804 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.088883 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.126911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7afb-faab-42d0-9504-ead5b2324f81 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.128804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3408180-b7ca-4b36-a620-1184c4757e76 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.160994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.161643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.161922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.162188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] PATH_INFO: `/v3/users/0c0369f2309343bfa6e9ec96eeaa0574` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.162469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.163086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.163364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.163634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.170240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.171679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.175333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c0369f2309343bfa6e9ec96eeaa0574)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.177385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.179004 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 412/826] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:41 2022] GET /identity/v3/users/0c0369f2309343bfa6e9ec96eeaa0574 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:53:41.183853 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:41.184789 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:53:41.185749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:41.186175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.186256 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 415/827] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 00:53:41.190513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.255710 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.283138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87e13c-8b41-4b81-9692-ce5effb9f2e6 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.289854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3441-6655-4ea4-a836-711b1ac6ebf4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.303539 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.317239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.317885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.318161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.318428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.319520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] RBAC: Authorizing `identity:get_project(project_id=0e2e404e06dd4ed4847191da171e5a14)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.320939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.322583 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 413/828] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:53:41 2022] GET /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:41.323540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.324137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.324416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.324687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.325438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:41.325744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.327394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.328668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.340283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 416/829] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:41.346401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:41.427729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa6ea6-2cd8-469a-92f9-c86abe6c70ef None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.461095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.461773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.462050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.462320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14/users/0c0369f2309343bfa6e9ec96eeaa0574/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.464193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e2e404e06dd4ed4847191da171e5a14, user_id=0c0369f2309343bfa6e9ec96eeaa0574, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.465621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb31cf-e3e5-4b5e-9bda-9fe788e90a80 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.484894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d56b4-520a-4caa-ad22-d7d309434306 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:41.510267 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.518057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:41.518700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:41.519012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:41.526675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:41.526675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] RBAC: Adding query filter params (role.id=5da97468a2f74013aff800db631e01df, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=1449e0ef893c420e93cf26910f4a6a1f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:41.526675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:41.526675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099bfc-a21e-4725-9a7d-26a971517ad6 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:41.528046 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 417/830] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:41 2022] GET /identity/v3/role_assignments?user.id=1449e0ef893c420e93cf26910f4a6a1f&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=5da97468a2f74013aff800db631e01df => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:41.549001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 414/831] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:41 2022] PUT /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14/users/0c0369f2309343bfa6e9ec96eeaa0574/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 00:53:43.717480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9893-6302-485a-aebb-5d8fd776a6fe None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:43.718021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9893-6302-485a-aebb-5d8fd776a6fe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:43.718021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f9893-6302-485a-aebb-5d8fd776a6fe None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:43.719836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 418/832] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 00:53:43.725105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:43.725568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:43.725660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:43.743729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:43.744893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:43.785961 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:43.808418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 415/833] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:44.077157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f9893-6302-485a-aebb-5d8fd776a6fe None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:44.175411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f9893-6302-485a-aebb-5d8fd776a6fe None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:44.209442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:44.210050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.210324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.210592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.220296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:53:44.225010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:53:44.226177 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:53:44.227038 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 419/834] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:53:44.232498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:44.328596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40697a1-b3ba-4289-b169-bf3722c6c26d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:44.360739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:44.361328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.361640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.361932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.362585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:44.363370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:44.364724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:44.372495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 416/835] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:44.378970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:44.430652 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:44.475237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6cdc5-a5e1-4cb7-b665-bf20e0d4546c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:44.509120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:44.509819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.510098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.510371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] PATH_INFO: `/v3/users/0c0369f2309343bfa6e9ec96eeaa0574` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.511477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] RBAC: Authorizing `identity:get_user(user_id=0c0369f2309343bfa6e9ec96eeaa0574)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:44.512899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:44.514490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 420/836] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/users/0c0369f2309343bfa6e9ec96eeaa0574 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:44.520188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:44.560475 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:44.618840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dca18b-d18c-45e0-9bd2-7ec469f44242 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:44.651517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:44.652138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.652416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.652683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.719084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:44.720555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:44.759058 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:44.814565 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 417/837] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:53:44.821000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:44.918595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f28bc-24f8-42ef-b687-c9d30bdef49a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:44.937981 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:44.952212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:44.952832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:44.953110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:44.953410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:44.954548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=0e2e404e06dd4ed4847191da171e5a14)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:44.955970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67405936-4aab-49e7-b642-a333c062fbb0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:44.958293 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 421/838] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:44.964466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:45.058710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7c125-71c8-4596-953c-749d5eb98b8a None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:45.091333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:45.091916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:45.092188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:45.092453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:45.093158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=0e2e404e06dd4ed4847191da171e5a14, user.id=0c0369f2309343bfa6e9ec96eeaa0574) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:45.093490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:45.094965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa95ca4-6178-4857-930b-e7a4861dfdc3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:45.100438 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 418/839] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:44 2022] GET /identity/v3/role_assignments?user.id=0c0369f2309343bfa6e9ec96eeaa0574&scope.project.id=0e2e404e06dd4ed4847191da171e5a14&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:53:47.234130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69415d-064f-4e29-9170-3e14d16eb788 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:47.234706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69415d-064f-4e29-9170-3e14d16eb788 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:47.234706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69415d-064f-4e29-9170-3e14d16eb788 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:47.236015 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 422/840] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:47.241576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:47.242083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:47.242179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:47.249456 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:47.260970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:47.262210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:47.329856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 419/841] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:47.605546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69415d-064f-4e29-9170-3e14d16eb788 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:47.703695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69415d-064f-4e29-9170-3e14d16eb788 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:47.737148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:47.737788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:47.738064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:47.738333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:47.739430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:47.740832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b9e92-2629-438e-ab77-4c9b7a62f786 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:47.742411 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 423/842] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:47.748243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:47.843080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd13157-b82a-4b28-8304-8a6d1d01672f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:47.874975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:47.875522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:47.875804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:47.876075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:47.876734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:47.878743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1738d22-3041-49f2-bfaa-f7fabeb353e5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:47.886845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:47.959065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 420/843] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:53:47 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:50.127183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92701-4483-4f92-b18f-2ad744e2d5ba None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:50.127715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92701-4483-4f92-b18f-2ad744e2d5ba None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:50.127808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92701-4483-4f92-b18f-2ad744e2d5ba None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:50.129113 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 424/844] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:50.134465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528dd-e814-4301-92ca-18f46453679f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:50.134853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528dd-e814-4301-92ca-18f46453679f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:50.135029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95528dd-e814-4301-92ca-18f46453679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:50.152619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b95528dd-e814-4301-92ca-18f46453679f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:50.153754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b95528dd-e814-4301-92ca-18f46453679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:50.217854 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 421/845] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:50.482997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92701-4483-4f92-b18f-2ad744e2d5ba None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:50.543349 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:50.586367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92701-4483-4f92-b18f-2ad744e2d5ba None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:50.619597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:50.620209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:50.620493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:50.620774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] PATH_INFO: `/v3/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:50.622158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] RBAC: Authorizing `identity:get_role(role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:50.623547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:50.624862 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 425/846] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:50 2022] GET /identity/v3/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:50.631334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95528dd-e814-4301-92ca-18f46453679f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:50.727401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95528dd-e814-4301-92ca-18f46453679f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:50.746444 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:50.760125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:50.760737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:50.761012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:50.761282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] PATH_INFO: `/v3/users/144c29c8d5da449fb57a4c48b43ecf96` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:50.774432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] RBAC: Authorizing `identity:get_user(user_id=144c29c8d5da449fb57a4c48b43ecf96)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:50.775881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:50.777491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 422/847] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:50 2022] GET /identity/v3/users/144c29c8d5da449fb57a4c48b43ecf96 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:50.783428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:50.879867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e37d7-b97b-4df5-a9bb-a0e270c1073c None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:50.906269 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:50.917401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:50.918019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:50.918290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:50.918556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:50.919631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] RBAC: Authorizing `identity:get_project(project_id=0e2e404e06dd4ed4847191da171e5a14)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:50.921162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce907964-03c0-4602-91d4-0abcec341f5b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:50.923070 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 426/848] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:53:50 2022] GET /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:50.928830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:51.025485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1401c2-b5f9-4da1-a90c-64bc351e7305 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:51.058108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:51.058743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:51.059020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:51.059331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14/users/144c29c8d5da449fb57a4c48b43ecf96/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:51.061455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e2e404e06dd4ed4847191da171e5a14, user_id=144c29c8d5da449fb57a4c48b43ecf96, role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:51.062866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85931db-9235-44fd-abef-2e01edec7db9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:51.209220 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 423/849] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:53:50 2022] PUT /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14/users/144c29c8d5da449fb57a4c48b43ecf96/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:53:53.334449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fd5b-364b-4f4a-81e6-9daa4d8ab116 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:53.334986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fd5b-364b-4f4a-81e6-9daa4d8ab116 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:53.334986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fd5b-364b-4f4a-81e6-9daa4d8ab116 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:53.336332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 427/850] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:53.342002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:53.342467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:53.342559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:53.360802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:53.363810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:53.392990 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:53.432458 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 424/851] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:53.699348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164fd5b-364b-4f4a-81e6-9daa4d8ab116 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:53.803294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164fd5b-364b-4f4a-81e6-9daa4d8ab116 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:53.837632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:53.838256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:53.838532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:53.838801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] PATH_INFO: `/v3/roles/70e1716c5bc64e81b540ed4c9a71f126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:53.840180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] RBAC: Authorizing `identity:get_role(role_id=70e1716c5bc64e81b540ed4c9a71f126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:53.841564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:53.842911 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 428/852] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:53 2022] GET /identity/v3/roles/70e1716c5bc64e81b540ed4c9a71f126 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:53.848917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:54.065386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8f134-a7a0-47ae-ac5b-96ac3e5bf8fe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:54.099510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:54.100134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:54.100412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:54.100674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] PATH_INFO: `/v3/users/144c29c8d5da449fb57a4c48b43ecf96` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:54.101797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] RBAC: Authorizing `identity:get_user(user_id=144c29c8d5da449fb57a4c48b43ecf96)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:54.103209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:54.104759 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 425/853] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:53:53 2022] GET /identity/v3/users/144c29c8d5da449fb57a4c48b43ecf96 => generated 286 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:54.110650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:54.180324 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:54.218935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf24f-49d5-4976-9d00-225008d93d4a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:54.253962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:54.254558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:54.254839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:54.255112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:54.327128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:54.328617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:54.387745 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:54.430613 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 429/854] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:53:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 30 00:53:54.440304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:54.476758 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:54.542214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ebb-76a3-4418-a0bc-2a8e7fdafc59 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:54.576988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:54.577694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:54.577920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:54.578194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] PATH_INFO: `/v3/projects/0e2e404e06dd4ed4847191da171e5a14` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:54.579308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] RBAC: Authorizing `identity:get_project(project_id=0e2e404e06dd4ed4847191da171e5a14)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:54.580728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29403dc-b448-4c3a-85fa-cd85d2e1eede None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:54.582377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 426/855] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:53:54 2022] GET /identity/v3/projects/0e2e404e06dd4ed4847191da171e5a14 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:54.589025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:54.688491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c5bca-fe85-445d-9ffa-89a5a3909e51 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:54.723923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:54.724525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:54.724809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:54.725083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:54.725837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] RBAC: Adding query filter params (role.id=70e1716c5bc64e81b540ed4c9a71f126, scope.project.id=0e2e404e06dd4ed4847191da171e5a14, user.id=144c29c8d5da449fb57a4c48b43ecf96) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:53:54.726147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:54.727584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95226d73-6193-491e-afef-2f68afe0e87a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:54.733905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 430/856] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:53:54 2022] GET /identity/v3/role_assignments?user.id=144c29c8d5da449fb57a4c48b43ecf96&scope.project.id=0e2e404e06dd4ed4847191da171e5a14&role.id=70e1716c5bc64e81b540ed4c9a71f126 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:56.925951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff10d4-beb2-46be-ac16-ab10b6670ddc None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:56.926526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff10d4-beb2-46be-ac16-ab10b6670ddc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:56.926526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff10d4-beb2-46be-ac16-ab10b6670ddc None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:56.927827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 427/857] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:56.933197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:56.933704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:56.933843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:56.953060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:56.954928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:56.973858 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:57.026121 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 431/858] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:53:57.294242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff10d4-beb2-46be-ac16-ab10b6670ddc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:57.396745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff10d4-beb2-46be-ac16-ab10b6670ddc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:57.399134 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:57.431845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:57.432469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:57.432745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:57.433013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:57.434176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:57.435602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e996a01-6ea6-4cc8-af36-7f339bf41a41 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:57.437165 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 428/859] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:53:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:53:57.443627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:53:57.546927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edbddd-76c6-4cb8-bfd5-42397e9c167a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:53:57.584646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:53:57.585319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:57.585625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:57.585892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:57.586558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:53:57.587977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85701fbd-3ca8-4ee2-9fef-f33c9e40ce2b None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:53:57.683895 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 432/860] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:53:57 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:53:59.874356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841fefa-5d46-4c1d-90e0-0136a5f742d4 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:59.874921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841fefa-5d46-4c1d-90e0-0136a5f742d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:59.874921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841fefa-5d46-4c1d-90e0-0136a5f742d4 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:59.876254 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 429/861] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:53:59.881807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:53:59.882215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:53:59.882355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:53:59.895132 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:59.900597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:53:59.901870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:53:59.968181 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 433/862] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:54:00.236607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841fefa-5d46-4c1d-90e0-0136a5f742d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:00.333362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841fefa-5d46-4c1d-90e0-0136a5f742d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:00.366557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:00.367175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:00.367448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:00.367715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:00.368809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:00.370265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b79a-532d-4e3c-a78c-73fbde776fd9 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:00.371856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 430/863] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:54:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:00.378259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:00.474801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837b097-9c2a-4edb-b443-c81ead3fb057 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:00.507598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:00.508132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:00.508408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:00.508678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:00.509380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:00.510799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d96546-e368-4d98-a549-9a5c4dbbd076 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:00.520129 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:00.613480 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 434/864] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:54:00 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:02.789792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1c45-7b5d-4524-8a4e-0768e9e97b5f None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:02.790389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1c45-7b5d-4524-8a4e-0768e9e97b5f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:02.790389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1c45-7b5d-4524-8a4e-0768e9e97b5f None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:02.791642 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 431/865] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:02.796865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:02.797287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:02.797452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:02.816503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:02.817722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:02.882953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 435/866] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:54:03.156882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa1c45-7b5d-4524-8a4e-0768e9e97b5f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:03.198199 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:03.256925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa1c45-7b5d-4524-8a4e-0768e9e97b5f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:03.290972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:03.291586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:03.291859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:03.292122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:03.302017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:54:03.306657 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:54:03.307819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:54:03.309106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 432/867] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:54:03.313899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:03.409618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48867-2f70-4558-8591-afe765d94e4e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:03.431087 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:03.442773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:03.445185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:03.445185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:03.445185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:03.445185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:03.445185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:03.450647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:03.455611 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 436/868] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:03.461579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:03.611088 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:03.614157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90550c5-7c3f-4712-b7ac-392ca9fdaf96 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:03.647578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e771-5314-4108-981f-b0740b373acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:03.648191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e771-5314-4108-981f-b0740b373acf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:03.648467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e771-5314-4108-981f-b0740b373acf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:03.648736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e771-5314-4108-981f-b0740b373acf None admin] PATH_INFO: `/v3/users/59b54af416ae4eba922b21d742af0e27` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:03.661937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e771-5314-4108-981f-b0740b373acf None admin] RBAC: Authorizing `identity:get_user(user_id=59b54af416ae4eba922b21d742af0e27)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:03.663332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e771-5314-4108-981f-b0740b373acf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:03.664898 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 433/869] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:54:03 2022] GET /identity/v3/users/59b54af416ae4eba922b21d742af0e27 => generated 286 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:03.670906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:03.769386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1489af-a91d-4e21-8d31-487d2a686bff None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:03.801687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:03.802291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:03.802566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:03.802835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] PATH_INFO: `/v3/projects/49396826913b40ef9c087d9044b96723` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:03.803931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] RBAC: Authorizing `identity:get_project(project_id=49396826913b40ef9c087d9044b96723)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:03.805368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2cd57-7d67-495f-84ae-a412940f96e6 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:03.806986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 437/870] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:54:03 2022] GET /identity/v3/projects/49396826913b40ef9c087d9044b96723 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:03.813049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e771-5314-4108-981f-b0740b373acf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:03.911022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e771-5314-4108-981f-b0740b373acf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:03.943618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:03.944200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:03.944475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:03.944741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] PATH_INFO: `/v3/projects/49396826913b40ef9c087d9044b96723/users/59b54af416ae4eba922b21d742af0e27/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:03.946638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] RBAC: Authorizing `identity:create_grant(project_id=49396826913b40ef9c087d9044b96723, user_id=59b54af416ae4eba922b21d742af0e27, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:03.948399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441e551-ad1e-4bd4-80df-20d608238995 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:04.058322 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 434/871] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:54:03 2022] PUT /identity/v3/projects/49396826913b40ef9c087d9044b96723/users/59b54af416ae4eba922b21d742af0e27/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:06.193012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e17af-70de-484a-ae2d-f5ed148f1b4a None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:06.193619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e17af-70de-484a-ae2d-f5ed148f1b4a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:06.193619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e17af-70de-484a-ae2d-f5ed148f1b4a None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:06.194898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 438/872] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:06.200271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:06.200673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:06.200812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:06.219753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:06.220927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:06.233800 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:06.285762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 435/873] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:54:06.554325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e17af-70de-484a-ae2d-f5ed148f1b4a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:06.609049 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:06.656287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e17af-70de-484a-ae2d-f5ed148f1b4a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:06.689327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:06.689965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:06.690245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:06.690516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:06.701209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:54:06.706572 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:54:06.707656 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:54:06.708905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 439/874] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:54:06.713740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:06.808776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442cd3f-bf51-4c6a-916e-7e25e8104a79 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:06.841715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:06.842303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:06.842578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:06.842873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:06.843532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:06.843826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:06.845188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:06.852927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 436/875] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:54:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:06.859758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:06.958629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803a7a3-1655-4a0b-b2d6-f698416449ca None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:06.971452 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:06.991102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:06.991714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:06.991991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:06.992262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] PATH_INFO: `/v3/users/59b54af416ae4eba922b21d742af0e27` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:06.993418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] RBAC: Authorizing `identity:get_user(user_id=59b54af416ae4eba922b21d742af0e27)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:06.994834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:06.996391 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 440/876] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:54:06 2022] GET /identity/v3/users/59b54af416ae4eba922b21d742af0e27 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:07.002204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:07.014571 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:07.102930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c1f1-e167-4737-827e-9255bcab42b5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:07.134456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:07.135036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:07.135309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:07.135573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:07.199319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:07.200728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:07.212191 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:07.294858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 437/877] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:54:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:54:07.300751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:07.398704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5862b9-0eab-4d35-b986-c253ffe62248 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:07.432217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:07.432838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:07.433117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:07.433416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] PATH_INFO: `/v3/projects/49396826913b40ef9c087d9044b96723` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:07.434526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] RBAC: Authorizing `identity:get_project(project_id=49396826913b40ef9c087d9044b96723)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:07.435952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994ac85-afdd-43bd-819e-0136ff2a709f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:07.438122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 441/878] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:54:07 2022] GET /identity/v3/projects/49396826913b40ef9c087d9044b96723 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:07.444317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:07.539470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab642c-d78d-4be0-a4a9-c9dca4724b98 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:07.550373 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:07.573256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:07.573885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:07.574154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:07.574413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:07.575126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=49396826913b40ef9c087d9044b96723, user.id=59b54af416ae4eba922b21d742af0e27) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:07.575427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:07.576896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4348-f661-4986-b0f5-405cf9a6fe74 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:07.582639 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 438/879] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:54:07 2022] GET /identity/v3/role_assignments?user.id=59b54af416ae4eba922b21d742af0e27&scope.project.id=49396826913b40ef9c087d9044b96723&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:09.716167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713099d-e15f-42bb-8dc5-24208db47f34 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:09.716733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713099d-e15f-42bb-8dc5-24208db47f34 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:09.716733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713099d-e15f-42bb-8dc5-24208db47f34 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:09.718080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 442/880] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:09.723187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca52a5-abf5-4396-a401-2c731f90f325 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:09.723592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca52a5-abf5-4396-a401-2c731f90f325 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:09.723735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca52a5-abf5-4396-a401-2c731f90f325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:09.742239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d6ca52a5-abf5-4396-a401-2c731f90f325 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:09.743414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d6ca52a5-abf5-4396-a401-2c731f90f325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:09.812685 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 439/881] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:54:10.083772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713099d-e15f-42bb-8dc5-24208db47f34 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:10.133243 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:10.185499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713099d-e15f-42bb-8dc5-24208db47f34 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:10.218250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:10.218835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:10.219114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:10.219385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:10.220048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:10.221454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5dec9-d901-48c5-94c7-a95ae4701078 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:10.330577 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 443/882] 10.222.0.13 () {60 vars in 1138 bytes} [Sun Oct 30 00:54:10 2022] POST /identity/v3/domains => generated 267 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:12.522207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d187-3f6a-4909-8116-9b7339e7e4df None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:12.522812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d187-3f6a-4909-8116-9b7339e7e4df None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:12.522812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d187-3f6a-4909-8116-9b7339e7e4df None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:12.524050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 440/883] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:12.529358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:12.529778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:12.529909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:12.549122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:12.550332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:12.616308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 444/884] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:54:12.880375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4d187-3f6a-4909-8116-9b7339e7e4df None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:12.981672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4d187-3f6a-4909-8116-9b7339e7e4df None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:12.984028 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:13.015081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:13.015739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:13.016017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:13.016284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] PATH_INFO: `/v3/domains/45ec39c8aee2497c8d0f93abf524e971` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:13.027515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=45ec39c8aee2497c8d0f93abf524e971)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:13.028940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe40f82-8b4f-4b12-b380-8732063392c1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:13.031222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 441/885] 10.222.0.13 () {56 vars in 1183 bytes} [Sun Oct 30 00:54:12 2022] GET /identity/v3/domains/45ec39c8aee2497c8d0f93abf524e971 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:13.037183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:13.078021 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:13.135732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1330713-d0c4-4755-8a09-1b3530a45e22 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:13.170268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:13.170916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:13.171198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:13.171473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:13.172120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:13.173568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115c6ba-2681-4b72-ac1b-66b12f3fe805 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:13.293030 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 445/886] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:54:13 2022] POST /identity/v3/projects => generated 361 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:15.477124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b429f-1d9e-4243-bab9-d23557b3e4ae None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:15.477724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b429f-1d9e-4243-bab9-d23557b3e4ae None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:15.477724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b429f-1d9e-4243-bab9-d23557b3e4ae None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:15.478998 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 442/887] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:15.484335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:15.484763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:15.484945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:15.503392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:15.504567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:15.569431 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 446/888] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 00:54:15.842861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b429f-1d9e-4243-bab9-d23557b3e4ae None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:15.948250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b429f-1d9e-4243-bab9-d23557b3e4ae None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:15.979943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:15.980546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:15.980889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:15.981157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] PATH_INFO: `/v3/domains/45ec39c8aee2497c8d0f93abf524e971` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:15.982264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=45ec39c8aee2497c8d0f93abf524e971)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:15.984195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933855-411c-4f19-8fd0-a86539a95c87 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:15.985738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 443/889] 10.222.0.13 () {56 vars in 1183 bytes} [Sun Oct 30 00:54:15 2022] GET /identity/v3/domains/45ec39c8aee2497c8d0f93abf524e971 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:15.991634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:16.012822 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:16.088584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e698f-bf77-42b4-95e7-aca553bf3429 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:16.121875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:16.122414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:16.122691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:16.122976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:16.123653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:16.125069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ac528-19d4-49e0-aa68-9a765bf13966 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:16.193673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 447/890] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:54:15 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:54:18.379034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee60b-c421-43d1-9663-ca893bc2f3ea None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:18.379635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee60b-c421-43d1-9663-ca893bc2f3ea None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:18.379635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ee60b-c421-43d1-9663-ca893bc2f3ea None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:18.380974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 444/891] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:18.386356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:18.395855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:18.395855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:18.405530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:18.406718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:18.472535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 448/892] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:54:18.741718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee60b-c421-43d1-9663-ca893bc2f3ea None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:18.773313 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:18.839917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ee60b-c421-43d1-9663-ca893bc2f3ea None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:18.872641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:18.873859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:18.874136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:18.874403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:18.885134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:54:18.890035 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:54:18.891101 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:54:18.891927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 445/893] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:54:18.897186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:18.905246 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:18.991906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139044b-448e-443f-99d8-fd09ce084d87 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:19.026559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:19.027159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:19.027436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:19.027704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:19.028362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:19.028660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:19.030596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:19.038756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 449/894] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:19.044710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:19.133688 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:19.142557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa7e4-66e3-4fe1-86b7-6cf379de3da6 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:19.173785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:19.174388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:19.174661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:19.174926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] PATH_INFO: `/v3/users/d1fda34720944e21858c0903d50763c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:19.188586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] RBAC: Authorizing `identity:get_user(user_id=d1fda34720944e21858c0903d50763c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:19.190026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:19.191583 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 446/895] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:54:19 2022] GET /identity/v3/users/d1fda34720944e21858c0903d50763c7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:19.197929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:19.376637 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:19.409553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0d7e0-f370-4bf8-ade2-bbdf424a1930 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:19.443688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:19.444310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:19.444590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:19.445112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] PATH_INFO: `/v3/projects/66280b504e644dea9eb9fcde12c65cfa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:19.446248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=66280b504e644dea9eb9fcde12c65cfa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:19.447724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9425ad4-c1ec-404d-a526-887be4c87cb1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:19.449401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 450/896] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:54:19 2022] GET /identity/v3/projects/66280b504e644dea9eb9fcde12c65cfa => generated 361 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:19.456155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:19.551918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033ce8e-a534-4d20-a63b-62e39f48b2ab None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:19.586378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:19.587025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:19.587306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:19.587578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] PATH_INFO: `/v3/projects/66280b504e644dea9eb9fcde12c65cfa/users/d1fda34720944e21858c0903d50763c7/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:19.589483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] RBAC: Authorizing `identity:create_grant(project_id=66280b504e644dea9eb9fcde12c65cfa, user_id=d1fda34720944e21858c0903d50763c7, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:19.590944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83d4d-d365-4cf0-acb5-b386a14b07de None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:19.684552 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 447/897] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:54:19 2022] PUT /identity/v3/projects/66280b504e644dea9eb9fcde12c65cfa/users/d1fda34720944e21858c0903d50763c7/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:54:21.804528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15a01-ff63-4491-a5e5-4788319ada81 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:21.805063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15a01-ff63-4491-a5e5-4788319ada81 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:21.805155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d15a01-ff63-4491-a5e5-4788319ada81 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:21.806489 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 451/898] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:54:21.811811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:21.812253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:21.812344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:21.830786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:54:21.831959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:54:21.834727 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:21.898359 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 448/899] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:54:22.167282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d15a01-ff63-4491-a5e5-4788319ada81 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:22.265767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d15a01-ff63-4491-a5e5-4788319ada81 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:22.298099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:22.298711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:22.298985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:22.299285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:22.301947 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:22.309514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:54:22.315188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:54:22.317040 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:54:22.318225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 452/900] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:54:22.322714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:22.418872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e428f2-18ee-49bb-837c-77223e8ee05a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:22.452051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:22.452639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:22.452915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:22.453181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:22.453863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:22.454164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:22.455514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:22.463248 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 449/901] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:22.469477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:22.567131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd2de-c6ba-40c8-9fd4-92151150348a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:22.601207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:22.601932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:22.602215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:22.602491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] PATH_INFO: `/v3/users/d1fda34720944e21858c0903d50763c7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:22.603609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1fda34720944e21858c0903d50763c7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:22.605027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:22.606728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 453/902] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 30 00:54:22 2022] GET /identity/v3/users/d1fda34720944e21858c0903d50763c7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:22.613080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:22.615937 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:22.710465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05d981-5cd9-4bcf-b62b-e5bbaa0c9368 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:22.742968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:22.743561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:22.743835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:22.744101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:22.808000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:22.809440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:22.811706 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:22.904727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 450/903] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:54:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:54:22.910772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:22.971298 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:23.008113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29006f-cba7-43a5-86be-1870054f40a4 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:23.040501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:23.041111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:23.041418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:23.041693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] PATH_INFO: `/v3/projects/66280b504e644dea9eb9fcde12c65cfa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:23.042873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] RBAC: Authorizing `identity:get_project(project_id=66280b504e644dea9eb9fcde12c65cfa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:23.044886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2064f-346c-4b88-81e8-55ec5bcb46c0 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:23.046518 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 454/904] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 30 00:54:22 2022] GET /identity/v3/projects/66280b504e644dea9eb9fcde12c65cfa => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:54:23.052597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:54:23.148212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52063ab2-63c0-4298-a715-6b89428d2ad8 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:54:23.149748 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:23.184212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:54:23.184819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:54:23.185099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:54:23.185391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:54:23.186108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=66280b504e644dea9eb9fcde12c65cfa, user.id=d1fda34720944e21858c0903d50763c7) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:54:23.186412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:54:23.187823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8275-3761-4306-835f-5a4013464a85 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:54:23.193395 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 451/905] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:54:23 2022] GET /identity/v3/role_assignments?user.id=d1fda34720944e21858c0903d50763c7&scope.project.id=66280b504e644dea9eb9fcde12c65cfa&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:54:33.036517 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=34 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:33.190869 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=17 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:41.549700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61640-908c-4e03-b1a2-ee18eb302b57 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:41.550335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61640-908c-4e03-b1a2-ee18eb302b57 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:41.550335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61640-908c-4e03-b1a2-ee18eb302b57 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:41.551627 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 455/906] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:41.556871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:41.557320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:41.557457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:41.576943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:41.578728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:41.646061 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 452/907] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:55:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:41.920562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da61640-908c-4e03-b1a2-ee18eb302b57 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:42.022177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da61640-908c-4e03-b1a2-ee18eb302b57 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:42.055142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:42.055752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:42.056028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:42.056296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:42.067268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:42.068715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:42.082941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:42.084020 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:42.085016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:42.085016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:42.085016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:42.085016 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 456/908] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:42.090371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:42.188842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dc80a-986b-47f3-ae78-478bc453fd65 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:42.216888 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:42.222808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:42.223409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:42.223692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:42.223959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:42.224652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:42.224955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:42.226346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32981d0c-adbe-4c05-a5f2-b06533e4c1e5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:42.237531 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 453/909] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:42.243342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:42.296223 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:42.342805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eebe4-9cf7-4f8f-b867-9417d9cd1ce1 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:42.375363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:42.375989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:42.376262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:42.376530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:42.377179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:42.378647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3e4b6-a49c-4c4d-bc2f-b6c272e5525f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:42.572334 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 457/910] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 30 00:55:42 2022] POST /identity/v3/users => generated 251 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 00:55:44.786293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24708-6415-4aa3-948a-645d4c5c5959 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:44.786857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24708-6415-4aa3-948a-645d4c5c5959 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:44.786857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24708-6415-4aa3-948a-645d4c5c5959 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:44.788171 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 454/911] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:44.793324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:44.793766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:44.793891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:44.811969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:44.819154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:44.878178 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 458/912] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:55:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:45.146262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c24708-6415-4aa3-948a-645d4c5c5959 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.246480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c24708-6415-4aa3-948a-645d4c5c5959 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.280183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.280800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.281081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.281362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.291656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:55:45.296485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:45.301730 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:45.302798 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 455/913] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:45.303684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.342938 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:45.400381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7486-ed0c-4ada-b4d3-6def2b7b8dab None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.432747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.433365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.433637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.433904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.434550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] RBAC: Adding query filter params (name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:45.434847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:45.436193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:45.444588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 459/914] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:45.450537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.500706 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:45.550406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e4794-f229-403f-b176-cf354641dcf7 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.583536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.584146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.584423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.584688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.594794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:45.596217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:45.610983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:45.612172 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:45.613263 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:45.613263 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:45.613263 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:45.613263 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 456/915] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:45.618065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.713580 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:45.716379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74f28d-4d0b-4924-b082-0a87f712458d None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.749432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.750632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.750959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.751236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.751866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:45.752169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:45.753547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:45.764641 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 460/916] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:45.770412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:45.869635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc3ad-4712-4be8-9c2a-b98790aff1c1 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:45.871106 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:45.903442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:45.906534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:45.906534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:45.906534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:45.911897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:45.913326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:55:45.924235 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:45.925409 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:45.926367 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 457/917] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:45.931191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.031613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfd184-7378-4b0a-a2fa-f8f18953ad3f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.065864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.066472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.066749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.067108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.067835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:46.068140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.069612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.087127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 461/918] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 30 00:55:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:46.092891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.189419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a0065-8bfc-4c5a-b619-0be6593d159f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.221544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.222160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.222432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.222696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.232913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.234959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:46.248670 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:46.249845 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:46.250971 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:46.250971 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:46.250971 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:46.250971 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 458/919] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:46.255543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.274526 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:46.351724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e797b-0062-4698-91bc-cfd0ac149067 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.384914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.385540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.385819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.386088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.386718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:46.387019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.388410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.400261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 462/920] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:46.406729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.422399 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:46.504328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aefd-25c0-4dba-90c1-85b57e96d9a5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.537610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.538242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.538511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.538820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.545221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.547300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:55:46.558283 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:46.559224 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:46.560418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 459/921] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:46.565871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.641600 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:46.663330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452deb4c-2647-438f-877f-ad8e06ee16e7 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.696487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.697094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.697396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.697669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.698348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:46.698649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.700061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4f56b-775a-4a28-b5de-87a9e5cf1469 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.712144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 463/922] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:46.718752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:46.798076 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:46.822439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e40be2-bec2-4761-9938-9f34f256e027 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:46.856115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:46.856763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:46.857047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:46.857378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/897aa8bacc3b47ef90b104754bb2817c/roles/64642fa4e2264f3aad5ac593f1c335dc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:46.871622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=897aa8bacc3b47ef90b104754bb2817c, role_id=64642fa4e2264f3aad5ac593f1c335dc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:46.873041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150f95e-c709-4059-93dc-c14dcddd09dd None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:46.979568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 460/923] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:55:46 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/897aa8bacc3b47ef90b104754bb2817c/roles/64642fa4e2264f3aad5ac593f1c335dc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:49.128741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a2ff-ca9b-4d1b-b485-ed1c6d187ecb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.129293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a2ff-ca9b-4d1b-b485-ed1c6d187ecb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.129293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795a2ff-ca9b-4d1b-b485-ed1c6d187ecb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.130693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 464/924] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:49.136015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.136447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.136547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.155073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:49.156396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:49.226578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 461/925] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:55:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:49.498018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a2ff-ca9b-4d1b-b485-ed1c6d187ecb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.599090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795a2ff-ca9b-4d1b-b485-ed1c6d187ecb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.631870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.632480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.632756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.637019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.640554 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:49.644265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:55:49.649154 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:49.653400 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:49.654460 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 465/926] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 30 00:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:49.656536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.711008 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:49.753243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec0c9a-e4c2-47cb-a3e8-208e0ef7ade7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.788293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.788893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.789175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.789477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.790147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:49.790446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:49.791856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:49.799796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 462/927] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 30 00:55:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:49.805728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:49.906866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed527f2-7dcf-4f28-8475-354267537f89 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:49.941214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:49.941868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:49.942149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:49.942424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:49.953502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:49.955026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:49.970447 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:49.971596 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:49.972745 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:49.972745 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:49.972745 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:49.972745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 466/928] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:49.977479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.076145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539590b1-4b4f-44aa-a0bf-ad470f71d0b3 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.091674 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.108929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.110004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.110278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.110541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.111164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:50.111456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.112798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.124680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 463/929] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:50.130969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.182645 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.231109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907acb16-a79d-46e1-a631-a47003d5b69a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.264561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.265265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.265596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.265864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.273087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.274527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:55:50.285452 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:50.286610 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:50.287574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 467/930] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:50.292417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.391255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac0c7-9293-47e3-b527-922459c4055f None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.425057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.425686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.425963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.426231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.426950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:50.427252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.428666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.446256 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 464/931] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:50.452069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.554330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877bfd3-1d8c-4b66-bf01-caab9889f7ce None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.564917 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.587522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.588112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.588387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.588654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.653384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.654872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.752812 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 468/932] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:50.758748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.792395 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:50.855272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd69f99-0445-43b1-8243-e3793ff0c398 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:50.888165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:50.888777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:50.889049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:50.889314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:50.899753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:50.901190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:50.916133 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:50.917411 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:50.918361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:50.918361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:50.918361 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:50.918361 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 465/933] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:50.923129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:50.934418 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:51.019008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed9cf-8239-42a9-a470-78a81b1a3bde None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:51.052212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:51.052807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:51.054305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:51.054305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:51.054305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:51.054305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:51.055619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:51.067277 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 469/934] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:51.073086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:51.158715 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:51.173053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fefa8-27ef-49d8-ba22-8111c0ebfd3d None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:51.206787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:51.207394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:51.207670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:51.207936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:51.214585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:51.215994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:55:51.226993 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:51.233024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:51.234197 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 466/935] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:55:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:51.234764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:51.302089 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:51.333567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48402b-1eac-438e-9514-e187ee7f8b21 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:51.364998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:51.365611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:51.365885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:51.366151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:51.366821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:51.367118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:51.368551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a74ea-cf29-4b8b-8234-66a853164346 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:51.381064 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 470/936] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:51.387157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:51.484144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c832fc4-1157-44af-a160-200e92df6489 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:51.518946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:51.519531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:51.519876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:51.520145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:51.520892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] RBAC: Adding query filter params (role.id=64642fa4e2264f3aad5ac593f1c335dc, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=897aa8bacc3b47ef90b104754bb2817c) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:51.521191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:51.522620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbe9b9-c25c-444b-8520-ed6bbc3a8d0c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:51.528297 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 467/937] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:55:51 2022] GET /identity/v3/role_assignments?user.id=897aa8bacc3b47ef90b104754bb2817c&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=64642fa4e2264f3aad5ac593f1c335dc => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:53.723872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8523-05e3-49eb-9e88-19d622e6a0ad None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:53.724410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8523-05e3-49eb-9e88-19d622e6a0ad None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:53.724410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e8523-05e3-49eb-9e88-19d622e6a0ad None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:53.725787 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 471/938] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:53.731137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:53.731559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:53.731677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:53.749558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:53.750734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:53.753843 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:53.815598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 468/939] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:55:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:54.085638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e8523-05e3-49eb-9e88-19d622e6a0ad None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.184198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e8523-05e3-49eb-9e88-19d622e6a0ad None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.213065 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:54.218862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:54.219511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:54.219785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:54.220052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:54.229770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:55:54.234487 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:54.235678 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:54.236706 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 472/940] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:54.241766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.337316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aaec0-ebac-4f20-a0e6-09516e3e0ec3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.369610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:54.370195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:54.370471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:54.370739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:54.371400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:54.371760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:54.373124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:54.381915 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 469/941] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:54.387650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.487278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6027-c384-446a-bcc0-00ce85536490 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.521821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:54.522439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:54.522716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:54.522999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:54.532526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:54.533978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:54.548721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:54.550033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:54.551148 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:54.551148 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:54.551148 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:54.551148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 473/942] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:54.555947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.558868 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:54.651990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0ec1a-dfeb-4e7b-bb83-89e6c9a79620 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.684694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:54.685283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:54.685591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:54.685876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:54.686485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:54.686779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:54.688938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:54.700152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 470/943] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 00:55:54.706005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.748571 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:54.803343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8abc2c-7f70-4766-8159-868ee3ea3a5a None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.836070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:54.836679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:54.836955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:54.837224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:54.844971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:54.849371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:55:54.857854 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:54.858941 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:54.860479 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 474/944] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:54.865830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:54.927441 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:54.963670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cfd9-0f00-44fd-aa36-0284cd0f7127 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:54.999831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.000423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.000696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.000961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.001819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:55.002115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.003524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.020029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 471/945] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 30 00:55:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:55.025886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:55.124178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099911ec-bc9b-4de6-8db2-28398a745b7f None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:55.125699 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:55.157186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.157825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.158101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.158368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.168469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.169961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:55.184386 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:55.185549 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:55.186818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:55.186818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:55.186818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:55.186818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 475/946] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:55.191437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:55.289981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec829e-af7f-46c3-afd7-20b0c27a30fc None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:55.311019 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:55.324636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.325230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.325536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.325807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.326447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:55.326745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.328638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.339447 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 472/947] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:55.345782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:55.446171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85edd-4ac5-4157-8dd4-7bedef440ee2 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:55.479777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.480399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.480677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.480950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.488137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.489617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:55:55.500760 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:55.501855 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:55.502977 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 476/948] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:55.507790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:55.606919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ee76-7ad6-4cf7-b01c-02247cef24de None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:55.639556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.640145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.640504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.641269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.641980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:55.642282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.643696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d4aec-9d42-4f19-9003-6939d1696a67 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.655459 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 473/949] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:55.661739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:55.677815 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:55.759418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e223bda-bae7-40ce-b49d-205b8945dede None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:55.792446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:55.793135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:55.793438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:55.793708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] PATH_INFO: `/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/897aa8bacc3b47ef90b104754bb2817c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:55.795719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] RBAC: Authorizing `identity:create_grant(project_id=657aeb3031984f5f88426c3f9f385d20, user_id=897aa8bacc3b47ef90b104754bb2817c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:55.797117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae99d4-8877-48f0-b95b-9714324c67be None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:55.987580 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 477/950] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 30 00:55:55 2022] PUT /identity/v3/projects/657aeb3031984f5f88426c3f9f385d20/users/897aa8bacc3b47ef90b104754bb2817c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 00:55:58.128879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5275-74a3-4754-a78d-b408f98d4235 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:58.129508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5275-74a3-4754-a78d-b408f98d4235 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:58.129508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5275-74a3-4754-a78d-b408f98d4235 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:58.130870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 474/951] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:55:58.136210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:58.136638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:58.136766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:58.155450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:55:58.156568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:55:58.223935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 478/952] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:55:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:58.502581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5275-74a3-4754-a78d-b408f98d4235 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:58.545249 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:58.605909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5275-74a3-4754-a78d-b408f98d4235 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:58.638955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:58.639560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:58.639832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:58.640214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:58.650840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 30 00:55:58.656189 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:58.658001 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:58.659769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 475/953] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 30 00:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:58.663507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:58.666672 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:58.760744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab408e7-ef3b-413c-a111-ca4233a59e45 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:58.794173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:58.794761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:58.795151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:58.795300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:58.796097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:58.797071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:58.798453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:58.806223 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 479/954] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 30 00:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:58.812456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:58.910109 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:58.913106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17296-de0b-4352-a23e-932905a55ba5 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:58.945828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:58.946445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:58.946713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:58.946982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:58.957536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:58.958970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:58.973906 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:58.975055 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:58.975991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:58.975991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:58.975991 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:58.975991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 476/955] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:58.981028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:59.044512 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:59.078913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f4ddb-0ee3-4199-bdb7-af76b1c10963 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:59.111346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:59.111933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:59.112205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:59.112466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:59.113082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:59.113404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:59.114746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:59.125979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 480/956] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:59.131822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:59.228660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198036-6c9b-43a2-84c8-0c479024250b None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:59.260378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:59.260981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:59.261256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:59.261546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] PATH_INFO: `/v3/users/placement` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:59.269255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:59.270755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 00:55:59.282077 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:59.283490 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:55:59.284819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 477/957] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:59.289194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:59.387200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c638b8c-7950-455a-8da3-b6e4f3441fd2 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:59.412554 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:59.421016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:59.421662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:59.421935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:59.422200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:59.422903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:55:59.423201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:59.424648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:59.442033 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 481/958] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 30 00:55:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:55:59.447900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:59.464500 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:59.548018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c45ed-ee37-40ff-a377-fc275d23835c None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:59.582336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:59.582931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:59.583212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:59.583499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:59.648954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:59.650326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:59.663609 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:59.746521 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 478/959] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 30 00:55:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:59.753263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:55:59.853645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a329b2e-d691-4381-9641-04bbc13e3107 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:55:59.888824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:55:59.889473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:55:59.889761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:55:59.890034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:55:59.900506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:55:59.901941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 00:55:59.917223 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:55:59.918225 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 30 00:55:59.919192 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 00:55:59.919192 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 30 00:55:59.919192 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:55:59.919192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 482/960] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 00:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:55:59.926356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:00.024652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b40e9b-0cd9-4510-8921-290433d35d48 None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:00.039827 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:00.060311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:00.060895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:00.061166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:00.061462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:00.062949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:00.063239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:00.064612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:00.075670 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 479/961] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 30 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:00.081489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:00.117253 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:00.180798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7312-adc4-4a69-891e-0265fe632e51 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:00.214718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:00.215327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:00.215601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:00.215868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:00.222942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:00.224362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 30 00:56:00.235787 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:56:00.236870 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 00:56:00.238125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 483/962] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 30 00:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:56:00.243084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:00.340546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85119926-81b0-481e-8917-d9e78c02d6be None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:00.373913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:00.374504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:00.374778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:00.375044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:00.375743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:00.376042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:00.377475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adca8a-674d-4184-ad1f-a64213261f6a None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:00.389173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 480/963] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 30 00:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:00.395547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:00.496015 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:00.501741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c00f-953c-4946-9cd0-861bbc99dd09 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:00.535699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:00.536292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:00.536564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:00.536830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:00.537573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] RBAC: Adding query filter params (role.id=2be61dd3a1dd4c158a4acc57cb37fb15, scope.project.id=657aeb3031984f5f88426c3f9f385d20, user.id=897aa8bacc3b47ef90b104754bb2817c) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:00.537876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:00.539283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74010dc0-05ec-49f2-b38c-dd0c15ea1b81 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:00.544967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 484/964] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 30 00:56:00 2022] GET /identity/v3/role_assignments?user.id=897aa8bacc3b47ef90b104754bb2817c&scope.project.id=657aeb3031984f5f88426c3f9f385d20&role.id=2be61dd3a1dd4c158a4acc57cb37fb15 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:02.684396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b27c7-7b1e-4890-88c3-9711fd15b372 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:02.684962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b27c7-7b1e-4890-88c3-9711fd15b372 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:02.684962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b27c7-7b1e-4890-88c3-9711fd15b372 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:02.686289 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 481/965] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:56:02.691866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:02.692279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:02.692541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:02.711102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:02.712299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:02.779075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 485/966] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:56:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:56:03.047774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b27c7-7b1e-4890-88c3-9711fd15b372 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:03.079068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:03.147714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b27c7-7b1e-4890-88c3-9711fd15b372 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:03.181833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:03.182469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:03.182746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:03.183014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:03.183584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:03.184935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:56:03.193724 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:56:03.195144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:03.196372 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 482/967] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:56:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:56:03.201015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:03.288088 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:03.298086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b0ab-af56-4e65-a2ec-4ceabb620c1a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:03.333649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:03.334243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:03.334520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:03.334787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:03.335404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:03.335704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:03.337049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3fbaa-25e9-4512-8d78-a728939675b3 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:03.341905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 486/968] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 30 00:56:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:03.348298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:03.442892 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:03.448540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf09a5-e5b8-4f68-9a1c-5e614d6c40bf None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:03.482007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:03.482599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:03.482876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:03.483144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:03.483765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:03.484061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:03.485440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c1e0a-c3c3-4519-a516-f1c37ecb87d2 None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:03.489715 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 483/969] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 30 00:56:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:05.631536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22fff-f844-4bfc-bf1b-10c64f581a67 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:05.632143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22fff-f844-4bfc-bf1b-10c64f581a67 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:05.632143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a22fff-f844-4bfc-bf1b-10c64f581a67 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:05.633493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 487/970] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:56:05.638550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e737-ba5b-4096-99d9-637a5a621cc5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:05.638951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e737-ba5b-4096-99d9-637a5a621cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:05.639094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e737-ba5b-4096-99d9-637a5a621cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:05.657517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fd37e737-ba5b-4096-99d9-637a5a621cc5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:05.658760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd37e737-ba5b-4096-99d9-637a5a621cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:05.724547 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 484/971] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:56:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:56:05.995381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22fff-f844-4bfc-bf1b-10c64f581a67 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:06.096145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a22fff-f844-4bfc-bf1b-10c64f581a67 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:06.129691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:06.130281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:06.130559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:06.130830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:06.131486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:06.132842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a91d-2abf-42e8-89a2-aef7ad584c49 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:06.384815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 488/972] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 30 00:56:05 2022] POST /identity/v3/services => generated 246 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:08.530012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b842-ab6f-4403-bdbe-3c776410fbf3 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.530608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b842-ab6f-4403-bdbe-3c776410fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.530608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0b842-ab6f-4403-bdbe-3c776410fbf3 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.531883 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 485/973] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:56:08.537035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:08.537848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:08.537848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:08.555447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:08.560032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:08.566839 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:08.629605 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 489/974] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:56:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:56:08.904437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b842-ab6f-4403-bdbe-3c776410fbf3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:08.992116 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:09.002901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0b842-ab6f-4403-bdbe-3c776410fbf3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:09.035398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:09.036012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:09.036287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:09.036554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] PATH_INFO: `/v3/services/placement` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:09.037125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:09.038502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:56:09.047826 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:56:09.049105 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:09.050110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 486/975] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:56:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:56:09.055114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:09.153555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7453d-867b-427e-ac35-42ebfa0b4faf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:09.187044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:09.187639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:09.187918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:09.188241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:09.188879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:09.189175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:09.190574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:09.195947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 490/976] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 30 00:56:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:09.202082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:09.302191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abafd80-0b0d-4d19-a05e-25c93c0670ee None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:09.335759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:09.337915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:09.337915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:09.337915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:09.337915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] RBAC: Adding query filter params (interface=public, service_id=722f8774136b4a99b847a7e3afca810c, region_id=RegionOne) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:09.337915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:09.339347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6a5e-efde-4c8a-a82e-cc72809b114b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:09.345095 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 487/977] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 30 00:56:09 2022] GET /identity/v3/endpoints?service_id=722f8774136b4a99b847a7e3afca810c&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:09.350760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:09.354505 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:09.448883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aaa68-5c2a-4aaa-8cc1-6335163bb9c2 None admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:09.483373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:09.483973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:09.484254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:09.484527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:09.485126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:09.486513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be9fcd-7ed5-4ea8-934e-95f4d5ce8cb4 None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:09.493227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 491/978] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 30 00:56:09 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 00:56:11.698444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592967-3ce6-443f-8997-c9a8dea2225c None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:11.699006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592967-3ce6-443f-8997-c9a8dea2225c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:11.699006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51592967-3ce6-443f-8997-c9a8dea2225c None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:11.700298 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 488/979] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 00:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 00:56:11.705984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:11.709455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:11.709455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:11.727922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 00:56:11.729119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 00:56:11.790020 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:11.795263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 492/980] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 00:56:11 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 30 00:56:12.067064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592967-3ce6-443f-8997-c9a8dea2225c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:12.086695 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:12.167939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51592967-3ce6-443f-8997-c9a8dea2225c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:12.201844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:12.203007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:12.203281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:12.203544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] PATH_INFO: `/v3/services/placement` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:12.204108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:12.205475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 00:56:12.214198 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 00:56:12.215347 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 00:56:12.216190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 489/981] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 30 00:56:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 00:56:12.221508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:12.319350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2849f8-7c31-4764-b253-2af376b3ee4a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:12.352744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:12.353361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:12.353653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:12.353926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:12.354550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] RBAC: Adding query filter params (name=placement) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 00:56:12.354852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:12.356291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa461-2af2-46a2-b70f-01d87ac3c48f None admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:12.361449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 493/982] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 30 00:56:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 00:56:12.367536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 00:56:12.450330 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:12.468019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d4d56-e59a-4257-aea2-a9770647f6df None admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 00:56:12.503834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 00:56:12.504488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 00:56:12.504747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 00:56:12.505013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 00:56:12.505702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 00:56:12.507115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6ec3c-ecb9-4d72-b634-427604625c4b None admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 00:56:12.597482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 490/983] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 00:56:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 00:56:22.358374 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=69 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:22.592603 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:04.993844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dde0e-ccf2-4583-9e17-8d1d9ef47eb3 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:04.994449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dde0e-ccf2-4583-9e17-8d1d9ef47eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:04.994449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dde0e-ccf2-4583-9e17-8d1d9ef47eb3 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:05.001206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189cc0-1dce-4a45-9470-748c6b7bf0e2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:05.003752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189cc0-1dce-4a45-9470-748c6b7bf0e2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:05.003752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189cc0-1dce-4a45-9470-748c6b7bf0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:05.004709 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 494/984] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:05.133639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5f189cc0-1dce-4a45-9470-748c6b7bf0e2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:05.135224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5f189cc0-1dce-4a45-9470-748c6b7bf0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:05.326233 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 491/985] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:03:05.624948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:05.625236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:05.625792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:05.627218 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 495/986] 10.222.0.13 () {54 vars in 965 bytes} [Sun Oct 30 01:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:05.633144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5cee9-5934-410c-bdf6-a3042504e6e4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:05.633816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5cee9-5934-410c-bdf6-a3042504e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:05.634289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5cee9-5934-410c-bdf6-a3042504e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:05.715037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55f5cee9-5934-410c-bdf6-a3042504e6e4 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:05.716242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55f5cee9-5934-410c-bdf6-a3042504e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:05.738343 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:05.804605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 492/987] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:05.815352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:05.817239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:05.949802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7bffe-51ba-4348-bc16-032b9c03939d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:06.032962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:06.033703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:06.033861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:06.034429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:06.036009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:06.095856 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:06.152480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:06.153838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8fd99-1a0f-4da5-8dff-3337f61c2c4d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:06.173101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 496/988] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:08.631255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8d6-b8ee-4a07-822a-6018d3754cac None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:08.631900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8d6-b8ee-4a07-822a-6018d3754cac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:08.631900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a8d6-b8ee-4a07-822a-6018d3754cac None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:08.633589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 493/989] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:08.639172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeacfa-2b9f-4e97-8470-c892699d5cae None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:08.639613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeacfa-2b9f-4e97-8470-c892699d5cae None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:08.639716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeacfa-2b9f-4e97-8470-c892699d5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:08.726549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bcdeacfa-2b9f-4e97-8470-c892699d5cae None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:08.727898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bcdeacfa-2b9f-4e97-8470-c892699d5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:08.826348 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 497/990] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:09.129460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b463-bee7-4e82-a715-acb547446410 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:09.129763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b463-bee7-4e82-a715-acb547446410 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:09.130036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b463-bee7-4e82-a715-acb547446410 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:09.131391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 494/991] 10.222.0.13 () {54 vars in 965 bytes} [Sun Oct 30 01:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:09.137484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9a119-0ed6-48f4-88a5-bc7baa27bcbd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:09.137930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9a119-0ed6-48f4-88a5-bc7baa27bcbd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:09.138358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9a119-0ed6-48f4-88a5-bc7baa27bcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:09.151189 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:09.222072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-30b9a119-0ed6-48f4-88a5-bc7baa27bcbd None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:09.223274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-30b9a119-0ed6-48f4-88a5-bc7baa27bcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:09.300525 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 498/992] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:09.310436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b463-bee7-4e82-a715-acb547446410 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:09.312263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0309b463-bee7-4e82-a715-acb547446410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:09.417386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b463-bee7-4e82-a715-acb547446410 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:09.493009 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:09.495885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:09.496484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:09.496761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:09.497028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:09.498694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:09.607782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:09.609211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdba1d-c18f-46d0-969c-e5be36a09fc1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:09.628173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 495/993] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:12.508067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:12.508641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:12.508641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:12.509980 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 499/994] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:12.515764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596935-73de-4cd0-883e-99f236c50a07 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:12.516194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596935-73de-4cd0-883e-99f236c50a07 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:12.516313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37596935-73de-4cd0-883e-99f236c50a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:12.582696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-37596935-73de-4cd0-883e-99f236c50a07 None None] MFA Rules not processed for user `37059a78252546879c642c5d24d5fd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:12.583918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-37596935-73de-4cd0-883e-99f236c50a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:12.635644 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:12.678684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 496/995] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:12.969626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:12.971189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:13.084600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaf227-75aa-4847-90b7-ddbfc1ab2fdf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:13.087496 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:13.158563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:13.159167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:13.159447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:13.159713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:13.161300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:13.267799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:13.269200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7110163-f8d9-4cfd-a74a-f30a394ded77 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:13.287234 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 500/996] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:16.310405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:16.311250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:16.311250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:16.312527 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 497/997] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:16.317762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685f87b-37de-44ff-a755-c2c7f1638642 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:16.318168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685f87b-37de-44ff-a755-c2c7f1638642 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:16.318313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685f87b-37de-44ff-a755-c2c7f1638642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:16.359293 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:16.384476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1685f87b-37de-44ff-a755-c2c7f1638642 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:16.385752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1685f87b-37de-44ff-a755-c2c7f1638642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:16.482379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 501/998] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:16.773113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:16.774790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:16.878716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a128c5-1616-4082-a13c-e883c3dd9bf2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:16.954114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:16.954633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:16.954912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:16.955180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:16.956777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:16.964528 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:17.063669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:17.065084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cab2c6-2674-4bf5-9bc8-e33324828cdc service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:17.083684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 498/999] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:20.218518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:20.219085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:20.219085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:20.220386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 502/1000] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:20.225665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469bab-342a-4705-a1ed-252ba0530da0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:20.226107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469bab-342a-4705-a1ed-252ba0530da0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:20.226196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469bab-342a-4705-a1ed-252ba0530da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:20.291910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ed469bab-342a-4705-a1ed-252ba0530da0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:20.293099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed469bab-342a-4705-a1ed-252ba0530da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:20.353347 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:20.392907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 499/1001] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:20.674407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:20.676014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:20.781677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb34f9-9510-4fb1-a936-b23771127254 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:20.795195 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:20.859450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:20.860055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:20.860329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:20.860596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:20.862309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:20.984376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:20.985873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e6e8-3763-4ed9-be61-92adcb47b190 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:21.004525 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 503/1002] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:23.259034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:23.259581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:23.259688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:23.260955 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 500/1003] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:23.266569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ab5f-7fdc-48a4-a870-752ecfeeea51 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:23.267083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ab5f-7fdc-48a4-a870-752ecfeeea51 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:23.267186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ab5f-7fdc-48a4-a870-752ecfeeea51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:23.320011 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:23.342352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d0d5ab5f-7fdc-48a4-a870-752ecfeeea51 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:23.348287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0d5ab5f-7fdc-48a4-a870-752ecfeeea51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:23.446652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 504/1004] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:23.732024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:23.733592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:23.840361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940befe7-fc1a-476c-8acc-b50c11092c76 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:23.917853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:23.918451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:23.918723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:23.919018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:23.920595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:23.939903 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:24.034174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:24.035619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4002de2-7dce-4f97-ab24-1e266fb07256 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:24.054006 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 501/1005] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:26.300562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:26.301071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:26.301194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:26.302488 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 505/1006] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:26.308454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a448-014e-41fd-9b20-86dbeb81ab60 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:26.308855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a448-014e-41fd-9b20-86dbeb81ab60 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:26.308994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03a448-014e-41fd-9b20-86dbeb81ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:26.377856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1e03a448-014e-41fd-9b20-86dbeb81ab60 None None] MFA Rules not processed for user `37059a78252546879c642c5d24d5fd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:26.379100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e03a448-014e-41fd-9b20-86dbeb81ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:26.451068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:26.485771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 502/1007] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:26.772643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:26.774224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:26.897830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd3aa-03c6-424d-b60b-5e77a126533f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:26.923209 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:26.984105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:26.984867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:26.985143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:26.985546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:26.987082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:27.107030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:27.108477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0765a-c5bd-4e50-966f-f0aac6a0a48a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:27.129231 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 506/1008] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:29.897690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:29.898156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:29.898248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:29.899589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 503/1009] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:29.904833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad82e-2281-4b6c-b518-c89960119248 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:29.905258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad82e-2281-4b6c-b518-c89960119248 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:29.905405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad82e-2281-4b6c-b518-c89960119248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:29.969400 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:29.971938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9cdad82e-2281-4b6c-b518-c89960119248 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:29.973181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9cdad82e-2281-4b6c-b518-c89960119248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:30.070096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 507/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:30.351527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:30.353704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:30.457095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eaec4-0b7a-4e91-8bcf-d469af3a874c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:30.531216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:30.531816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:30.532150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:30.532423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:30.534064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:30.560695 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:30.644329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:30.645717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043971f-78d0-427c-ab92-da8816d3fcb6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:30.664470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 504/1011] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:32.872558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:32.873093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:32.873093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:32.874463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 508/1012] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:32.880069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ec32-d852-4211-a213-51870135a28d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:32.880501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ec32-d852-4211-a213-51870135a28d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:32.880606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99ec32-d852-4211-a213-51870135a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:32.945639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7d99ec32-d852-4211-a213-51870135a28d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:32.946882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7d99ec32-d852-4211-a213-51870135a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:33.019113 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:33.041855 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 505/1013] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:33.323436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:33.324970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:33.431889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9966-ef20-4052-9dbf-dc4be404bc1a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:33.463577 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:33.509654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:33.510265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:33.510538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:33.510802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:33.512373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:33.620301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:33.621661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f4c95-6ce0-4416-8025-e62ba223c93f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:33.639624 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 509/1014] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:36.376808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:36.377369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:36.377369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:36.378725 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 506/1015] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:36.384651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e8293-1415-401f-b02f-363f8d6f3193 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:36.385070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e8293-1415-401f-b02f-363f8d6f3193 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:36.385193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e8293-1415-401f-b02f-363f8d6f3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:36.449849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0a0e8293-1415-401f-b02f-363f8d6f3193 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:36.451045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a0e8293-1415-401f-b02f-363f8d6f3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:36.459279 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:36.546305 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 510/1016] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:36.842503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:36.844276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:36.958759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f269a57-e27f-4385-be13-9ecbc93c7430 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:37.036894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:37.037519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:37.037795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:37.038064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:37.039647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:37.076412 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:37.151516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:37.152939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0078db-b898-4049-8aac-e9aa8584968d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:37.172373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 507/1017] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:41.688185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:41.688751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:41.688751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:41.690118 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 511/1018] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:41.696218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff61f-e150-444d-9afd-b2c1af69e6d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:41.696674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff61f-e150-444d-9afd-b2c1af69e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:41.696778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff61f-e150-444d-9afd-b2c1af69e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:41.764715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-44fff61f-e150-444d-9afd-b2c1af69e6d6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:41.765935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-44fff61f-e150-444d-9afd-b2c1af69e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:41.853200 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:41.864879 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 508/1019] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:42.153786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:42.155324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:42.260980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675a80-ed2d-4edf-b907-fa2943ac2b28 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:42.298693 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:42.336855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:42.337501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:42.337783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:42.338055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:42.339688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:42.454449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:42.458351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ae1a0-ece9-4170-9113-4fd2dc13366d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:42.474755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 512/1020] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:45.661373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:45.661973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:45.661973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:45.663268 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 509/1021] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:45.668907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84af86-d16e-45c1-8987-2dd4fd158097 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:45.669423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84af86-d16e-45c1-8987-2dd4fd158097 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:45.669625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84af86-d16e-45c1-8987-2dd4fd158097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:45.740035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-da84af86-d16e-45c1-8987-2dd4fd158097 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:45.741269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-da84af86-d16e-45c1-8987-2dd4fd158097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:45.761202 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:45.846075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 513/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:46.126592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:46.128141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:46.238988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec127f-be43-4cfa-b5b6-3bf625dc3c6d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:46.332034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:46.334037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:46.335018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:46.335297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:46.336950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:46.386381 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:46.463431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:46.464895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a52f72-2b04-45fe-b03b-89e33e6aabfe service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:46.486211 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 510/1023] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:50.928275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:50.928809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:50.928809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:50.930424 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 514/1024] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:50.936460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b3ad-46b4-4dff-81c4-805cfa0c4d22 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:50.936901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b3ad-46b4-4dff-81c4-805cfa0c4d22 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:50.937514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b3ad-46b4-4dff-81c4-805cfa0c4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:51.016303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2cd5b3ad-46b4-4dff-81c4-805cfa0c4d22 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:51.017540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2cd5b3ad-46b4-4dff-81c4-805cfa0c4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:51.129369 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:51.131634 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 511/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:03:51.413154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:03:51.415210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:51.519460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac0425-4175-422c-b766-3111c5334bcc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:03:51.570076 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:51.597014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:03:51.597641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:51.597919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:51.598184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:51.599791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:51.710561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:03:51.712030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1cd51-b715-4b45-a697-401cb3659e98 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:03:51.730368 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 515/1026] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:03:56.722469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15323-3b03-4bf2-b1ce-b9f85686f0f0 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:56.722894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15323-3b03-4bf2-b1ce-b9f85686f0f0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:56.723023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15323-3b03-4bf2-b1ce-b9f85686f0f0 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:56.724794 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 512/1027] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:03:56.730364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce187dd-63c7-4f75-ae6a-780f4b51fa02 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:03:56.730763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce187dd-63c7-4f75-ae6a-780f4b51fa02 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:03:56.730939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce187dd-63c7-4f75-ae6a-780f4b51fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:03:56.866242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ce187dd-63c7-4f75-ae6a-780f4b51fa02 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:03:56.867640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ce187dd-63c7-4f75-ae6a-780f4b51fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:03:56.902918 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:57.020661 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 516/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:01.235086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433503-5449-48c5-8d62-ea126bab584c None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:01.235670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433503-5449-48c5-8d62-ea126bab584c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:01.235670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433503-5449-48c5-8d62-ea126bab584c None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:01.236905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 513/1029] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:01.242841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39c704-3c56-415d-92b2-4cadbc030980 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:01.243370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39c704-3c56-415d-92b2-4cadbc030980 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:01.243609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39c704-3c56-415d-92b2-4cadbc030980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:01.325605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd39c704-3c56-415d-92b2-4cadbc030980 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:01.326998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd39c704-3c56-415d-92b2-4cadbc030980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:01.402389 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:01.448198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 517/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:02.763970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04deb-81b3-4d22-b8a8-6d3fbf2aa175 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:02.764526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04deb-81b3-4d22-b8a8-6d3fbf2aa175 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:02.764526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04deb-81b3-4d22-b8a8-6d3fbf2aa175 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:02.766106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 514/1031] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:02.771994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7b24-f3d6-49c3-b7d3-418266cf09b1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:02.772433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7b24-f3d6-49c3-b7d3-418266cf09b1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:02.772572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7b24-f3d6-49c3-b7d3-418266cf09b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:02.853660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5bca7b24-f3d6-49c3-b7d3-418266cf09b1 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:02.854893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5bca7b24-f3d6-49c3-b7d3-418266cf09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:02.969125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 518/1032] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:06.509176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263f21-cae4-459c-9195-cd4a3bc12727 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:06.509892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263f21-cae4-459c-9195-cd4a3bc12727 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:06.509892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f263f21-cae4-459c-9195-cd4a3bc12727 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:06.515009 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 515/1033] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:06.517664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4af1-2276-41c1-819b-cce204953d26 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:06.518134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4af1-2276-41c1-819b-cce204953d26 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:06.518229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd4af1-2276-41c1-819b-cce204953d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:06.561575 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:06.598910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-38bd4af1-2276-41c1-819b-cce204953d26 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:06.600544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-38bd4af1-2276-41c1-819b-cce204953d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:06.706189 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 519/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:07.010428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:07.010855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:07.011058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:07.012287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 516/1035] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:07.020992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4808b-f8ff-4dd7-8676-29c30e3280e0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:07.021906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4808b-f8ff-4dd7-8676-29c30e3280e0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:07.022267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4808b-f8ff-4dd7-8676-29c30e3280e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:07.133681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bbb4808b-f8ff-4dd7-8676-29c30e3280e0 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:07.135018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bbb4808b-f8ff-4dd7-8676-29c30e3280e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:07.189737 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.267213 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 520/1036] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:04:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:07.276807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:07.278442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:07.437775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d4830-bb70-4ccd-b850-fffd7a3b0068 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:07.515660 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:07.559222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:07.560160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:07.560890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:07.561410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:07.563220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:07.666071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:07.667807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b9d4a-3cc8-4334-bdb3-fde009587099 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:07.689550 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 517/1037] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:10.107249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:10.121466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:10.121466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:10.121466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 521/1038] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:10.121768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b5c0-01bb-4a26-83e9-f5753f84c4cb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:10.121768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b5c0-01bb-4a26-83e9-f5753f84c4cb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:10.121768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b5c0-01bb-4a26-83e9-f5753f84c4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:10.212067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-72e3b5c0-01bb-4a26-83e9-f5753f84c4cb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:10.213721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-72e3b5c0-01bb-4a26-83e9-f5753f84c4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:10.258135 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:10.325761 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 518/1039] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:10.618436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:10.620069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:10.790774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e054b-262d-44c5-87a4-3565582d2ab1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:10.803257 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:10.958082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:10.958702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:10.959066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:10.959336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:10.960969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:11.055630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:11.057148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b55ba-23eb-4683-9706-146d8ab50092 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:11.075897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 522/1040] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:13.703352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfb5b-eef4-44c9-ba09-b70062c0f634 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:13.704240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfb5b-eef4-44c9-ba09-b70062c0f634 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:13.704674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabfb5b-eef4-44c9-ba09-b70062c0f634 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:13.706188 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 519/1041] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:04:13.712156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff30c-f8b1-41f4-8e2f-cabc0525faf5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:13.712655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff30c-f8b1-41f4-8e2f-cabc0525faf5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:13.712760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff30c-f8b1-41f4-8e2f-cabc0525faf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:13.739366 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:13.814105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e71ff30c-f8b1-41f4-8e2f-cabc0525faf5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:13.815310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e71ff30c-f8b1-41f4-8e2f-cabc0525faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:13.947626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 523/1042] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:14.248313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:14.248838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:14.249293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:14.251636 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 520/1043] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:14.261314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8570c-bc36-46cc-952f-d7e07b8d452e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:14.262602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8570c-bc36-46cc-952f-d7e07b8d452e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:14.262602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8570c-bc36-46cc-952f-d7e07b8d452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:14.373728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bbc8570c-bc36-46cc-952f-d7e07b8d452e None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:14.380226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bbc8570c-bc36-46cc-952f-d7e07b8d452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:14.424239 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:14.537191 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 524/1044] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:14.545834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:14.547875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:14.761702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf514c6-ffd9-481d-8439-a19b2bd000dd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:14.789327 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:14.921312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:14.922163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:14.922445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:14.922712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:14.924319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:15.034324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:15.037324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40082486-562a-4190-a89a-63d6f5640cf5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:15.064380 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 521/1045] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:04:17.657162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:17.658180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:17.658621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:17.664791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 525/1046] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:17.666312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d6df-04fc-4910-9086-4c36fbee4df8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:17.666840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d6df-04fc-4910-9086-4c36fbee4df8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:17.667067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d6df-04fc-4910-9086-4c36fbee4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:17.765003 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:17.852319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3cf1d6df-04fc-4910-9086-4c36fbee4df8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:17.853982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cf1d6df-04fc-4910-9086-4c36fbee4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:18.049718 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 522/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:18.353975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:18.355976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:18.603169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a49b8-a9ed-48e7-859f-1723a300f301 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:18.603548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a49b8-a9ed-48e7-859f-1723a300f301 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:18.604347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a49b8-a9ed-48e7-859f-1723a300f301 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:18.606307 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 523/1048] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:18.609593 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:18.611450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48edd-dfc1-4c7f-bce1-a2db764eff5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:18.611947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48edd-dfc1-4c7f-bce1-a2db764eff5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:18.612223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48edd-dfc1-4c7f-bce1-a2db764eff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:18.615112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3564254-acfb-46d1-b59f-216d91fd5c61 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:18.681822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2fb48edd-dfc1-4c7f-bce1-a2db764eff5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:18.683218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2fb48edd-dfc1-4c7f-bce1-a2db764eff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:18.742206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:18.742819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:18.743100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:18.743373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:18.744105 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:18.744982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:18.801316 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 524/1049] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:18.845987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:18.847565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28302d0-9d6d-4fd9-9fe9-22a6e32143ea service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:18.864392 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:18.868544 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 526/1050] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:19.107716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:19.107993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:19.108573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:19.110468 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 525/1051] 10.222.0.13 () {54 vars in 963 bytes} [Sun Oct 30 01:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:19.117176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469321c-5d7d-4aee-87f7-c9de716513e9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:19.117835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469321c-5d7d-4aee-87f7-c9de716513e9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:19.118323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469321c-5d7d-4aee-87f7-c9de716513e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:19.211200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c469321c-5d7d-4aee-87f7-c9de716513e9 None None] MFA Rules not processed for user `135b054aaaae4c84b280fe4e9908e240`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:19.212627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c469321c-5d7d-4aee-87f7-c9de716513e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:19.309714 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 527/1052] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 30 01:04:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:19.317509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:19.319060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:19.431818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881982e-2c85-482b-b4a3-0f47108937de None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:19.515791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:19.516319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:19.516600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:19.516864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:19.518505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:19.531359 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:19.651648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:19.652945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc328be-a317-46df-9cf8-31452fc01a06 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:19.674560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 526/1053] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:04:21.209603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:21.210469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:21.210916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:21.212478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 528/1054] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:21.218277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8651-eb99-4539-966c-383f799b2c6c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:21.218751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8651-eb99-4539-966c-383f799b2c6c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:21.218831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd8651-eb99-4539-966c-383f799b2c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:21.292609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21dd8651-eb99-4539-966c-383f799b2c6c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:21.293852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21dd8651-eb99-4539-966c-383f799b2c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:21.354844 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:21.404172 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 527/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:21.695819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:21.697449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:21.800391 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:21.869574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705791-a1ab-4dd7-a319-6c649f91704c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:22.026832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:22.027606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:22.027918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:22.028195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:22.029862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:22.096030 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:22.136150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:22.139124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9e76f-cb4f-4567-96ce-1d8c5a78a2a6 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:22.160897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 529/1056] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:04:24.604391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:24.604935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:24.605138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:24.610795 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 528/1057] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:24.612156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0df6-688f-479b-af9b-dccb80fb97d4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:24.612607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0df6-688f-479b-af9b-dccb80fb97d4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:24.612700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0df6-688f-479b-af9b-dccb80fb97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:24.688206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-acdb0df6-688f-479b-af9b-dccb80fb97d4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:24.689435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-acdb0df6-688f-479b-af9b-dccb80fb97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:24.797948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 530/1058] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:25.090679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:25.092195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:25.279336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab096049-d901-45b3-8a3d-c2b9e1f30d02 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:25.354749 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:25.431034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:25.431643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:25.431923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:25.432513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:25.434168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:25.537031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:25.538589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ddb89-678c-4e67-95ca-623406c7c0eb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:25.563057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 529/1059] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:27.975636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:27.976200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:27.976305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:27.977908 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 531/1060] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:27.983592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ddac2-2156-4abd-a538-0d62defb8eda None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:27.984039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ddac2-2156-4abd-a538-0d62defb8eda None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:27.984151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ddac2-2156-4abd-a538-0d62defb8eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:28.056347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a75ddac2-2156-4abd-a538-0d62defb8eda None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:28.057853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a75ddac2-2156-4abd-a538-0d62defb8eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:28.059915 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:28.180039 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 530/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:28.547063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:28.549079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:28.591438 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:28.721895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2b8f-76d4-4b14-80c3-17a18a9b5b85 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:28.839645 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:28.846559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:28.847165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:28.847438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:28.847704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:28.850142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:28.946408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:28.947987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869f8cc-77ae-441f-a179-4b4638d7d014 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:28.966992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 532/1062] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:31.135389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:31.135951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:31.135951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:31.137155 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 531/1063] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:31.142566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2caae-e259-4868-ba87-ab6a56eb0f54 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:31.143006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2caae-e259-4868-ba87-ab6a56eb0f54 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:31.143111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2caae-e259-4868-ba87-ab6a56eb0f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:31.215291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dbc2caae-e259-4868-ba87-ab6a56eb0f54 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:31.216956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dbc2caae-e259-4868-ba87-ab6a56eb0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:31.289878 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:31.329759 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 533/1064] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:31.619653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:31.621290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:31.760826 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:31.777427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30296e6-81aa-402d-8d6e-5f636f7f3cc8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:31.908440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:31.909076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:31.909362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:31.909635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:31.911245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:32.011284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:32.012874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2043eb-3a3c-4c0b-b0be-6963cecb6564 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:32.017973 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:32.031962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 532/1065] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:34.549366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:34.549938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:34.549938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:34.551192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 534/1066] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:34.557483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45af69-99b9-4cc6-a9ab-33d88cbc4b93 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:34.557973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45af69-99b9-4cc6-a9ab-33d88cbc4b93 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:34.558079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45af69-99b9-4cc6-a9ab-33d88cbc4b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:34.634187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e45af69-99b9-4cc6-a9ab-33d88cbc4b93 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:34.635378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e45af69-99b9-4cc6-a9ab-33d88cbc4b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:34.729796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 533/1067] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:35.018432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:35.019932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:35.165649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a006c11-69f3-4f84-8db7-e928638d9392 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:35.218024 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:35.284463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:35.285071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:35.285369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:35.285674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:35.287325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:35.381501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:35.383072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b721-2c49-4d65-9488-4b53bb866a86 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:35.401148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 535/1068] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:35.883607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092c24-785b-4f3a-a7a5-ae0e41fbc0b9 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:35.884253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092c24-785b-4f3a-a7a5-ae0e41fbc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:35.884253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9092c24-785b-4f3a-a7a5-ae0e41fbc0b9 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:35.885691 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 534/1069] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:04:35.891117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa44d4-f1e0-411d-af85-d7d044fef82b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:35.891654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa44d4-f1e0-411d-af85-d7d044fef82b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:35.891654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa44d4-f1e0-411d-af85-d7d044fef82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:35.964771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-06fa44d4-f1e0-411d-af85-d7d044fef82b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:35.966036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-06fa44d4-f1e0-411d-af85-d7d044fef82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:35.973219 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:36.069587 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 536/1070] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:36.369784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:36.370069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:36.370347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:36.371694 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 535/1071] 10.222.0.13 () {54 vars in 962 bytes} [Sun Oct 30 01:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:36.377884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe082a2-a10c-47f8-b3b8-20b8e2157253 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:36.378246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe082a2-a10c-47f8-b3b8-20b8e2157253 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:36.378590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe082a2-a10c-47f8-b3b8-20b8e2157253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:36.460875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9fe082a2-a10c-47f8-b3b8-20b8e2157253 None None] MFA Rules not processed for user `82ec9bbb37ef44fe8cf300e8f298498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:36.468074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9fe082a2-a10c-47f8-b3b8-20b8e2157253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:36.543987 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 537/1072] 10.222.0.13 () {58 vars in 1059 bytes} [Sun Oct 30 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:36.552516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:36.554070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:36.630097 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:36.661640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e0cf-3104-436c-85ec-b982f3ca5e0a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:36.739307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:36.739908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:36.740181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:36.740447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:36.742079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:36.868035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:36.869501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0d9b0-1063-4711-899c-2f864f58a5f6 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:36.886206 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:36.889398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 536/1073] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:04:37.797808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c119fa4-7417-4265-85b7-2062adc4ebb2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:37.798323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c119fa4-7417-4265-85b7-2062adc4ebb2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:37.798602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c119fa4-7417-4265-85b7-2062adc4ebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:37.803231 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:37.817760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0373-57ac-42a7-b59b-c93c6b343522 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:37.818042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0373-57ac-42a7-b59b-c93c6b343522 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:37.818315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0373-57ac-42a7-b59b-c93c6b343522 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:37.819658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 537/1074] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:04:37.825034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2924a-62cd-4004-8e91-55f43cc31192 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:37.825378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2924a-62cd-4004-8e91-55f43cc31192 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:37.825615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2924a-62cd-4004-8e91-55f43cc31192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:37.878352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1c119fa4-7417-4265-85b7-2062adc4ebb2 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:37.880369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1c119fa4-7417-4265-85b7-2062adc4ebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:37.900272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9ea2924a-62cd-4004-8e91-55f43cc31192 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:37.901739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ea2924a-62cd-4004-8e91-55f43cc31192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:37.980406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 538/1075] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:38.021866 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 538/1076] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:38.026158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:38.026625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:38.026903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:38.028432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 539/1077] 10.222.0.13 () {54 vars in 943 bytes} [Sun Oct 30 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:38.035240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2486-76df-465a-890e-32e417d0b614 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:38.035541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2486-76df-465a-890e-32e417d0b614 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:38.035910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2486-76df-465a-890e-32e417d0b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:38.114467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-334d2486-76df-465a-890e-32e417d0b614 None None] MFA Rules not processed for user `88425fb345824272be839024c9316741`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:38.115689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-334d2486-76df-465a-890e-32e417d0b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:38.138081 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:38.229813 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 539/1078] 10.222.0.13 () {58 vars in 1040 bytes} [Sun Oct 30 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:38.238907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:38.241249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:38.310055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2486-76df-465a-890e-32e417d0b614 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:38.311365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-334d2486-76df-465a-890e-32e417d0b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:38.334495 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:38.388969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ac4f-1a25-43fb-bede-fe2b5cc2d7ff None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:38.417504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2486-76df-465a-890e-32e417d0b614 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:38.463513 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:38.503588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:38.504186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:38.504460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:38.504746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:38.506927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:38.538532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:38.539279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:38.539561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:38.539830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:38.541480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:38.588385 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:38.599916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:38.601607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fa4d5-2eb1-462c-9a3f-54900a44b987 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:38.610334 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 540/1079] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:04:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:04:38.648990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:38.650758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e648c-0982-49a9-9fba-c72ca5a961d3 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:38.671645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 540/1080] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:04:41.818723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:41.819307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:41.819307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:41.821013 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 541/1081] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:41.827167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a466ac-582e-44df-8dbd-e90b6ce0753c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:41.827768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a466ac-582e-44df-8dbd-e90b6ce0753c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:41.827768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a466ac-582e-44df-8dbd-e90b6ce0753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:41.912637 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:41.920960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-49a466ac-582e-44df-8dbd-e90b6ce0753c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:41.922237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-49a466ac-582e-44df-8dbd-e90b6ce0753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:42.096860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 541/1082] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:04:42.399854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:42.401652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:42.572270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f77a-9aae-46cf-b7ce-07a5afef0273 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:42.645308 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:42.713399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:42.714013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:42.714295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:42.714567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:42.716209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:42.825866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:42.826549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a8f5b-c1ec-439a-83a8-38df34079a98 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:42.847713 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 542/1083] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:45.315087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:45.315666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:45.315666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:45.317191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 542/1084] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:04:45.322805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2828-8679-452a-8544-a96ee75f6ace None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:45.323383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2828-8679-452a-8544-a96ee75f6ace None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:45.323383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2828-8679-452a-8544-a96ee75f6ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:45.411083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-91fa2828-8679-452a-8544-a96ee75f6ace None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:04:45.415385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91fa2828-8679-452a-8544-a96ee75f6ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:45.470890 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:45.594028 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 543/1085] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:04:45.901032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:04:45.903052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:46.072270 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:46.103731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba686b6c-3e99-4d13-a4ee-c5ca7f1949b4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:04:46.256235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:04:46.257131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:04:46.257485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:04:46.257762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:04:46.259364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:04:46.372499 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:46.375542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:04:46.377195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624278a-1de2-4387-aa0a-476f08a107d5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:04:46.399078 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 543/1086] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:04:55.591654 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=31 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:56.407022 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:03.960884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3365fc-5ff9-4d8b-8a72-794813380731 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:03.961449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3365fc-5ff9-4d8b-8a72-794813380731 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:03.961449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3365fc-5ff9-4d8b-8a72-794813380731 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:03.962813 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 544/1087] 10.222.0.13 () {54 vars in 918 bytes} [Sun Oct 30 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:03.968022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60206-ee62-4bbf-9889-1cbd1a6297ff None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:03.968486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60206-ee62-4bbf-9889-1cbd1a6297ff None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:03.968596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60206-ee62-4bbf-9889-1cbd1a6297ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:04.051742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2e60206-ee62-4bbf-9889-1cbd1a6297ff None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:04.052980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2e60206-ee62-4bbf-9889-1cbd1a6297ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:04.167344 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 544/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 30 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:04.182121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e2a9-19ef-487c-8d13-013578a11b59 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:04.182463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e2a9-19ef-487c-8d13-013578a11b59 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:04.182778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e2a9-19ef-487c-8d13-013578a11b59 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:04.184235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 545/1089] 10.222.0.13 () {54 vars in 918 bytes} [Sun Oct 30 01:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:04.188933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838e2d-b84b-4d62-b37c-447e105f548b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:04.189212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838e2d-b84b-4d62-b37c-447e105f548b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:04.189530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99838e2d-b84b-4d62-b37c-447e105f548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:04.267754 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:04.271569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99838e2d-b84b-4d62-b37c-447e105f548b None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:04.272822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99838e2d-b84b-4d62-b37c-447e105f548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:04.390727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 545/1090] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 30 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:07.002361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:07.002947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:07.002947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:07.004434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 546/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:07.009908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f342fb-fa00-4baf-9f98-85efd14fc600 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:07.010347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f342fb-fa00-4baf-9f98-85efd14fc600 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:07.010444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f342fb-fa00-4baf-9f98-85efd14fc600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:07.078937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-31f342fb-fa00-4baf-9f98-85efd14fc600 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:07.080062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-31f342fb-fa00-4baf-9f98-85efd14fc600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:07.138752 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:07.182589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 546/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:07.473097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:07.474688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:07.625095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa521-ecf8-40a1-80a9-677fa91cacbe None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:07.697817 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:07.738011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:07.738653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:07.738938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:07.739212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:07.740819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:07.832053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:07.833703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374b11-9745-4334-8725-9a9303f13141 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:07.853042 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 547/1093] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:08.993455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:08.994000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:08.994000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:08.995307 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 547/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:09.000205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b625e-e84e-4a2b-8378-8d9514d646d4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:09.000681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b625e-e84e-4a2b-8378-8d9514d646d4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:09.000777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b625e-e84e-4a2b-8378-8d9514d646d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:09.077778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-780b625e-e84e-4a2b-8378-8d9514d646d4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:09.078912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-780b625e-e84e-4a2b-8378-8d9514d646d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:09.107314 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:09.179668 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 548/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:09.344266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:09.345744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:09.490545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a8bb-ce0c-42fc-8ab6-133062b6682b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:09.530832 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:09.609521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:09.610034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:09.610328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:09.610590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:09.612192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:09.703380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:09.704949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499bf8f-56e8-478a-87b1-0754274be77f service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:09.723338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 548/1096] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:10.851855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:10.852479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:10.852479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:10.853798 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 549/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:10.859210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515f69-9df2-4ace-b9a4-ec5e1c962eb9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:10.859724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515f69-9df2-4ace-b9a4-ec5e1c962eb9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:10.859724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515f69-9df2-4ace-b9a4-ec5e1c962eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:10.915872 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:10.938112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b515f69-9df2-4ace-b9a4-ec5e1c962eb9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:10.939311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b515f69-9df2-4ace-b9a4-ec5e1c962eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:11.038156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 549/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:11.192233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:11.193864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:11.344519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ed4c0-ef87-4287-b106-f2e9cdf5950d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:11.357283 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:11.457888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:11.458501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:11.458792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:11.459042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:11.460619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:11.553108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:11.554813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff98f66-ee4c-493b-901e-1f644da38e98 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:11.575824 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 550/1099] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:12.694226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:12.694730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:12.700831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:12.700831 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 550/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:12.701656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835cd3-5555-48ac-8ebd-a7219e3889e1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:12.702133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835cd3-5555-48ac-8ebd-a7219e3889e1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:12.702266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b835cd3-5555-48ac-8ebd-a7219e3889e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:12.722804 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:12.780464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5b835cd3-5555-48ac-8ebd-a7219e3889e1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:12.781790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b835cd3-5555-48ac-8ebd-a7219e3889e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:12.882045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 551/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:13.033062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:13.034669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:13.146572 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:13.184636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6acc0-b6d7-4329-8816-bf1f633f9ffe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:13.299653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:13.300804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:13.301080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:13.301362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:13.302977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:13.379398 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:13.393114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:13.394733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c9bcc-3026-4516-9cc3-5a47a79c5a11 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:13.414071 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 551/1102] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:14.529123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:14.529747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:14.529747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:14.531151 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 552/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:14.536283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142f597-73af-49e0-af29-54385a229198 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:14.536746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142f597-73af-49e0-af29-54385a229198 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:14.536852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142f597-73af-49e0-af29-54385a229198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:14.615051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2142f597-73af-49e0-af29-54385a229198 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:14.616263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2142f597-73af-49e0-af29-54385a229198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:14.714397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 552/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:14.865078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:14.866594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:14.959389 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:15.022323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db47960-89df-4fdf-92a5-4f5909371921 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:15.136516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:15.137023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:15.137295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:15.137593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:15.139189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:15.189083 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:15.230923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:15.232527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6676b5e-d1a5-46e3-acf6-c68fe19e2897 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:15.250390 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 553/1105] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:16.364171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:16.364730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:16.364730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:16.366099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 553/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:16.371151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85baad-5fb2-45fa-9c24-4114f975bafb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:16.371621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85baad-5fb2-45fa-9c24-4114f975bafb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:16.371718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85baad-5fb2-45fa-9c24-4114f975bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:16.447878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f85baad-5fb2-45fa-9c24-4114f975bafb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:16.449073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f85baad-5fb2-45fa-9c24-4114f975bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:16.547920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 554/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:16.695492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:16.697033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:16.747902 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:16.844960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3c9c-deff-426f-9068-afaf31df99a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:16.964579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:16.965100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:16.965410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:16.965680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:16.967389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:16.975781 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:17.061807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:17.063390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3573fc-3ff1-4d94-a95a-0b9b8e04f4d9 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:17.082529 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 554/1108] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:18.241370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:18.241966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:18.241966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:18.243161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 555/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:18.248671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e309f0-bf2a-4469-8bff-05b41e757aa5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:18.249392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e309f0-bf2a-4469-8bff-05b41e757aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:18.249392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e309f0-bf2a-4469-8bff-05b41e757aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:18.329091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a9e309f0-bf2a-4469-8bff-05b41e757aa5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:18.330332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a9e309f0-bf2a-4469-8bff-05b41e757aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:18.404202 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:18.433221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 555/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:18.588147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:18.589767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:18.608045 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:18.743865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4614-b2e5-44a5-97ed-dc3cfb90c7ff None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:18.834989 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:18.861035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:18.861787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:18.862606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:18.863048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:18.865028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:18.956373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:18.957996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028ed6-250f-49b8-a945-1e96957abbff service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:18.976529 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 556/1111] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:20.106189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:20.106768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:20.106768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:20.108124 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 556/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:20.114322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec73878-8e5b-4758-8da7-87e56b98bd28 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:20.114804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec73878-8e5b-4758-8da7-87e56b98bd28 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:20.114896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec73878-8e5b-4758-8da7-87e56b98bd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:20.194949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eec73878-8e5b-4758-8da7-87e56b98bd28 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:20.196206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eec73878-8e5b-4758-8da7-87e56b98bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:20.240501 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:20.296942 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 557/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:20.449020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:20.450513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:20.606132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7590-748e-4269-89e7-d11f538f5426 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:20.664217 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:20.724426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:20.724932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:20.725210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:20.725508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:20.727116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:20.819199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:20.820788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281a6e9-034b-4fb2-a258-83737dce83cb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:20.838980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 557/1114] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:21.947829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:21.948403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:21.948500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:21.950054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 558/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:21.957125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38885-203c-4429-97c5-ec978da7a405 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:21.957647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38885-203c-4429-97c5-ec978da7a405 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:21.957736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38885-203c-4429-97c5-ec978da7a405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:22.036157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8ed38885-203c-4429-97c5-ec978da7a405 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:22.037450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8ed38885-203c-4429-97c5-ec978da7a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:22.039438 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:22.134976 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 558/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:22.292341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:22.293892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:22.455095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6e99-decb-4768-8d73-100716cae212 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:22.485409 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:22.582513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:22.583037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:22.583321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:22.583596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:22.585230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:22.677297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:22.678943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47eebc-7c12-41d4-ad0d-d1bcbfac7fef service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:22.699427 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 559/1117] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:24.833503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:24.834397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:24.834397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:24.835788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 559/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:05:24.842167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a1b44-d6d9-421a-a15c-7b8c5d51c86c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:24.842778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a1b44-d6d9-421a-a15c-7b8c5d51c86c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:24.842778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a1b44-d6d9-421a-a15c-7b8c5d51c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:24.890429 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:24.926011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-928a1b44-d6d9-421a-a15c-7b8c5d51c86c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:24.927583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-928a1b44-d6d9-421a-a15c-7b8c5d51c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:25.054193 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 560/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:25.346915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:25.348623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:25.467547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd7405-3e27-4d0a-8573-4dc9b40fe599 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:25.505511 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:25.557061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:25.557711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:25.558005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:25.558255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:25.560020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:25.700624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:25.707220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ee90-977f-4edd-9b1a-6b80bd4189bf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:25.723392 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 560/1120] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:28.178824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:28.179502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:28.179502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:28.181245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 561/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:28.187295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fbc2-6a47-4889-815a-ea52d8dc1e0e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:28.188101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fbc2-6a47-4889-815a-ea52d8dc1e0e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:28.188101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fbc2-6a47-4889-815a-ea52d8dc1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:28.267456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-92c0fbc2-6a47-4889-815a-ea52d8dc1e0e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:28.268719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-92c0fbc2-6a47-4889-815a-ea52d8dc1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:28.284422 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:28.404037 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 561/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:28.696272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:28.697868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:28.824154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330415-5ef4-4b53-ae71-c00507e11ac5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:28.837212 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:28.917032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:28.917689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:28.917971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:28.918247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:28.919985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:29.053949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:29.055655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ba642-72c3-4d77-87b2-9363f8c84470 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:29.077521 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 562/1123] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:31.966252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:31.967142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:31.967142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:31.968779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 562/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:31.975135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730528-5c9b-4f8f-af29-a836d382c5da None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:31.975891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730528-5c9b-4f8f-af29-a836d382c5da None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:31.975891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa730528-5c9b-4f8f-af29-a836d382c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:32.032709 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:32.055194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fa730528-5c9b-4f8f-af29-a836d382c5da None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:32.056441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa730528-5c9b-4f8f-af29-a836d382c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:32.184493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 563/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:32.484197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:32.485917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:32.618825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5284a-fa11-49b9-8534-e3fcecfefc15 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:32.670031 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:32.712012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:32.712666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:32.712940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:32.713213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:32.715040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:32.852520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:32.854020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d3c7-aa20-4c9c-b476-a696bf960ba6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:32.881457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 563/1126] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:05:35.407868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:35.408495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:35.408495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:35.410043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 564/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:35.416495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee37cb-8b82-40a4-bf2f-2c7732b85039 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:35.417087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee37cb-8b82-40a4-bf2f-2c7732b85039 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:35.417087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee37cb-8b82-40a4-bf2f-2c7732b85039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:35.497239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-59ee37cb-8b82-40a4-bf2f-2c7732b85039 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:35.498568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59ee37cb-8b82-40a4-bf2f-2c7732b85039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:35.523748 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:35.612123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 564/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:35.903697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:35.905321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:36.027048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee36dc-6345-4f58-a2f5-65edb88c03a2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:36.053880 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:36.135527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:36.136147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:36.136415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:36.136680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:36.138457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:36.271860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:36.273724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7a778-c91b-4999-a4da-c9110e8bbc4a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:36.297108 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 565/1129] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:38.724727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:38.725576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:38.725576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:38.726845 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 565/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:05:38.733105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901b20-7044-424c-9638-d76d7e591dae None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:38.733749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901b20-7044-424c-9638-d76d7e591dae None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:38.733749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901b20-7044-424c-9638-d76d7e591dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:38.809394 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:38.812799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-80901b20-7044-424c-9638-d76d7e591dae None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:38.814906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80901b20-7044-424c-9638-d76d7e591dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:38.937463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 566/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:39.226139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:39.227828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:39.353602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca912e23-eed4-489c-9107-e1ff480cbaac None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:39.412868 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:39.440269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:39.440869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:39.441142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:39.441445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:39.443092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:39.579717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:39.581194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5742-7dc0-4ad8-a118-210eb4b7bd55 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:39.604988 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 566/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:05:42.041689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:42.042598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:42.042598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:42.043822 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 567/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:42.050977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aed4e-e8c1-44ca-9235-bc76cd5e13c4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:42.051915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aed4e-e8c1-44ca-9235-bc76cd5e13c4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:42.051915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aed4e-e8c1-44ca-9235-bc76cd5e13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:42.146835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-233aed4e-e8c1-44ca-9235-bc76cd5e13c4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:42.148326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-233aed4e-e8c1-44ca-9235-bc76cd5e13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:42.184923 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:42.276216 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 567/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:42.582063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:42.583699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:42.752337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208e8f4-f5c3-4f8e-8c25-eb3364fc2579 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:42.791208 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:42.848047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:42.848615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:42.848933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:42.849204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:42.850999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:42.985775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:42.987762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4cd6a-3654-4d7f-893c-fb0928f029d4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:43.009172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 568/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:45.409128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:45.409808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:45.409808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:45.411074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:45.417624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92d5c-68e5-4dcd-822a-abd4cb33bb25 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:45.418210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92d5c-68e5-4dcd-822a-abd4cb33bb25 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:45.418210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92d5c-68e5-4dcd-822a-abd4cb33bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:45.497636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a7a92d5c-68e5-4dcd-822a-abd4cb33bb25 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:45.513862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a7a92d5c-68e5-4dcd-822a-abd4cb33bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:45.513862 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:45.616478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:05:45.910019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:45.915144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:46.038164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1f718-6464-42d4-8c31-65187c706175 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:46.105798 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:46.131272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:46.131875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:46.132145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:46.132410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:46.134133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:46.264621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:46.266144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2d5c-6799-4a93-86f8-5cae183d9bd5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:46.288418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 569/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:48.608734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:48.609449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:48.609449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:48.610707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:05:48.616672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e499e-1cf2-4348-a372-eebbe723c5ea None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:48.617153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e499e-1cf2-4348-a372-eebbe723c5ea None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:48.617283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e499e-1cf2-4348-a372-eebbe723c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:48.693999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ea5e499e-1cf2-4348-a372-eebbe723c5ea None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:48.695216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ea5e499e-1cf2-4348-a372-eebbe723c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:48.735524 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:48.796464 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:49.090571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:49.092168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:49.231405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9861d-b5dc-415a-b3d4-0e018c84163e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:49.296008 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:49.342177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:49.342689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:49.342967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:49.343238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:49.345795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:49.493707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:49.495166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9e521-bc50-40ed-84b0-dfa5f3ac7bd9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:49.517982 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 571/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:51.867637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:51.868224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:51.868224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:51.869645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:51.875048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a495-9fac-4562-a514-52a90a6dae2e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:51.875530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a495-9fac-4562-a514-52a90a6dae2e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:51.876747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a495-9fac-4562-a514-52a90a6dae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:51.989410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5a45a495-9fac-4562-a514-52a90a6dae2e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:51.991402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5a45a495-9fac-4562-a514-52a90a6dae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:52.024459 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:52.108881 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:52.395742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:52.397348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:52.508428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9cb0-527c-4359-b858-db2436784d82 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:52.579781 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:52.586732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:52.587332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:52.587608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:52.587873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:52.589545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:52.707085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:52.714264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c580d49-d068-4f91-9383-acd798c47a98 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:52.727511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 572/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:05:54.940788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:54.941458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:54.941458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:54.942688 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:05:54.948204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6a1-9232-45bd-ab83-87d3d850205c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:54.948796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6a1-9232-45bd-ab83-87d3d850205c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:54.948796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6a1-9232-45bd-ab83-87d3d850205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:55.019730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-76a4f6a1-9232-45bd-ab83-87d3d850205c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:05:55.020956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-76a4f6a1-9232-45bd-ab83-87d3d850205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:55.071388 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:55.121509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:05:55.406138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:05:55.408206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:55.522317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e6c44-ce7b-4c56-ba51-2ec570ca1a68 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:05:55.580391 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:55.608425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:05:55.609043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:05:55.609324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:05:55.609681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:05:55.611285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:05:55.732132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:05:55.733588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e215d1-f084-4f10-a6da-f5b65c7e4bfa service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:05:55.751593 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 574/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:05.124224 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=22 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:05.749274 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=66 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:16.480015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b18e4-117e-4394-94dd-733601cf71a9 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:16.480602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b18e4-117e-4394-94dd-733601cf71a9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:16.480602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b18e4-117e-4394-94dd-733601cf71a9 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:16.481912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 574/1148] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:16.488103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6c3d-ad91-4fae-935f-5825c98c1f7d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:16.488521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6c3d-ad91-4fae-935f-5825c98c1f7d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:16.488658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba6c3d-ad91-4fae-935f-5825c98c1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:16.567655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1eba6c3d-ad91-4fae-935f-5825c98c1f7d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:16.568898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eba6c3d-ad91-4fae-935f-5825c98c1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:16.667903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 575/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:16.966669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:16.966953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:16.967295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:16.968622 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 575/1150] 10.222.0.13 () {54 vars in 962 bytes} [Sun Oct 30 01:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:16.974570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743af4-cf33-42e2-84af-37e512eadcd6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:16.974907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743af4-cf33-42e2-84af-37e512eadcd6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:16.975193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d743af4-cf33-42e2-84af-37e512eadcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:17.053080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2d743af4-cf33-42e2-84af-37e512eadcd6 None None] MFA Rules not processed for user `82ec9bbb37ef44fe8cf300e8f298498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:17.054598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d743af4-cf33-42e2-84af-37e512eadcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:17.076277 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:17.136606 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 576/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Sun Oct 30 01:06:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:17.144761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:17.146372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:17.250982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5479fd-016a-4d96-95b1-9c55bad62992 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:17.324101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:17.324590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:17.324867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:17.325136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:17.326762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:17.383360 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:17.439388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:17.440899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760baa-309d-4ad0-a45c-6939539f7747 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:17.459148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 576/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:06:19.762161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:19.762735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:19.763206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:19.766134 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 577/1153] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:19.773191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6841d-ac66-4d0b-82bd-094385212dd8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:19.773782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6841d-ac66-4d0b-82bd-094385212dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:19.774185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6841d-ac66-4d0b-82bd-094385212dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:19.848865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ded6841d-ac66-4d0b-82bd-094385212dd8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:19.849989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ded6841d-ac66-4d0b-82bd-094385212dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:19.963876 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 577/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:20.240610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:20.242297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:20.376718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6029-eca5-449e-9b73-fbe409ead4d9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:20.426426 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:20.470968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:20.471466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:20.471753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:20.472017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:20.472642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:20.473769 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:06:20.473769 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:06:20.473769 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:06:20.474901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e9ed-0349-46c4-bc46-f7ec3d4693a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:20.494427 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 578/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 30 01:06:20 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:06:22.668087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:22.668632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:22.668632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:22.670150 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 578/1156] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:22.676138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58d1d-7a62-491a-af9b-5554fdce5225 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:22.676535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58d1d-7a62-491a-af9b-5554fdce5225 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:22.676690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a58d1d-7a62-491a-af9b-5554fdce5225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:22.743804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-12a58d1d-7a62-491a-af9b-5554fdce5225 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:22.745125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12a58d1d-7a62-491a-af9b-5554fdce5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:22.843285 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 579/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:23.138187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:23.140430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:23.149788 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:23.285696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308180b-bd6a-4c34-9510-7e13341c8172 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:23.363381 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:23.395178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:23.395784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:23.396060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:23.396328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:23.398716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:23.488386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:23.490015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e3b7-c355-434b-9513-8f880bb5eba8 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:23.507877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 579/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:25.871118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937a7a-000c-4e79-b401-42393caad107 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:25.872024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937a7a-000c-4e79-b401-42393caad107 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:25.872310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62937a7a-000c-4e79-b401-42393caad107 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:25.873810 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 580/1159] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:25.879892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14235a-8c7a-4eb8-bbc2-21682ebb3757 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:25.880402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14235a-8c7a-4eb8-bbc2-21682ebb3757 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:25.880506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14235a-8c7a-4eb8-bbc2-21682ebb3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:25.947197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3c14235a-8c7a-4eb8-bbc2-21682ebb3757 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:25.948408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c14235a-8c7a-4eb8-bbc2-21682ebb3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:25.994296 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:26.045313 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 580/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:26.333507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937a7a-000c-4e79-b401-42393caad107 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:26.335124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62937a7a-000c-4e79-b401-42393caad107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:26.360775 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:26.439607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62937a7a-000c-4e79-b401-42393caad107 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:26.514462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:26.515067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:26.515342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:26.516303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:26.517961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:26.591623 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:26.627331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:26.628789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e240909-0666-404a-95e3-9d6937f0692f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:26.647611 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 581/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:28.900797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:28.901233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:28.901378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:28.902700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 581/1162] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:06:28.908469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf581-b248-4376-8448-8f0f8e22044a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:28.908888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf581-b248-4376-8448-8f0f8e22044a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:28.909022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf581-b248-4376-8448-8f0f8e22044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:28.975374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d44cf581-b248-4376-8448-8f0f8e22044a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:28.976566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d44cf581-b248-4376-8448-8f0f8e22044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:29.073027 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 582/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:29.363112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:29.364688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:29.469856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cb688-88b0-473d-91e4-0938ee3dcc3b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:29.543250 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:29.544811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:29.545561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:29.545830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:29.546098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:29.548285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:29.673417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:29.674863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287cd2-77a4-4ee6-8915-791257938dde service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:29.693436 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 582/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:32.012971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:32.013615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:32.013615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:32.014925 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 583/1165] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:32.021053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea39db-deff-416d-87b8-7c629294dbf1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:32.021738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea39db-deff-416d-87b8-7c629294dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:32.021738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea39db-deff-416d-87b8-7c629294dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:32.096794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04ea39db-deff-416d-87b8-7c629294dbf1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:32.098046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04ea39db-deff-416d-87b8-7c629294dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:32.154819 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:32.207495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 583/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:32.505798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:32.507569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:32.547789 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:32.621722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608de0e1-c951-4e80-9b36-b183f4b02fa2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:32.703697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:32.704307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:32.704581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:32.704874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:32.706593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:32.807007 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:32.845145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:32.847351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0297-f1a4-40e3-b9b0-8d772b1225e7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:32.867338 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 584/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:35.458669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:35.459654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:35.459654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:35.460615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 584/1168] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 30 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:06:35.466845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65a15-a3e4-460e-b32d-6dbecb426a7c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:35.467504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65a15-a3e4-460e-b32d-6dbecb426a7c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:35.467504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65a15-a3e4-460e-b32d-6dbecb426a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:35.555039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-94f65a15-a3e4-460e-b32d-6dbecb426a7c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:06:35.556269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94f65a15-a3e4-460e-b32d-6dbecb426a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:35.670120 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 585/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 30 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:06:35.960493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:06:35.962110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:36.086052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f872ea-8a59-4a7e-95d6-47cbecb4f505 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:06:36.165481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:06:36.166091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:06:36.166378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:06:36.166646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:06:36.168331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:06:36.177747 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:36.285889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:06:36.287236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a467e-1376-4d6f-8546-1a5da4770ec5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:06:36.306615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 585/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:06:45.668515 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:46.304038 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=50 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:59.701777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:07:59.702403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:07:59.702403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:07:59.780706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:07:59.781924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:07:59.877971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 586/1171] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:07:59.885921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:07:59.886425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:07:59.886523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:07:59.962468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:07:59.963556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:00.062014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 586/1172] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:08:00.066705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.067943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:00.079322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0732fc-132e-469b-8b66-151de95ada1e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:00.141543 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:00.176098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:00.176857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:00.177134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:00.177697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:00.178349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:08:00.178647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:00.179666 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:08:00.179666 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:08:00.179666 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:08:00.180562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:00.192565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 587/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:08:00.202378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.211812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88839-0705-45bc-9e7a-0b877c75ce5e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:00.276017 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:00.311216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:00.311823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:00.312123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:00.312374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:00.313028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:00.314094 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:08:00.314094 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:08:00.314094 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:08:00.315307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:00.416843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 587/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:08:00 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:08:00.421206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.422759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:00.455312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42bb75-d5a0-453f-a5d6-befe6e28ebc5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:00.547550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:00.548056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:00.548331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:00.548595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:00.549202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:00.550270 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:08:00.550270 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:08:00.550270 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:08:00.551455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:00.651295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 588/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:08:00 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:08:00.655533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.657083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:00.719558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d8494-d992-473c-9ebd-91b93bb32345 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:00.804336 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:00.814427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:00.815150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:00.815275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:00.815533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:00.816677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:00.818290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:00.831872 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 588/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:08:00.835690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.837224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:00.848947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b4558-ecf9-4700-890e-4f2754fa078c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:00.873743 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:00.947654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:00.948250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:00.948521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:00.948784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:00.949454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:00.951087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e349b5-1fae-4c2c-b6eb-ea9604c42fc4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:00.964015 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 589/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:08:00.968410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:00.969975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:01.004791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3ce13-52dc-428d-ba14-290410cc81f6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:01.097305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:01.097892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.098162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.098422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] PATH_INFO: `/v3/projects/a8e1e7f94e9f4672ba3adb8b24eb20e9/users/4b511b7312284355830ca52c45a016c4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.120661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e1e7f94e9f4672ba3adb8b24eb20e9, user_id=4b511b7312284355830ca52c45a016c4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:01.123330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c5b82-0644-4a8c-b711-efcfec266288 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:01.195513 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 589/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:08:00 2022] PUT /identity/v3/projects/a8e1e7f94e9f4672ba3adb8b24eb20e9/users/4b511b7312284355830ca52c45a016c4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:08:01.206874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882bc-48a7-4d47-a1c4-aed110184f70 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.207171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882bc-48a7-4d47-a1c4-aed110184f70 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.207460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b882bc-48a7-4d47-a1c4-aed110184f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.268306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e1b882bc-48a7-4d47-a1c4-aed110184f70 None None] MFA Rules not processed for user `4b511b7312284355830ca52c45a016c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:08:01.269555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1b882bc-48a7-4d47-a1c4-aed110184f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:01.349954 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 590/1179] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:08:01.365911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.366192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.366474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.367780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 590/1180] 10.222.0.13 () {54 vars in 963 bytes} [Sun Oct 30 01:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:08:01.373721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ae0f-388c-4425-aad9-2c4a9bc07cca None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.374230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ae0f-388c-4425-aad9-2c4a9bc07cca None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.374510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ae0f-388c-4425-aad9-2c4a9bc07cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.410999 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:01.460203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d095ae0f-388c-4425-aad9-2c4a9bc07cca None None] MFA Rules not processed for user `135b054aaaae4c84b280fe4e9908e240`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:08:01.461471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d095ae0f-388c-4425-aad9-2c4a9bc07cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:01.542178 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 591/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 30 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:08:01.550537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:01.552092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:01.604759 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:01.660462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcd76e-75f9-4f3d-b911-ef109b6bf4b7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:01.736816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:01.737534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.737818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.738575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.740225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:01.839907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:01.841375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:01.845536 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:01.860535 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 591/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:08:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:08:01.907540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379c9a-55ea-4fa0-ad26-bf5e8763e9c2 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:01.907997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379c9a-55ea-4fa0-ad26-bf5e8763e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:01.908113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f379c9a-55ea-4fa0-ad26-bf5e8763e9c2 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:01.909928 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 592/1183] 10.222.0.13 () {52 vars in 830 bytes} [Sun Oct 30 01:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:08:01.913650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:01.918851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:02.015449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f883bca-749c-4701-bffa-26182e9034eb service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:02.108837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:02.109485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:02.109760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:02.110025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] PATH_INFO: `/v3/users/4b511b7312284355830ca52c45a016c4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:02.123070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b511b7312284355830ca52c45a016c4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:02.124009 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:08:02.124009 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:08:02.124009 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:08:02.125222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:02.135482 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:02.337010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b511b7312284355830ca52c45a016c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:02.472294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b511b7312284355830ca52c45a016c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:02.472711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b511b7312284355830ca52c45a016c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:02.497647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b511b7312284355830ca52c45a016c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:02.512214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b511b7312284355830ca52c45a016c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:02.518259 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 592/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:08:01 2022] DELETE /identity/v3/users/4b511b7312284355830ca52c45a016c4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:08:02.522690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:02.522978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:02.523260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:02.584935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:08:02.586189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:02.664988 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:02.679275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 593/1185] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:08:02.689462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:02.691272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:02.794307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa162e3-7dc9-41d3-b728-fabc9f1e0f9f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:02.850679 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:02.870064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:02.870669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:02.870944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:02.871212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:02.872822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:02.981803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:02.983161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5bc9e-1753-4c71-9ab8-fe1583061d6f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:03.002480 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 593/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:08:03.473818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:08:03.475044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:08:03.486961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d654-3e7c-4b0b-8bf4-92491a9adaa0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:08:03.586760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:08:03.587396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:08:03.587670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:08:03.587940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] PATH_INFO: `/v3/projects/a8e1e7f94e9f4672ba3adb8b24eb20e9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:08:03.598779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e1e7f94e9f4672ba3adb8b24eb20e9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:08:03.599786 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:08:03.599786 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:08:03.599786 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:08:03.600990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:08:03.748483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e1e7f94e9f4672ba3adb8b24eb20e9', 'request_id': 'req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:03.756370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e1e7f94e9f4672ba3adb8b24eb20e9', 'request_id': 'req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:03.843643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e1e7f94e9f4672ba3adb8b24eb20e9', 'request_id': 'req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:03.876785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] The token cache is being invalidate because project a8e1e7f94e9f4672ba3adb8b24eb20e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:08:03.877071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:03.877633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1b9bc34b-3d71-4e90-a29d-587a54ecbddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:08:03.879749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 594/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:08:03 2022] DELETE /identity/v3/projects/a8e1e7f94e9f4672ba3adb8b24eb20e9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:08:13.049384 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=62 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:13.874298 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:18.210002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e39-3fb0-4617-8ac2-ba80c0178c53 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:18.210610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e39-3fb0-4617-8ac2-ba80c0178c53 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:18.210610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868e39-3fb0-4617-8ac2-ba80c0178c53 None None] PATH_INFO: `/v3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:18.211819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 594/1188] 10.222.0.46 () {54 vars in 925 bytes} [Sun Oct 30 01:11:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:11:18.218182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1398-905d-42a2-a5a7-efed6371d091 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:18.218635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1398-905d-42a2-a5a7-efed6371d091 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:18.218882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1398-905d-42a2-a5a7-efed6371d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:18.298864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0adb1398-905d-42a2-a5a7-efed6371d091 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:18.300069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0adb1398-905d-42a2-a5a7-efed6371d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:18.413170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 595/1189] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 30 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:23.362859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cabff-7f57-400b-bd22-612960b92c34 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:23.363460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cabff-7f57-400b-bd22-612960b92c34 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:23.363460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cabff-7f57-400b-bd22-612960b92c34 None None] PATH_INFO: `/v3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:23.364592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 595/1190] 10.222.0.50 () {54 vars in 925 bytes} [Sun Oct 30 01:11:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:11:23.370568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df741-d0a1-438b-b33f-89eb4c739c63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:23.371268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df741-d0a1-438b-b33f-89eb4c739c63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:23.371483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673df741-d0a1-438b-b33f-89eb4c739c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:23.391747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-673df741-d0a1-438b-b33f-89eb4c739c63 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:23.392968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-673df741-d0a1-438b-b33f-89eb4c739c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:23.401543 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 596/1191] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Oct 30 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:27.037213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91ad5-ba40-4f09-9a58-9e4a19ac4b2d None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:27.037772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91ad5-ba40-4f09-9a58-9e4a19ac4b2d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:27.037772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa91ad5-ba40-4f09-9a58-9e4a19ac4b2d None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:27.039132 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 596/1192] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:11:27.044943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:27.045467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:27.045571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:27.068328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:27.069571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:27.078316 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 597/1193] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:27.086149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa91ad5-ba40-4f09-9a58-9e4a19ac4b2d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:27.100982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa91ad5-ba40-4f09-9a58-9e4a19ac4b2d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:27.105904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:27.106513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:27.107280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:27.107545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:27.116233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:27.117880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4493f-dbc4-475e-a99a-38aeb0b28bf0 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:27.128630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 597/1194] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:11:32.388461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:32.399026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ee7e1-2efc-4336-ab5d-e5a4fa7ab489 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:32.404827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:32.405457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:32.405738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:32.406009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:32.414293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:32.415864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d24c4c-3b3e-4340-b72c-8f1611adbd21 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:32.425611 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 598/1195] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:11:37.124516 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:42.421602 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:45.701515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:45.702164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:45.702164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:45.703387 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 598/1196] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:11:45.709619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80394a-2830-40ff-8dbf-5728fb7ea20a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:45.710107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80394a-2830-40ff-8dbf-5728fb7ea20a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:45.710256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c80394a-2830-40ff-8dbf-5728fb7ea20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:45.773744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6c80394a-2830-40ff-8dbf-5728fb7ea20a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:45.775052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6c80394a-2830-40ff-8dbf-5728fb7ea20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:45.857853 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 599/1197] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:46.024542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:46.027067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:46.134932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedd6d1-db02-4190-9c8b-78a5678f20d6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:46.140605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233febc8-0bb9-4177-9940-871150257746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:46.141208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233febc8-0bb9-4177-9940-871150257746 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:46.141528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233febc8-0bb9-4177-9940-871150257746 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:46.141801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233febc8-0bb9-4177-9940-871150257746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:46.150360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233febc8-0bb9-4177-9940-871150257746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:46.151943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233febc8-0bb9-4177-9940-871150257746 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:46.162382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 599/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:11:47.297979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789465-3c34-49d8-b071-fcdc276cff1b None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:47.298565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789465-3c34-49d8-b071-fcdc276cff1b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:47.298565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f789465-3c34-49d8-b071-fcdc276cff1b None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:47.300054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 600/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 30 01:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:11:47.308661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8f1-55b5-44bd-a347-5ef0d4603ad7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:47.308661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8f1-55b5-44bd-a347-5ef0d4603ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:47.308661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6f8f1-55b5-44bd-a347-5ef0d4603ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:47.338622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3cd6f8f1-55b5-44bd-a347-5ef0d4603ad7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:47.340777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cd6f8f1-55b5-44bd-a347-5ef0d4603ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:47.356119 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 600/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 30 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:47.510353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789465-3c34-49d8-b071-fcdc276cff1b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:47.525742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f789465-3c34-49d8-b071-fcdc276cff1b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:47.532048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:47.532677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:47.532959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:47.533225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:47.542881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:47.544833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ada44-0251-44d5-bb96-a4e342c6c10f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:47.556248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 601/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:11:51.592686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:51.593267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:51.593267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:51.594602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 601/1202] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:11:51.599796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f0a0-3619-4985-bd7c-f07c9f70ef82 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:51.600256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f0a0-3619-4985-bd7c-f07c9f70ef82 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:51.600357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f0a0-3619-4985-bd7c-f07c9f70ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:51.621742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd83f0a0-3619-4985-bd7c-f07c9f70ef82 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:51.622933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd83f0a0-3619-4985-bd7c-f07c9f70ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:51.630692 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 602/1203] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:51.920470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:51.922174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:52.004122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96640339-00b8-4b4a-b1e7-d11c6ee75f82 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:52.007798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:52.008398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:52.008675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:52.008947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:52.019232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:52.020726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d624fe-4130-4afb-8ad8-f4e410caf953 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:52.030900 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 602/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:11:54.212686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb49b-2686-4fc1-9c83-1d1f4717cf88 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:54.213271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb49b-2686-4fc1-9c83-1d1f4717cf88 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:54.213271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfb49b-2686-4fc1-9c83-1d1f4717cf88 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:54.214647 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 603/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 30 01:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:11:54.220944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f4e6-b2b8-42a7-a417-f69089cd4892 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:54.221467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f4e6-b2b8-42a7-a417-f69089cd4892 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:54.221581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f4e6-b2b8-42a7-a417-f69089cd4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:54.241323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6537f4e6-b2b8-42a7-a417-f69089cd4892 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:11:54.242585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6537f4e6-b2b8-42a7-a417-f69089cd4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:11:54.250674 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 603/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 30 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:11:54.545053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb49b-2686-4fc1-9c83-1d1f4717cf88 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:11:54.556634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfb49b-2686-4fc1-9c83-1d1f4717cf88 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:11:54.560775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:11:54.561407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:11:54.561683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:11:54.561950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:11:54.571666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:11:54.573100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c76a0f-019f-4a27-aeb8-fd8b1588829f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:11:54.584082 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 604/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:12:04.236187 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:04.579578 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=65 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:12:46.336400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f26-1fbe-47f7-8912-19e9a4892e46 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:12:46.336975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f26-1fbe-47f7-8912-19e9a4892e46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:12:46.336975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070f26-1fbe-47f7-8912-19e9a4892e46 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:12:46.338583 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 604/1208] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:12:46.344099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad563e-4cff-45b0-a256-27374ad2eed7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:12:46.344553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad563e-4cff-45b0-a256-27374ad2eed7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:12:46.344657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad563e-4cff-45b0-a256-27374ad2eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:12:46.365081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-93ad563e-4cff-45b0-a256-27374ad2eed7 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:12:46.366304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-93ad563e-4cff-45b0-a256-27374ad2eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:12:46.375031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 605/1209] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:12:56.359446 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:19.854118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48216b-189a-46b4-8940-0c0e7e579f66 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:19.867075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48216b-189a-46b4-8940-0c0e7e579f66 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:19.867075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48216b-189a-46b4-8940-0c0e7e579f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:19.907603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e48216b-189a-46b4-8940-0c0e7e579f66 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:19.907603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e48216b-189a-46b4-8940-0c0e7e579f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:19.920308 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 605/1210] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:19.933186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:19.934256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:19.934811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:19.973598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:19.974973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:19.987919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf85f-5625-4341-83a1-4b387d3e88de None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:19.988264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf85f-5625-4341-83a1-4b387d3e88de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:19.988491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cf85f-5625-4341-83a1-4b387d3e88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.006030 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 606/1211] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.011175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.025813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acca777-6499-4eeb-845a-fc4f564721f8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.034955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1d5cf85f-5625-4341-83a1-4b387d3e88de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.036193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d5cf85f-5625-4341-83a1-4b387d3e88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.041681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.042301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.042578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.042848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.043496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:20.043800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.052217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.064951 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 606/1212] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:13:20.073692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90b9-a98a-411d-a84a-c8084239e1bc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.074012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90b9-a98a-411d-a84a-c8084239e1bc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.074508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae90b9-a98a-411d-a84a-c8084239e1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.087814 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 607/1213] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:13:20.096227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.124155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9a071-5822-495f-bc32-7033bcbaa58a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.127115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-10ae90b9-a98a-411d-a84a-c8084239e1bc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.128348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10ae90b9-a98a-411d-a84a-c8084239e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.147419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.148061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.148346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.148625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.149274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.150331 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:13:20.150331 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:13:20.150331 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:13:20.151558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef4687-9e39-41c6-9df3-446d44f12d60 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.161453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 607/1214] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:13:20.167368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.167368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.167902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.259987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.261396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.286650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 608/1215] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.287908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.316132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1d90-3cf9-4c0c-9e21-ab979247c0db None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.323259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.323886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.324172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.324454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.327395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:20.327711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.328753 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:13:20.328753 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:13:20.328753 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:13:20.331328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697bbfe-79ee-4fa8-8134-548164fb61e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.360191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 609/1216] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:20.361514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.364073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.365644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.382903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 608/1217] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:13:20.385237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ddd6-2ad5-427d-ba76-cd818db2d15d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.388401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ddd6-2ad5-427d-ba76-cd818db2d15d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.388780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ddd6-2ad5-427d-ba76-cd818db2d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.440670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.447943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.453797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4325ddd6-2ad5-427d-ba76-cd818db2d15d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.455508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4325ddd6-2ad5-427d-ba76-cd818db2d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.561524 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 609/1218] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.573366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.575775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.576249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.605373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.605373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.606793 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 610/1219] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.607908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.612692 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 610/1220] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.613531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.621327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a437ae-a8dd-4817-8909-cbd57c17143c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.624421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb232780-a572-429a-b157-be857bb9e2a5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.626377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.628016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.628360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.628703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.629481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.629911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.630512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.630792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.631063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.631695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.631797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673adde-27a1-40c7-9e74-509738a9cdd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.633623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3563a5-3cf3-4347-94ca-2e38f112d6c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.766527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 611/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:20.768306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5775f-ad2f-4117-9131-c48185c0ab82 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.768592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5775f-ad2f-4117-9131-c48185c0ab82 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.768863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5775f-ad2f-4117-9131-c48185c0ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.787904 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 611/1222] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/projects => generated 393 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:20.793322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b4c5775f-ad2f-4117-9131-c48185c0ab82 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.793322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b4c5775f-ad2f-4117-9131-c48185c0ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.793550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a248e3-e612-4801-a9c5-07f176f0fd44 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.793550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a248e3-e612-4801-a9c5-07f176f0fd44 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.793550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a248e3-e612-4801-a9c5-07f176f0fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.810979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-68a248e3-e612-4801-a9c5-07f176f0fd44 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.812230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68a248e3-e612-4801-a9c5-07f176f0fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.849852 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 612/1223] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.851179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d1f5-c8d7-45c1-96c3-efb6f5a8352d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.851468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d1f5-c8d7-45c1-96c3-efb6f5a8352d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.851743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d1f5-c8d7-45c1-96c3-efb6f5a8352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.871552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7e03d1f5-c8d7-45c1-96c3-efb6f5a8352d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.872757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e03d1f5-c8d7-45c1-96c3-efb6f5a8352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.880977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 612/1224] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.884012 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 613/1225] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.885173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47769b22-234b-4719-884c-0300aa020528 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.885524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47769b22-234b-4719-884c-0300aa020528 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.885801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47769b22-234b-4719-884c-0300aa020528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.891775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.894058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.894500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.905640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-47769b22-234b-4719-884c-0300aa020528 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.906931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-47769b22-234b-4719-884c-0300aa020528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.913966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.915077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 614/1226] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.915181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.915857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47769b22-234b-4719-884c-0300aa020528 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.925879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47769b22-234b-4719-884c-0300aa020528 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.926684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 613/1227] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.927463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.934496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.935191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.935377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.935651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.936293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:20.936596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.937021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e4d9-4f59-43de-b992-a9dc0911f21f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.938245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.942848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.943434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.943840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.944115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.944750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.946855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001516d-5f0a-4d90-9b0f-d0f0c4dd91e0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.947791 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:20.951155 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 615/1228] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:20.952501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:20.957814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 614/1229] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:20.974451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994317-3501-46ac-92e1-79dae3affb03 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.974451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994317-3501-46ac-92e1-79dae3affb03 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.974451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994317-3501-46ac-92e1-79dae3affb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.974724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddceff-07a3-4ea6-a56e-c2323a93eb4e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:20.974724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:20.974724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.974724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.975046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:20.975046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:20.975046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:20.979350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b2994317-3501-46ac-92e1-79dae3affb03 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:20.980512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b2994317-3501-46ac-92e1-79dae3affb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:20.989141 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 615/1230] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:20.990339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dff5eb-ec16-4e5b-a68f-f45ec1f4f94e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:20.990611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dff5eb-ec16-4e5b-a68f-f45ec1f4f94e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:20.990908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dff5eb-ec16-4e5b-a68f-f45ec1f4f94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.010341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-12dff5eb-ec16-4e5b-a68f-f45ec1f4f94e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:21.011446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12dff5eb-ec16-4e5b-a68f-f45ec1f4f94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:21.019238 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 616/1231] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:21.020381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.027178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.027178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.040965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:21.042203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:21.050625 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 617/1232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:21.058713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.059435 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.063170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f571a-79b2-43e1-b76c-673386d74dde None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.068589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.069190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.069526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.069794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.070436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:21.070733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.072348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.084424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 618/1234] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:21.084751 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 616/1234] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:20 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.085208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.085623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.097401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665395e2-4593-4f0a-8887-73746702788c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.097595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3f2b2-9d5a-4dbe-add9-a4811501144d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.102019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.102375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.102606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.102882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.102989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.103154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.103260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.103502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.103786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.104162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:21.104466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.106102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.106370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.120168 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 619/1235] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:21.121002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.131433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6cd54-7457-469c-8b00-a2e524f4ea73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.136308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.136905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.137184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.137496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.138161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.139735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.150084 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 620/1236] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:21.150982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.160712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495a4a-4275-4af7-b159-9f11f3beec4b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.165482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.166067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.166976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.166976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.167267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:21.167568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.169144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.182396 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 621/1237] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:21.183220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.193599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8b7f4-07c9-4171-915a-0bd9b6477535 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.198280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.198974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.199261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.199532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.200172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:21.200471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.202098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.213741 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 622/1238] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:21.215270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.224907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96403358-6d26-4374-870a-aa4a84b6306d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.229640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.230211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.230492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.230763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.231399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:21.231702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.233384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.246299 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 623/1239] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:21.247113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.253387 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 617/1240] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.253387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.258977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5521a-cbd5-4fcd-b917-a356ba69b18a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.317716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa92424-c39f-4c5f-b748-a27e748354fa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.317922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.318830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.319118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.319383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.320024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.321653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.322552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.323344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.323626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.323894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.324524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.326656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.334608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 624/1241] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:21.334608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.342037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd895f4-3541-4919-8420-ecf941e7af84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.347206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.347813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.348087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.348354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.348981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.350907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.465206 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 618/1242] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.466197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.499110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 625/1243] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.499995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.527643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1130012-8257-4ae8-ae24-f06daeb065ae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.563864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75351a95-f19d-44ca-8f13-0f155e0832f4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.568880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.569444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.569720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.569989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.570630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.572526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.575885 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.577378 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:21.585745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.586414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.592336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.592336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] PATH_INFO: `/v3/projects/e76c392d55c145faa0ffe95da38e1db0/users/4c87a460c2c147e9953a07fc69b458b2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.602129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76c392d55c145faa0ffe95da38e1db0, user_id=4c87a460c2c147e9953a07fc69b458b2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.604824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.699036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 626/1244] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.699996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.721630 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 619/1245] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:21 2022] PUT /identity/v3/projects/e76c392d55c145faa0ffe95da38e1db0/users/4c87a460c2c147e9953a07fc69b458b2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:21.723868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.763534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cf6e-c75d-4ea3-8063-d227aa031a4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.786639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f2aca-7ddf-41c7-bf6f-7cf9de58d372 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.792060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.792662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.792976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.793248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.793907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.795822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.823328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.823848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.824123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.824389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.825019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.826985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.906418 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 620/1246] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.907363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:21.919880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8cc8-f54b-42df-89d8-e78cae175d9a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:21.924569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:21.925161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:21.925483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:21.925762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:21.926390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:21.928308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:21.947782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 627/1247] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:21.948633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.010728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3431f-a117-475d-a4c3-946390e74a64 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.015305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.015885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.016200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.016469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.017101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.019389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.029288 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 628/1248] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.030081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.036066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 621/1249] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:21 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.036860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.040858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ef283-ef9c-4d82-a2c5-b66586535e6f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.050207 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.098977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.099536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.099814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.100113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.100451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f99a1-99b4-49ac-a638-1a90822c68e1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.100742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.101924 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:13:22.101924 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:13:22.101924 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:13:22.103154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.105599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.106209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.109142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.109142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.109142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.109441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086f0bb-9978-44cf-9a6b-187d1f41f804 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.212650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 629/1250] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.213680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.223673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0472a58-a975-4494-89a5-c6f4898682c3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.228521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.229098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.229409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.229681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.230304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.232227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.243744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 622/1251] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.243744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.243744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.243744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.270997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] MFA Rules not processed for user `4c87a460c2c147e9953a07fc69b458b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:22.272196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:22.291486 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.336451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 623/1252] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:22.337365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.347831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a759466-2b91-46a2-b183-fe9e2b0b7189 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.352760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 630/1253] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.352760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.354775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.355542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.355827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.356098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.356747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.358395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.360757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200486-7592-4084-9c53-3b7f7e88e8c5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.366037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.366628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.366903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.367264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.367884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.369150 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 624/1254] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.369825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.370026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.381264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042b34-dbb2-49fb-aff7-aba299a19aad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.386646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.387290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.387570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.387843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49/users/d69604c3494f489b8d86c6dfa932b108/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.403733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a171f2755be64d048fc4b422798ebc49, user_id=d69604c3494f489b8d86c6dfa932b108, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.406434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.478564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 631/1255] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.479504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.489547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb5943-08cb-4825-b835-f15fe526ed22 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.494143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.494724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.495000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.495272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.495910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.497833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.503929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 625/1256] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:22 2022] PUT /identity/v3/projects/a171f2755be64d048fc4b422798ebc49/users/d69604c3494f489b8d86c6dfa932b108/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:22.504889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.574970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f95b9a-49eb-4ea1-bfe3-712498f77187 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.584377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.585030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.585310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.585609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.586246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.587862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.599196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 632/1257] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.599422 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 626/1258] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.601633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.603148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.610544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2891bb-1735-4090-a1bd-e25150af65af admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.612768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d913f-e151-4325-8550-7242790abd55 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.615121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.615719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.615984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.616250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.616868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.617380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.617969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.618247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.618522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.618793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1769ad-8cba-4de5-8939-e7815b2750ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.619194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.620773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.633721 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 633/1259] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.633721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.641026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487fd3e-1168-4098-8d06-cd5c1b95ee0a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.646684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.647452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.647576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.647847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.648474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.650084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.662209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 634/1260] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.662997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.672377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cc7c1-4418-4931-b984-503d859a2593 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.677026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.677611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.677886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.678154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.678799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.680380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.690339 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 635/1261] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.691092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.700279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5490792-b670-4869-b59f-bf06ccc09073 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.707689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 627/1262] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.707689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.707689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.707689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.708088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.708088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.708088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.708088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.708438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.708920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.723241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 636/1263] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.723241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.731202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ccdfc-ee69-469e-9ad4-d3da3b5b34c1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.735073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] MFA Rules not processed for user `d69604c3494f489b8d86c6dfa932b108`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:22.736414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:22.786418 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.790468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.793265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.793265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.793265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.793265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.793979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.804063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 637/1264] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.805076 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 628/1265] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:22.805193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.809284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.810805 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.816889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be011b8-0df8-4575-b43b-0970c683d632 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.821590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.821753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee870-a135-4e3d-9b25-59750ec6cad6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.822216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.822496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.822909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.823550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.825158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.826486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.827148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.827472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.827731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.828488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.830265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.836772 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 638/1266] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.839143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.843175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 629/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.844272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.850114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97b91-7b27-4e46-9537-b06ceac01597 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.854024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b545c-dc29-4945-a6bb-bf183e8cfafc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.854922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.855522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.855808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.856085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.856784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.858400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.858795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.859428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.859711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.859987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] PATH_INFO: `/v3/projects/b499ae6acbf14266a54f5bb8c30e6acc/users/98f82f409f404c2c93ea52f4625b64c3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.868867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 639/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:22.872541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.876261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b499ae6acbf14266a54f5bb8c30e6acc, user_id=98f82f409f404c2c93ea52f4625b64c3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.879732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.881159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091804-d7d3-4bf4-bc5a-a2025703766a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:22.885854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:22.886446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:22.887054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:22.887325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:22.887951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:22.889894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:22.972652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 630/1269] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:22 2022] PUT /identity/v3/projects/b499ae6acbf14266a54f5bb8c30e6acc/users/98f82f409f404c2c93ea52f4625b64c3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:22.973553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.982716 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 640/1270] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:22 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:22.991890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:22.993736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cccac-f3a8-4f6a-9463-2044ccd578ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.041210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6150-c595-4304-89e9-7b0d337619ed admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.046094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.046828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.047134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.047392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.048037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.049721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.052915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.053595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.053861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.054125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.054761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.056578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.065093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 631/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:23.065093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.070587 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 641/1272] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:23.070587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.075494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c603-67d6-4325-9b03-25e6e4f47d6c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.077707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710744b-56f4-427f-96b0-dbc89261f0b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.080309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.081423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.081704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.081981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.082601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.082818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.083447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.083723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.083993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] PATH_INFO: `/v3/projects/3441b0a2de064974ba07e5e0cdda427f/users/328a2b1b782746bb9af94d706c97ffc7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.084479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.099487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3441b0a2de064974ba07e5e0cdda427f, user_id=328a2b1b782746bb9af94d706c97ffc7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.102332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.182579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 632/1273] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/projects => generated 395 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:23.183676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.191772 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 642/1274] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/3441b0a2de064974ba07e5e0cdda427f/users/328a2b1b782746bb9af94d706c97ffc7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:23.192559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.247842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a24d-176c-4a54-aa04-4fc6c049fcb8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.264820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7339b2-747d-4e3c-add1-49ec19a95a2c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.270054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.270707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.271061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.271280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] PATH_INFO: `/v3/projects/1b971a28beb54d189c4ccbcddfd73925/users/333395380d0348138321e634cc1ce438/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.281729 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:23.285877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b971a28beb54d189c4ccbcddfd73925, user_id=333395380d0348138321e634cc1ce438, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.288524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f62ff-f8a4-4cbd-acc7-de0a389e105f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.304569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.305226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.305534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.305807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] PATH_INFO: `/v3/projects/d56d4c23abde4891af030ac51a7e56ce/users/699c4aa15ab745e881adca16afcf3bcf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.321681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56d4c23abde4891af030ac51a7e56ce, user_id=699c4aa15ab745e881adca16afcf3bcf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.324322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.403999 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 643/1275] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/1b971a28beb54d189c4ccbcddfd73925/users/333395380d0348138321e634cc1ce438/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:23.405515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.405802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.406075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.425198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 633/1276] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/d56d4c23abde4891af030ac51a7e56ce/users/699c4aa15ab745e881adca16afcf3bcf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:23.426115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.437325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] MFA Rules not processed for user `98f82f409f404c2c93ea52f4625b64c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:23.438595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:23.444599 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:23.494907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31f52d-3b11-4c86-8afd-8453c71edef2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.499947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.500636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.500995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.501352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.502638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.504345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.505908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 644/1277] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:23.506828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.515434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 634/1278] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:23.518325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.518451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be580452-b7f5-46ef-a129-cad51fbcd463 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.522469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.523148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.523429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.523706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] PATH_INFO: `/v3/projects/ce6543b666064cd78c02ec5a471d003f/users/ae9211a459e946c1a114983c531a8897/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.526118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d19d-8edb-43e5-b9f6-25b4440ac2cf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.530749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.531395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.531678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.531956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] PATH_INFO: `/v3/projects/7125ddd978584c4b8f1b196e6cc62e94/users/3d46ad002b4d4e7b82c455ee8d2cd2ab/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.539544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6543b666064cd78c02ec5a471d003f, user_id=ae9211a459e946c1a114983c531a8897, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.542252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.547484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7125ddd978584c4b8f1b196e6cc62e94, user_id=3d46ad002b4d4e7b82c455ee8d2cd2ab, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.550808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483f21-2cdd-452e-aba7-cfc8da7f31e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.604152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 645/1279] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/ce6543b666064cd78c02ec5a471d003f/users/ae9211a459e946c1a114983c531a8897/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:23.604963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.661413 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 635/1280] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/7125ddd978584c4b8f1b196e6cc62e94/users/3d46ad002b4d4e7b82c455ee8d2cd2ab/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:23.662769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f21a-da75-4ac7-9f24-feb73ff37c76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.663052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f21a-da75-4ac7-9f24-feb73ff37c76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.663326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f21a-da75-4ac7-9f24-feb73ff37c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.668462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b9033-3ca5-42ec-839d-8f6556ba32b6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.692779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bc21f21a-da75-4ac7-9f24-feb73ff37c76 None None] MFA Rules not processed for user `328a2b1b782746bb9af94d706c97ffc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:23.693925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc21f21a-da75-4ac7-9f24-feb73ff37c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:23.726088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.726692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.726968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.727234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.727852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.729798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ded08-2d54-4f40-a630-e7bfa93b2ab6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.762832 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 636/1281] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:23.764148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.764433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.764827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.792500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] MFA Rules not processed for user `333395380d0348138321e634cc1ce438`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:23.793738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:23.803362 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:23.852726 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 646/1282] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/users => generated 304 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:23.854317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.854929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.855235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.857916 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 637/1283] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:23.861205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.870253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9cb50-94aa-402a-9180-db426ec6dad9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.875090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:23.875902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.876247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.876568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.877262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:23.880527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d23f1e-0671-45d4-ba85-4189f2e753e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:23.887172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] MFA Rules not processed for user `699c4aa15ab745e881adca16afcf3bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:23.890217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:23.898280 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:23.953754 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 647/1284] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:23.954468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:23.966014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe494aa-6dcc-43d5-ad89-05394962fb67 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:23.967923 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 638/1285] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:23.969051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceede61-b632-4734-a632-690340ac1496 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:23.969345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceede61-b632-4734-a632-690340ac1496 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:23.969629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceede61-b632-4734-a632-690340ac1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:23.998659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aceede61-b632-4734-a632-690340ac1496 None None] MFA Rules not processed for user `ae9211a459e946c1a114983c531a8897`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:23.999785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aceede61-b632-4734-a632-690340ac1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:24.024139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.024797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.025073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.025355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] PATH_INFO: `/v3/projects/5149999249d74f9894cff131b506aaf5/users/1395329d1b9e4d2f81d5e030bc76ed49/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.040292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5149999249d74f9894cff131b506aaf5, user_id=1395329d1b9e4d2f81d5e030bc76ed49, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.043048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.065869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 639/1286] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:24.067154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.067428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.067699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.094856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] MFA Rules not processed for user `3d46ad002b4d4e7b82c455ee8d2cd2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:24.096636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:24.110194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 648/1287] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:23 2022] PUT /identity/v3/projects/5149999249d74f9894cff131b506aaf5/users/1395329d1b9e4d2f81d5e030bc76ed49/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:24.111025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.164894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 640/1288] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:24.165764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.175092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f33c4-7c18-42b0-9cd2-9586826e1b0c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.175700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f0374-f7c3-4c1a-8399-537d2df0e761 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.179669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.180084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.180273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.180550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.180662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.180821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.180928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.181547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.181770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.182356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.183633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.183934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.186052 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:24.195674 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 641/1289] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:24.195674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.204705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76e13e-c7b1-4d0f-9d72-10fee50f68d8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.209662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.210236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.210515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.210784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.211400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.213302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.274134 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 649/1290] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.275086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.294907 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:24.296871 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 642/1291] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.297603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.342265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c187b-3756-479b-8825-3b12b1062def admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.362680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09a7e4-7efd-492f-95a6-87016d333775 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.367589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.368192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.368530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.368803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.369459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.378769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.402134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.408213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.408213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.408213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.408213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.408213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.510442 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 643/1292] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.511347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.521851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e6cd4-41fe-4db0-9cd9-9fb9866d2b9f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.526421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.527009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.527285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.527557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.528179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.530110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.548596 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 650/1293] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/projects => generated 391 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.548596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.607123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b75cc-b3d4-45d8-9c41-91da39282fcb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.611821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.612910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.613186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.613489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.614125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.615702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.625296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 651/1294] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:24.626208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.636238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762471-3f02-4f86-9118-2b2ca2880840 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.637172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 644/1295] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.638035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.683894 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:24.696856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.697527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.697830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.698140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.698769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.700675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.703475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db304af0-b1fb-44c7-b2cb-89a99dcc4292 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.707999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.708651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.708923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.709198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] PATH_INFO: `/v3/projects/7cc6b17bab9147488735967e838892ca/users/24efaa8ae2f04bb5a447d610f7743fdc/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.724918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6b17bab9147488735967e838892ca, user_id=24efaa8ae2f04bb5a447d610f7743fdc, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.736641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.790266 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 652/1296] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:24.790980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.825682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 645/1297] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:24 2022] PUT /identity/v3/projects/7cc6b17bab9147488735967e838892ca/users/24efaa8ae2f04bb5a447d610f7743fdc/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:24.827053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:24.859999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06096-9370-4eb6-826a-7a7506858789 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.866099 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:24.906880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99915212-b96c-485f-86af-7fdbda7b2b87 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:24.911888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.912484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.912765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.913075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.913869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.915765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:24.924103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:24.925409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:24.931629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:24.931629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:24.931629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:24.931629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.041533 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 653/1298] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:25.042295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.044649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 646/1299] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:24 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:25.045429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.053601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc135c-e3f5-438e-a629-d4fae41b39a8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.055724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5913-6238-46f4-87b8-79869ff824ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.059034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.059293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.059481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.059747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.060379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.061504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.061982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.062099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.062377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.062870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.063375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.065141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.072328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 654/1300] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.073153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.085005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0547e-2fe7-4af2-a58b-ad39b3dc2024 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.090045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.090787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.091070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.091352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] PATH_INFO: `/v3/projects/5149999249d74f9894cff131b506aaf5/users/1395329d1b9e4d2f81d5e030bc76ed49/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.093241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5149999249d74f9894cff131b506aaf5, user_id=1395329d1b9e4d2f81d5e030bc76ed49, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.095947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.108968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 655/1301] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/5149999249d74f9894cff131b506aaf5/users/1395329d1b9e4d2f81d5e030bc76ed49/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:25.109762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.154546 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.155558 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 647/1302] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:25 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:25.156437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.167201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced317-eb84-468b-8549-b9a3658d289d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.171711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2fa2-e522-4978-8e8c-600eea467664 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.172166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.172815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.173076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.173367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.174001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.176614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.176878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.177509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.177781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.178046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.178662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.180543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.264920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 648/1303] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:25 2022] POST /identity/v3/users => generated 306 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:25.265855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.273453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 656/1304] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:25 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:25.274419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.278980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455351f-587f-4dab-9392-a0c58479c86e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.283648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.284820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.285036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486dbc9-1553-4a29-961d-2525f74eda98 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.285143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.285384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.286025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.287630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.289507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.290108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.290389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.290660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.291370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.293136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.298018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 649/1305] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.298894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.307329 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 657/1306] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.307329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.310038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f322-91bf-4ed0-9596-bd269a8ce71b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.314673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53859191-c46b-41a7-b5ed-11e4e881d896 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.315141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.315769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.316048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.316319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.316954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.318635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1420967-52e3-4842-b782-f86cb7308c40 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.319501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.320130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.320406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.320677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] PATH_INFO: `/v3/projects/810ecf55b8154c638346ce4cd5175139/users/f215e5e4985844c98e6e3913a8598705/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.329622 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 650/1307] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.331024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.338049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.338049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.338275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810ecf55b8154c638346ce4cd5175139, user_id=f215e5e4985844c98e6e3913a8598705, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.339159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.359654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] MFA Rules not processed for user `1395329d1b9e4d2f81d5e030bc76ed49`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:25.360858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:25.424212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 658/1308] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/810ecf55b8154c638346ce4cd5175139/users/f215e5e4985844c98e6e3913a8598705/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:25.425179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.429060 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 651/1309] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:25.429954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.441474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df795ac7-8277-44eb-9f62-1b15f675aafa None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.485182 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.497107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead3ac-36f2-4468-8e8b-f7e2cb69c8f5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.500352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.500967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.501243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.501660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.501762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.502305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.502494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.502793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.503057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.503692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.503984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.505269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.514149 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 652/1310] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.515517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.515655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 659/1311] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.519153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.525729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc47dd-df15-4e0a-a432-8c84836cb80b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.528935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f67c8-62af-46dd-a283-aac4663bbf55 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.530431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.531068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.531404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.531612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.532514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.534753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.535576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] PATH_INFO: `/v3/projects/7cc6b17bab9147488735967e838892ca/users/24efaa8ae2f04bb5a447d610f7743fdc/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6b17bab9147488735967e838892ca, user_id=24efaa8ae2f04bb5a447d610f7743fdc, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.543869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.544760 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 653/1312] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.545572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.552582 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 660/1313] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/7cc6b17bab9147488735967e838892ca/users/24efaa8ae2f04bb5a447d610f7743fdc/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:25.553464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.555073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0c10e-aeb6-4b53-a636-6d4628714ca7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.618045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.618702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.618977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.619257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] PATH_INFO: `/v3/projects/5f6196cf023248e3bb519426078e3f76/users/47d7d91ccee64fa3887f26bf639c7173/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.627222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0af-7cee-47b7-ba1b-bbfee3f3bb0e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.632045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.632717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.632994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.633272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] PATH_INFO: `/v3/projects/97484c59144d49689571a256f79dc813/users/919f7975ad3f4835b1ede000861f6139/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.634477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6196cf023248e3bb519426078e3f76, user_id=47d7d91ccee64fa3887f26bf639c7173, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.637123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5860-41f5-4a32-ae00-f9266b776a93 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.649250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97484c59144d49689571a256f79dc813, user_id=919f7975ad3f4835b1ede000861f6139, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.652007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.755959 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 661/1314] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/97484c59144d49689571a256f79dc813/users/919f7975ad3f4835b1ede000861f6139/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:25.756385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 654/1315] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/5f6196cf023248e3bb519426078e3f76/users/47d7d91ccee64fa3887f26bf639c7173/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:25.756860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.757682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3b7f-a1d0-46de-a5ad-b553d96f5749 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.757971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3b7f-a1d0-46de-a5ad-b553d96f5749 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.758251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c3b7f-a1d0-46de-a5ad-b553d96f5749 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.759648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 655/1316] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:25.760183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c3b7f-a1d0-46de-a5ad-b553d96f5749 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.762940 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:25.959832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f26b8-f934-4ae6-b930-cb532380282e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.960674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c3b7f-a1d0-46de-a5ad-b553d96f5749 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.960766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.960766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.960766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.960766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.961148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.961232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.961358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.961441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.961441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.961441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] PATH_INFO: `/v3/projects/c63e7b7a4aef41adaa41001c0129434c/users/aa3da3ec33c7409a8c0463bf64d50400/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.961647 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 662/1317] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:25.961647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:25.961791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63e7b7a4aef41adaa41001c0129434c, user_id=aa3da3ec33c7409a8c0463bf64d50400, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.961791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:25.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fae06e-9ca2-4b8a-99fc-324b4f9e815f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:25.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:25.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:25.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:25.962286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] PATH_INFO: `/v3/projects/002154e888654c7294b2fbf8f841c06a/users/5720738406e547d38a4d7dfe26c7070e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:25.962286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=002154e888654c7294b2fbf8f841c06a, user_id=5720738406e547d38a4d7dfe26c7070e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:25.962286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5429759-8541-48c4-bb0a-004367a9df6d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.052966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 656/1318] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/c63e7b7a4aef41adaa41001c0129434c/users/aa3da3ec33c7409a8c0463bf64d50400/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.053808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.074173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 663/1319] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:25 2022] PUT /identity/v3/projects/002154e888654c7294b2fbf8f841c06a/users/5720738406e547d38a4d7dfe26c7070e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.075682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.076110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.076422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.095013 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.105135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] MFA Rules not processed for user `24efaa8ae2f04bb5a447d610f7743fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:26.106378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:26.118937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42285cb6-6620-476e-b36a-0fa6ec62747f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.174537 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 664/1320] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:26.176057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.180689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.181642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.181957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.182243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] PATH_INFO: `/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176/users/b96f9e0241064bb69711a89f1f0bc2ae/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.186325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c878-a2c0-4f85-95d3-3244335cceeb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.191243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.191828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.192102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.192368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.192998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.194623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.200788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd04564aa9a44f7bff9ed4d1d322176, user_id=b96f9e0241064bb69711a89f1f0bc2ae, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.203576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.204355 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 665/1321] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:26.205218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.217521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469025-ad4e-44a7-88c7-723e54f39de2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.222157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.222731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.223007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.223292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.223920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.225630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef74a4f-38e6-45cf-b94a-af334fa8a80b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.235190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 666/1322] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:26.236446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.236731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.237001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.274305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:26.275485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:26.295660 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.308094 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 657/1323] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176/users/b96f9e0241064bb69711a89f1f0bc2ae/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.308881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.345448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 667/1324] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:26.350510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.362010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70955ab8-8c3b-4ad1-9264-7d1766241441 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.374257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52f14f-f3f0-42dc-b868-595b93ef18bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.379612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.380261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.380535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.380804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] PATH_INFO: `/v3/projects/810ecf55b8154c638346ce4cd5175139/users/f215e5e4985844c98e6e3913a8598705/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.383219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810ecf55b8154c638346ce4cd5175139, user_id=f215e5e4985844c98e6e3913a8598705, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.385854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.396406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 658/1325] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/810ecf55b8154c638346ce4cd5175139/users/f215e5e4985844c98e6e3913a8598705/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.397203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.422442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.423050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.423331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.423604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.424294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.426485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.436738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 668/1326] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:26.437564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.448180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d75a83-c4c0-4dea-b9a7-3e61c1d23cdf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.464318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9b881-78b7-41ea-be7f-b3969bc33195 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.469018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.469662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.469944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.470221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.470861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.472970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.474275 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.483482 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 659/1327] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:26.484260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.494444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeec4c8-d27b-4cca-88ce-b7047f4faf2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.499222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.500000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.500282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.500603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] PATH_INFO: `/v3/projects/5f6196cf023248e3bb519426078e3f76/users/47d7d91ccee64fa3887f26bf639c7173/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.502890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6196cf023248e3bb519426078e3f76, user_id=47d7d91ccee64fa3887f26bf639c7173, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.505665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.506378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.506975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.507244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.507517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.508209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.510082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.516787 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 660/1328] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/5f6196cf023248e3bb519426078e3f76/users/47d7d91ccee64fa3887f26bf639c7173/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.517715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.580516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3872-b8f6-41f1-9b9e-9c821182db6a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.585058 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 669/1329] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:26.585181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.585790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.586036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.586147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.586339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] PATH_INFO: `/v3/projects/97484c59144d49689571a256f79dc813/users/919f7975ad3f4835b1ede000861f6139/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.588388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97484c59144d49689571a256f79dc813, user_id=919f7975ad3f4835b1ede000861f6139, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.591271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.603376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 661/1330] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/97484c59144d49689571a256f79dc813/users/919f7975ad3f4835b1ede000861f6139/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.603958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.636860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.655928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863b6e6-760e-4e22-b15c-7d86a51d8088 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.682570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028fbaa-7267-4339-9be0-7d3f4f6ff995 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.688650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.689257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.689582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.689856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.712970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.713603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.713882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.714150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.714787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.716380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0ddf9-89b9-49fd-8ca6-f9fe7cf4a41f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.726507 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 670/1331] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:26.727798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22344-cc5c-4a08-af30-64f46e14059f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.728081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22344-cc5c-4a08-af30-64f46e14059f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.728351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22344-cc5c-4a08-af30-64f46e14059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.747534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.749154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.756739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dba22344-cc5c-4a08-af30-64f46e14059f None None] MFA Rules not processed for user `f215e5e4985844c98e6e3913a8598705`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:26.757979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dba22344-cc5c-4a08-af30-64f46e14059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:26.758518 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 662/1332] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:26.759438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.769287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84018415-f605-47d5-a3bc-d6ad0a4f9180 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.774379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.775736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.776018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.776691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] PATH_INFO: `/v3/projects/c63e7b7a4aef41adaa41001c0129434c/users/aa3da3ec33c7409a8c0463bf64d50400/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.779066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63e7b7a4aef41adaa41001c0129434c, user_id=aa3da3ec33c7409a8c0463bf64d50400, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.782260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.789801 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.795363 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 663/1333] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/c63e7b7a4aef41adaa41001c0129434c/users/aa3da3ec33c7409a8c0463bf64d50400/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.796255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.829118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 671/1334] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:26.830388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3d63d-2357-4134-a1c9-b0751e9f2af1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.830720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3d63d-2357-4134-a1c9-b0751e9f2af1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.830965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3d63d-2357-4134-a1c9-b0751e9f2af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.867733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e8c3d63d-2357-4134-a1c9-b0751e9f2af1 None None] MFA Rules not processed for user `47d7d91ccee64fa3887f26bf639c7173`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:26.868984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e8c3d63d-2357-4134-a1c9-b0751e9f2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:26.876798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a45d4-81c2-41fb-a1ba-8f123cae0e12 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:26.882370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:26.883280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.883562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.883837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] PATH_INFO: `/v3/projects/002154e888654c7294b2fbf8f841c06a/users/5720738406e547d38a4d7dfe26c7070e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.886336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002154e888654c7294b2fbf8f841c06a, user_id=5720738406e547d38a4d7dfe26c7070e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:26.889093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:26.913812 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 664/1335] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:26 2022] PUT /identity/v3/projects/002154e888654c7294b2fbf8f841c06a/users/5720738406e547d38a4d7dfe26c7070e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:26.913812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:26.941841 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:26.952877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 672/1336] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:26.954180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:26.954309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:26.954471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:26.985547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] MFA Rules not processed for user `919f7975ad3f4835b1ede000861f6139`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:26.986754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:26.993479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b3fe-02e2-4a72-abc5-11da7bb12065 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.001709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.002364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.002646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.002972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.003601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.005595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365d1cc-0f4d-4702-ba1f-322880ac124f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.059291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 673/1337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.060406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.070725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241686d-72e3-4cb1-93ef-2ae4a9198d03 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.075743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.076438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.076741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.077014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] PATH_INFO: `/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176/users/b96f9e0241064bb69711a89f1f0bc2ae/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.078969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd04564aa9a44f7bff9ed4d1d322176, user_id=b96f9e0241064bb69711a89f1f0bc2ae, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.082220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59b809-3230-45c6-b0a3-ebe78e093f73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.092672 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 674/1338] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:27 2022] PUT /identity/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176/users/b96f9e0241064bb69711a89f1f0bc2ae/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:27.093951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.094257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.094923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.122222 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 665/1339] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:26 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:27.122397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf7bd-c597-4559-9d25-90d1627e0fb0 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.122570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf7bd-c597-4559-9d25-90d1627e0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.122845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf7bd-c597-4559-9d25-90d1627e0fb0 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.124097 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 666/1340] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:27.124677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] MFA Rules not processed for user `aa3da3ec33c7409a8c0463bf64d50400`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:27.125114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.125413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.125684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.126664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.155382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] MFA Rules not processed for user `5720738406e547d38a4d7dfe26c7070e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:27.157252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.203048 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 675/1341] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.203824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.229690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 667/1342] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.231275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.244389 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:27.258427 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:27.270190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3840bb-40ac-405c-b49d-7b763b8b537a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.274706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.275326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.275600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.275862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] PATH_INFO: `/v3/users/4c87a460c2c147e9953a07fc69b458b2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.276967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c87a460c2c147e9953a07fc69b458b2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.278945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.307865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd08c68-025f-4f90-8278-0ab8fb50413e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.313230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.313886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.314156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.314423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.379276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.380811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99569559-9334-46c0-a5b3-d0f76b84fb0e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.391492 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 668/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:27.395266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.395555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.395831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.429951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] MFA Rules not processed for user `b96f9e0241064bb69711a89f1f0bc2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:27.431193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.477112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c87a460c2c147e9953a07fc69b458b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:27.506446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 669/1344] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.507287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.517491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e45001-f27a-4dbe-a2fc-6bf45074d3e4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.522764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.527194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.527194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.527194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.527194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.527194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c4052-d637-47b6-87f7-e48d10227ba8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.536199 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 670/1345] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:27.537327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.537635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.537909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.547396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c87a460c2c147e9953a07fc69b458b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:27.548031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c87a460c2c147e9953a07fc69b458b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:27.557156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:27.558303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.562612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c87a460c2c147e9953a07fc69b458b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:27.570318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c87a460c2c147e9953a07fc69b458b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:27.574118 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 671/1346] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.574887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.576145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.579851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 676/1347] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:27 2022] DELETE /identity/v3/users/4c87a460c2c147e9953a07fc69b458b2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:27.579851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.581680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.591408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136352d8-5999-4177-a614-d089e7bbdf65 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.597077 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:27.650869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17d0b5-5395-4faf-a7c8-5850e3f88dbb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.655423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.656032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.656313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.656585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.657223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.657383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.657996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.658275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.658547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.659024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07c8b7-bb3b-4107-92ea-410211fe29b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.660292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.669086 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 677/1348] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:27.670367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.670651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.670922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.690236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:27.692046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.699526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 678/1349] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:27.700283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.713386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cdc22-7689-4d6c-8ab3-661fee23b49b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.718878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.719471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.719748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.720015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.721765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.725213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.726820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.736340 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 672/1350] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:27.737620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.747475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a0d8-a1b4-46e8-b571-f2bb651730e9 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.752102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.752742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.753605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.753876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] PATH_INFO: `/v3/projects/895de57f9934430d82536a9252f6b39e/users/65ebad647d6d4e8d944b60941642f876/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.769047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895de57f9934430d82536a9252f6b39e, user_id=65ebad647d6d4e8d944b60941642f876, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.771739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.783019 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:27.786643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.788228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.797864 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 679/1351] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:27.800213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.800498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.856686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 673/1352] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:27 2022] PUT /identity/v3/projects/895de57f9934430d82536a9252f6b39e/users/65ebad647d6d4e8d944b60941642f876/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:27.857863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:27.860365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95a12c-c4f8-48e9-beec-87782e42c43d service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.910380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.911022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.911281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.911557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.959953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c8792-a017-4217-b720-0df8cc9f0966 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:27.966943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:27.967663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.967951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.968252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:27.970695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:27.980451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:27.982079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dd6a7-2128-4e01-ac3a-24c18307eaea service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:27.986806 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:27.993673 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 680/1353] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:27.995098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:27.995550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:27.995550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.030707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] MFA Rules not processed for user `65ebad647d6d4e8d944b60941642f876`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:28.032045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.046562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.048390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.062667 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 674/1354] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:28.094959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.111862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c762f-39f9-4280-ac71-1e39504a976b service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.113828 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:28.120277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.120978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.121352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.121693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.124301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.146363 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 681/1355] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:28.147400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.160307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f05ec-eeb4-45c5-967a-eea13dd93ab6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.166037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.166708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.167059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.167397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.169200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.203430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.205020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b6728-9387-47ff-ae9d-2224c137b29b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.215004 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 675/1356] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:28.236588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.239020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.253532 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 682/1357] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:28.283578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.284567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.285051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.286225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 676/1358] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:28.291580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:28.309426 n-d-master-1 devstack@keystone.service[82035]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 30 01:13:28.309962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.321449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.388314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bc55a-eea2-4675-87dd-8d3eb70f3dac service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.393132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47d7d91ccee64fa3887f26bf639c7173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f6196cf023248e3bb519426078e3f76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.394366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.394649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.394921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] PATH_INFO: `/v3/projects/3441b0a2de064974ba07e5e0cdda427f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.397713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: Authorizing `identity:get_project(project_id=3441b0a2de064974ba07e5e0cdda427f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.399870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.401567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 683/1359] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:28 2022] GET /identity/v3/projects/3441b0a2de064974ba07e5e0cdda427f => generated 377 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:28.506302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.508307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.535719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022c20-14dc-4884-9646-6b9f06b0476a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.541090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.541806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.542091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.542365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] PATH_INFO: `/v3/projects/e76c392d55c145faa0ffe95da38e1db0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.543526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76c392d55c145faa0ffe95da38e1db0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.545863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.642672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.655975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36102-01ff-47e2-8bb9-3f6280e0cdcb tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.662579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.663210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.666636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.666636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.666636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.676659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76c392d55c145faa0ffe95da38e1db0', 'request_id': 'req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:28.682833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76c392d55c145faa0ffe95da38e1db0', 'request_id': 'req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:28.739849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.741501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.756662 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 684/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:13:28.803859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76c392d55c145faa0ffe95da38e1db0', 'request_id': 'req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:28.812982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.818587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] The token cache is being invalidate because project e76c392d55c145faa0ffe95da38e1db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:28.818881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:28.819572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:28.821097 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 677/1361] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:28 2022] DELETE /identity/v3/projects/e76c392d55c145faa0ffe95da38e1db0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:28.824830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:28.826207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.828472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3267b1-78b3-4f32-b2be-9088ee74a9ca service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.842561 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:28.869135 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:28.901484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.902249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.902537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.902805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.904683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:28.907406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fe30b-dd71-41c0-a8f0-d2c9f6bb2ed1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:28.912148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:28.912769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:28.913044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:28.913429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] PATH_INFO: `/v3/users/1395329d1b9e4d2f81d5e030bc76ed49` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:28.914475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1395329d1b9e4d2f81d5e030bc76ed49)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.915478 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:13:28.915478 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:13:28.915478 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:13:28.924762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.964396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:28.966024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39a10f-b2be-464f-b1f6-4ecb976a13df service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:28.974968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 685/1362] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:29.071946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.071946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.071946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.071946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 686/1363] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:13:29.074650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:29.076508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.097268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.098585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.127125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1395329d1b9e4d2f81d5e030bc76ed49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.128873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1395329d1b9e4d2f81d5e030bc76ed49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.141126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1395329d1b9e4d2f81d5e030bc76ed49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.141992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1395329d1b9e4d2f81d5e030bc76ed49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.168554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b13c66-11cd-458a-9e89-0808c1c206d0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.173324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.174039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.174316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.175080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.176291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.178419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e7571-7a99-4ac0-a3b3-c20c07ce1443 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:29.180121 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 687/1364] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:29 2022] GET /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 393 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:13:29.221265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1395329d1b9e4d2f81d5e030bc76ed49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.256517 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 678/1365] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:28 2022] DELETE /identity/v3/users/1395329d1b9e4d2f81d5e030bc76ed49 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:13:29.260418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.260632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.260982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.262645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 688/1366] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:29.267598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.268146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:29.269876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.269990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.349135 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:29.370171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8954c-f116-4023-bea9-575f425c5bed admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.375379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.376179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.376591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.377127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] PATH_INFO: `/v3/users/333395380d0348138321e634cc1ce438` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.378970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=333395380d0348138321e634cc1ce438)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.381504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:29.386816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.388086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.453537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ab26-660f-4dac-a116-4b9df6a012f4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.458304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47d7d91ccee64fa3887f26bf639c7173', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f6196cf023248e3bb519426078e3f76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.458929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.459211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.459503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] PATH_INFO: `/v3/projects/3441b0a2de064974ba07e5e0cdda427f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.460648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: Authorizing `identity:get_project(project_id=3441b0a2de064974ba07e5e0cdda427f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.462712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:29.464332 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 689/1367] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:29 2022] GET /identity/v3/projects/3441b0a2de064974ba07e5e0cdda427f => generated 377 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:29.466208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.467803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.483133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28348fe1-9615-4644-b2db-dffc09bc7297 tempest-FlavorsAccessTestJSON-1892644905 tempest-FlavorsAccessTestJSON-1892644905-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.488770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.489468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.489704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.489981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] PATH_INFO: `/v3/users/699c4aa15ab745e881adca16afcf3bcf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.491651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=699c4aa15ab745e881adca16afcf3bcf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.493245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:29.577267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333395380d0348138321e634cc1ce438'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.578054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333395380d0348138321e634cc1ce438'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.581086 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:29.585992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333395380d0348138321e634cc1ce438'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.586751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333395380d0348138321e634cc1ce438'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.686562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b123d5ac-899b-48ce-b932-9e278dfbb6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333395380d0348138321e634cc1ce438'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.700500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699c4aa15ab745e881adca16afcf3bcf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.704885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 679/1368] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:29 2022] DELETE /identity/v3/users/333395380d0348138321e634cc1ce438 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:29.706347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862edc27-c5c6-400a-98b2-093b188ee81e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.706628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862edc27-c5c6-400a-98b2-093b188ee81e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.706902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862edc27-c5c6-400a-98b2-093b188ee81e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.708308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 680/1369] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:29.709406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6798e5-4858-4759-839b-510c26ddc6b0 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.709916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6798e5-4858-4759-839b-510c26ddc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.710196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6798e5-4858-4759-839b-510c26ddc6b0 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.711664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 681/1370] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:29.713035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75343c-495d-4c4c-95d2-73900cb54e54 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.713319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75343c-495d-4c4c-95d2-73900cb54e54 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.713615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75343c-495d-4c4c-95d2-73900cb54e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.741426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3e75343c-495d-4c4c-95d2-73900cb54e54 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:29.744096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e75343c-495d-4c4c-95d2-73900cb54e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.760482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699c4aa15ab745e881adca16afcf3bcf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.761197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699c4aa15ab745e881adca16afcf3bcf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.774550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699c4aa15ab745e881adca16afcf3bcf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.781822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699c4aa15ab745e881adca16afcf3bcf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:29.788834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 690/1371] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:29 2022] DELETE /identity/v3/users/699c4aa15ab745e881adca16afcf3bcf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:29.789985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:29.791430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.805638 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 682/1372] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:29.810802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.811608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.811608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.831601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:29.832819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.851395 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:29.868939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.870222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.906956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 683/1373] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:29.907900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.910472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.938043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46b1a-6421-4dde-acbc-2c5e21573a2c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.942867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.943507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.943989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.944431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.946387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.948503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bc9a2-3672-40d5-9164-139e61beac5f tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:29.950441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 691/1374] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:29 2022] GET /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 393 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:29.951528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.951975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.958838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.972818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:29.974065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.984908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 692/1375] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:29.984908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:29.984908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:29.988932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e75722-50b1-49dd-b334-8acb64d7070c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:29.993878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:29.994512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:29.994919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:29.995091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] PATH_INFO: `/v3/projects/5149999249d74f9894cff131b506aaf5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:29.996206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5149999249d74f9894cff131b506aaf5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:29.998201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.000751 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:30.048971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2368-b4af-483c-a51a-959174568ea9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.053770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.054351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.054625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.054895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.066062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.067813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.079594 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 693/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:30.080495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.082478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:30.098525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2cb1a-717f-4179-9320-83c0476f5c4f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.103969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.104584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.104866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.105138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.114682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.116295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.120912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5149999249d74f9894cff131b506aaf5', 'request_id': 'req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.127891 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 694/1377] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:30.128945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.129500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5149999249d74f9894cff131b506aaf5', 'request_id': 'req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.139231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acc49e-601e-47f4-9480-02ae86398fc7 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.195636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5149999249d74f9894cff131b506aaf5', 'request_id': 'req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.201353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.201973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.202286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.202674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.209705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] The token cache is being invalidate because project 5149999249d74f9894cff131b506aaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:30.210008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.210686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f8f2e72-84b4-4448-9ba9-d31e9c91b0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.215680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 684/1378] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:29 2022] DELETE /identity/v3/projects/5149999249d74f9894cff131b506aaf5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:30.215680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d407ea-459f-4a89-a059-6c8a4641ac91 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.215680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d407ea-459f-4a89-a059-6c8a4641ac91 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.215680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d407ea-459f-4a89-a059-6c8a4641ac91 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.217488 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 685/1379] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:30.219920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8aec7-4592-4d75-bfff-b0d89d18f104 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.220443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8aec7-4592-4d75-bfff-b0d89d18f104 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.220717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8aec7-4592-4d75-bfff-b0d89d18f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.241467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5ed8aec7-4592-4d75-bfff-b0d89d18f104 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:30.241676 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:30.242676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ed8aec7-4592-4d75-bfff-b0d89d18f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:30.272109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.273604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.283627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 695/1380] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:30.284473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:30.308789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 686/1381] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:30.319923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.320246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.320615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.345134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:30.347001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:30.358708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 687/1382] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:30.363381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.378919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4737d-20e1-43cf-a8df-78731fac78fb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.384360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.385267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.385862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.386188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.387078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:30.387552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.389368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.397483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.407169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 688/1383] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:13:30.416550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.429651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f3732-61b5-413d-87ed-456ff68c9c1c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.436398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.437241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.437653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.438320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.440120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.443226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.484114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018363-e5c6-4884-8f40-93e275ffdd9d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.489231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.489915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.490198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.490473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.491760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.493987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.495723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 696/1384] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 393 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:30.548812 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 689/1385] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:30 2022] POST /identity/v3/projects => generated 401 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:30.552676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.572887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1de216-7ef0-4808-b095-b34d918ee9c1 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.613091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.615181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:30.663435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.664079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.664508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.664781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.665456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.668128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.684253 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:30.713457 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:30.732157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef3c4c-90e4-4c92-b650-ce6a164c5eeb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.738837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.739491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.742831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.742831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] PATH_INFO: `/v3/projects/1b971a28beb54d189c4ccbcddfd73925` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.742831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b971a28beb54d189c4ccbcddfd73925)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.743471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.765049 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 697/1386] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:30 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:30.769263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.780827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011da4-c306-42bc-b3d2-763dc44004a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.799238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.799238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.799238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.799238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.799507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.799507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.805295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 698/1387] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:13:30.809507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.820219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936c3f6-0b99-4385-837b-bd309381abaa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.824952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.825590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.825869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.826143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.826767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.828416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:30.838702 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 699/1388] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:13:30.842984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:30.853628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487c07d-fa46-4181-be9e-f32a22dabc3d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:30.858271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:30.858921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:30.859198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:30.859499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] PATH_INFO: `/v3/projects/8e6f42c16eeb4e97b65cebf891105008/users/056e59c7d4c2475eb66b64e0e24367be/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:30.902559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b971a28beb54d189c4ccbcddfd73925', 'request_id': 'req-39f94538-e4b0-4650-a1e0-9d11116a1edc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.906375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6f42c16eeb4e97b65cebf891105008, user_id=056e59c7d4c2475eb66b64e0e24367be, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:30.912577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b971a28beb54d189c4ccbcddfd73925', 'request_id': 'req-39f94538-e4b0-4650-a1e0-9d11116a1edc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:30.914348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:31.009623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b971a28beb54d189c4ccbcddfd73925', 'request_id': 'req-39f94538-e4b0-4650-a1e0-9d11116a1edc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.021588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] The token cache is being invalidate because project 1b971a28beb54d189c4ccbcddfd73925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:31.021905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.022569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.024084 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 690/1389] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:30 2022] DELETE /identity/v3/projects/1b971a28beb54d189c4ccbcddfd73925 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:31.024844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:31.026191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.044349 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 700/1390] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:30 2022] PUT /identity/v3/projects/8e6f42c16eeb4e97b65cebf891105008/users/056e59c7d4c2475eb66b64e0e24367be/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:13:31.050821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:31.053846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.111509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f94538-e4b0-4650-a1e0-9d11116a1edc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:31.148311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae142bbb-1800-4f56-81bf-f2b69ca7baa0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:31.153628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:31.154350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.154709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.155059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] PATH_INFO: `/v3/users/98f82f409f404c2c93ea52f4625b64c3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.156266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f82f409f404c2c93ea52f4625b64c3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:31.158343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:31.172633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:31.173288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.173776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.173910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] PATH_INFO: `/v3/projects/d56d4c23abde4891af030ac51a7e56ce` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.175547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56d4c23abde4891af030ac51a7e56ce)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:31.177576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:31.423914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56d4c23abde4891af030ac51a7e56ce', 'request_id': 'req-e0f4e1af-bd42-404f-894c-4ac2963a1a32'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.424565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f82f409f404c2c93ea52f4625b64c3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.430734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56d4c23abde4891af030ac51a7e56ce', 'request_id': 'req-e0f4e1af-bd42-404f-894c-4ac2963a1a32'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.492100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f82f409f404c2c93ea52f4625b64c3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.492745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f82f409f404c2c93ea52f4625b64c3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.500754 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:31.505801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f82f409f404c2c93ea52f4625b64c3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.512638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f82f409f404c2c93ea52f4625b64c3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.519109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 701/1391] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:31 2022] DELETE /identity/v3/users/98f82f409f404c2c93ea52f4625b64c3 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:31.519878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:31.521179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.548897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56d4c23abde4891af030ac51a7e56ce', 'request_id': 'req-e0f4e1af-bd42-404f-894c-4ac2963a1a32'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.552303 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:31.561198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] The token cache is being invalidate because project d56d4c23abde4891af030ac51a7e56ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:31.561521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.562233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0f4e1af-bd42-404f-894c-4ac2963a1a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.566702 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 691/1392] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:31 2022] DELETE /identity/v3/projects/d56d4c23abde4891af030ac51a7e56ce => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:31.566702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.566702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.566702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.586061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ca2bb-88e8-4775-9851-f7b2c925fd3a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:31.586897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:31.588138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.590789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:31.591395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.591679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.591942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] PATH_INFO: `/v3/users/919f7975ad3f4835b1ede000861f6139` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.593078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919f7975ad3f4835b1ede000861f6139)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:31.595048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:31.596239 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 692/1393] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:31.597737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:31.600071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.610901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c0a53-fa92-40dd-9c1c-b96c77e68a38 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:31.615494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:31.616144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.616415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.616685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] PATH_INFO: `/v3/users/328a2b1b782746bb9af94d706c97ffc7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.617849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328a2b1b782746bb9af94d706c97ffc7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:31.619748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:31.737147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919f7975ad3f4835b1ede000861f6139'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.805759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328a2b1b782746bb9af94d706c97ffc7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.806681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328a2b1b782746bb9af94d706c97ffc7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.813752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328a2b1b782746bb9af94d706c97ffc7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.814430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328a2b1b782746bb9af94d706c97ffc7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.816124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919f7975ad3f4835b1ede000861f6139'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.817118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919f7975ad3f4835b1ede000861f6139'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.829738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919f7975ad3f4835b1ede000861f6139'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.837417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d83cba7-715f-4bd9-9feb-7ad61519e8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919f7975ad3f4835b1ede000861f6139'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.843563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 702/1394] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:31 2022] DELETE /identity/v3/users/919f7975ad3f4835b1ede000861f6139 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:31.844740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.845059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.845409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.847852 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 703/1395] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:31.848740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:31.850411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.915621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7062947e-9750-4111-ad56-d12af2d64af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328a2b1b782746bb9af94d706c97ffc7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:31.932245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fda8a-3693-47ae-88fd-8679cc2ee902 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:31.937978 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 693/1396] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:31 2022] DELETE /identity/v3/users/328a2b1b782746bb9af94d706c97ffc7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:31.939817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.940172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.941174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.941319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:31.941906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:31.942189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:31.942459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:31.944788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:31.963571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:31.964783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.008045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.009579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.019622 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 704/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:32.020430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.021776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.026898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 694/1398] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:32.027739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.034608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.098715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb117f-d68c-4cbb-9a5d-00f84dba0865 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.102741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.103549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.104106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.104106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.105735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.114748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fad26c-3cb8-488c-8081-44ed100e9bcf service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.119748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.125053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.125053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.125053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.125053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] PATH_INFO: `/v3/users/5720738406e547d38a4d7dfe26c7070e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.125387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5f9b-fa23-4c5f-9f57-24fb944d45c5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.125469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5720738406e547d38a4d7dfe26c7070e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.125469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.134981 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 695/1399] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:32.136541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b38-d11b-4419-9f14-11267603773c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.136886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b38-d11b-4419-9f14-11267603773c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.137274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f1b38-d11b-4419-9f14-11267603773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.161985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c46f1b38-d11b-4419-9f14-11267603773c None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:32.163209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c46f1b38-d11b-4419-9f14-11267603773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.234724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 696/1400] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:32.236185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.236476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.236750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.258683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:32.259827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.267465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 697/1401] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:32.268238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.277891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075a532-ce5a-4d85-99cd-a917b9a2a5ed None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.281662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.282257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.282535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.282805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.291983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.293428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2effe-5170-4e84-8003-998ed9c29b7a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.304274 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 698/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:32.305510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.305775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.306044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.307648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 699/1403] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 30 01:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:32.308464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.310608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.324569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491c5f2-8a03-45ef-b63f-c14129f3af00 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.328482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.329161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.329750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.330101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.339668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.341087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3635b-09f0-4051-af6a-f5c91cdcde71 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.373232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5720738406e547d38a4d7dfe26c7070e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.384850 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 700/1404] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:32.393716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.394071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.394934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.420274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:32.421710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.433021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 701/1405] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:32.434062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.435680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.449985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e079f55-0713-4364-bccd-13362de0f4d1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.455606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.456255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.456255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.456746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] PATH_INFO: `/v3/projects/97484c59144d49689571a256f79dc813` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.458132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97484c59144d49689571a256f79dc813)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.460470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.464721 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:32.509100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5720738406e547d38a4d7dfe26c7070e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.509672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5720738406e547d38a4d7dfe26c7070e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.524693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5720738406e547d38a4d7dfe26c7070e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.531509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21e554a1-c62d-4f1d-8012-1251b76835fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5720738406e547d38a4d7dfe26c7070e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.538564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 705/1406] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:32 2022] DELETE /identity/v3/users/5720738406e547d38a4d7dfe26c7070e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:32.542277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.543697 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:32.544158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.548840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.548840 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 706/1407] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:32.548840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.548840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.616449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97484c59144d49689571a256f79dc813', 'request_id': 'req-091879d6-8628-46e6-8680-4262cf4cd5e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.626223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97484c59144d49689571a256f79dc813', 'request_id': 'req-091879d6-8628-46e6-8680-4262cf4cd5e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.642453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff2d9-89d6-4e57-aeb6-a70d0a09de46 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:32.718140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97484c59144d49689571a256f79dc813', 'request_id': 'req-091879d6-8628-46e6-8680-4262cf4cd5e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.732869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] The token cache is being invalidate because project 97484c59144d49689571a256f79dc813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:32.733264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.734154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:32.736035 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 702/1408] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:32 2022] DELETE /identity/v3/projects/97484c59144d49689571a256f79dc813 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:32.736914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:32.738980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.746573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:32.747371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.747706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.747997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.751174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.766191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:32.767896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fbe0d-55c5-4437-b050-15d34933bfda service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:32.781468 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 707/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:32.783247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8a792-2631-4884-b7da-c7b96ebab7b6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.783532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8a792-2631-4884-b7da-c7b96ebab7b6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.783800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8a792-2631-4884-b7da-c7b96ebab7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.809319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-38b8a792-2631-4884-b7da-c7b96ebab7b6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:32.810393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38b8a792-2631-4884-b7da-c7b96ebab7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.921020 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 30 01:13:32.921020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:32.921020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.947666 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 708/1410] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:32.949514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:32.949721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:32.950001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:32.976595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:32.978208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:32.997445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 709/1411] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:13:33.007006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.010068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.039375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091879d6-8628-46e6-8680-4262cf4cd5e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.041196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a642-fcbd-4f11-b5b8-e770386bb295 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.046766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.047580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.051524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.052817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.055037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.058815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.063312 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 703/1412] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:32 2022] GET /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 393 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:33.065354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.070265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.071168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.072229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.072805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] PATH_INFO: `/v3/projects/3441b0a2de064974ba07e5e0cdda427f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.077704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3441b0a2de064974ba07e5e0cdda427f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.080191 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:13:33.080191 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:13:33.080191 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:13:33.084204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c31f1-e9c7-4221-acb7-8b1d7b3b3124 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.087425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.093087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.094171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.094610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.095037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.095853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:33.096285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.098878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8ee22-ef5a-456b-8fcc-307dd5ae4773 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.136588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 704/1413] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:33.136588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.136588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.136588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.164812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] MFA Rules not processed for user `ae9211a459e946c1a114983c531a8897`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:33.166107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.249006 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 705/1414] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:33.249006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.262641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106cda6-70a4-48cc-8958-87daf958ae0a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.280884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3441b0a2de064974ba07e5e0cdda427f', 'request_id': 'req-4a22b684-6192-4df9-88fc-240b80cd9a97'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.327642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.328249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.328524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.328793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.329450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.331962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.401298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3441b0a2de064974ba07e5e0cdda427f', 'request_id': 'req-4a22b684-6192-4df9-88fc-240b80cd9a97'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.415878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3441b0a2de064974ba07e5e0cdda427f', 'request_id': 'req-4a22b684-6192-4df9-88fc-240b80cd9a97'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.428353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] The token cache is being invalidate because project 3441b0a2de064974ba07e5e0cdda427f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:33.428651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.429324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.430901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 710/1415] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:32 2022] DELETE /identity/v3/projects/3441b0a2de064974ba07e5e0cdda427f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:33.435111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.436717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.443683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 706/1416] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:33 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:33.444765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.451026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.455627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22b684-6192-4df9-88fc-240b80cd9a97 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.514301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.514947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.515199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.515472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] PATH_INFO: `/v3/projects/b499ae6acbf14266a54f5bb8c30e6acc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.516606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b499ae6acbf14266a54f5bb8c30e6acc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.518173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6f943-8587-4911-b82f-2d0e7471f2b9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.519104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.523536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.524169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.524445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.524741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] PATH_INFO: `/v3/projects/002154e888654c7294b2fbf8f841c06a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.525992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002154e888654c7294b2fbf8f841c06a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.527930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.621418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b499ae6acbf14266a54f5bb8c30e6acc', 'request_id': 'req-6e28bac7-36c4-4138-950a-9ed8672539a9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.644735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002154e888654c7294b2fbf8f841c06a', 'request_id': 'req-3cb0441a-2c1a-4485-808c-563df4539d82'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.650180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002154e888654c7294b2fbf8f841c06a', 'request_id': 'req-3cb0441a-2c1a-4485-808c-563df4539d82'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.730125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b499ae6acbf14266a54f5bb8c30e6acc', 'request_id': 'req-6e28bac7-36c4-4138-950a-9ed8672539a9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.740281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b499ae6acbf14266a54f5bb8c30e6acc', 'request_id': 'req-6e28bac7-36c4-4138-950a-9ed8672539a9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.751213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] The token cache is being invalidate because project b499ae6acbf14266a54f5bb8c30e6acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:33.751486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.752152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e28bac7-36c4-4138-950a-9ed8672539a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.754326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 711/1417] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:33 2022] DELETE /identity/v3/projects/b499ae6acbf14266a54f5bb8c30e6acc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:33.755499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.755776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.756048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.757543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 712/1418] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:33.758240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.759836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.832365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002154e888654c7294b2fbf8f841c06a', 'request_id': 'req-3cb0441a-2c1a-4485-808c-563df4539d82'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.836641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef8486-a801-46d9-8f46-c89a83a26aa1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.842400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.843227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.843494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.843767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.844148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] The token cache is being invalidate because project 002154e888654c7294b2fbf8f841c06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:33.844448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.845164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:33.845627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.851998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 707/1419] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:33 2022] DELETE /identity/v3/projects/002154e888654c7294b2fbf8f841c06a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:33.853959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.855457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.914361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.915989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.927259 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 713/1420] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:33.928085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:33.929510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:33.931032 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:33.937634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0441a-2c1a-4485-808c-563df4539d82 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.943705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.944424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7de7-0de9-4c6d-a672-a4743a1cdbf5 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:33.944581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.944985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.949935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] PATH_INFO: `/v3/users/47d7d91ccee64fa3887f26bf639c7173` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.953033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:33.953765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:33.954119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:33.954463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:33.955174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.957315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:33.964201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d7d91ccee64fa3887f26bf639c7173)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:33.967932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.051106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 714/1421] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:33 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:34.052020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.054207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.066428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9348ff2-4704-493d-8fec-35eeed3f8b6e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.072304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.073635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.073966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.074255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] PATH_INFO: `/v3/users/f215e5e4985844c98e6e3913a8598705` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.076143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f215e5e4985844c98e6e3913a8598705)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.078418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.147423 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:34.187552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d7d91ccee64fa3887f26bf639c7173'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.188274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d7d91ccee64fa3887f26bf639c7173'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.196677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d7d91ccee64fa3887f26bf639c7173'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.197466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d7d91ccee64fa3887f26bf639c7173'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.269890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d7d91ccee64fa3887f26bf639c7173'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.287940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f215e5e4985844c98e6e3913a8598705'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.293290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 708/1422] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:33 2022] DELETE /identity/v3/users/47d7d91ccee64fa3887f26bf639c7173 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:34.294499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:34.305873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.359052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f215e5e4985844c98e6e3913a8598705'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.359665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f215e5e4985844c98e6e3913a8598705'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.379036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f215e5e4985844c98e6e3913a8598705'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.386632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea215a5-5584-4b28-b831-b64f5ada8cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f215e5e4985844c98e6e3913a8598705'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:34.393950 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 715/1423] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:34 2022] DELETE /identity/v3/users/f215e5e4985844c98e6e3913a8598705 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:34.395198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4117ce-45c7-4ef3-9a7a-77abee5dcc89 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.395486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4117ce-45c7-4ef3-9a7a-77abee5dcc89 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.395756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4117ce-45c7-4ef3-9a7a-77abee5dcc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.395870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.397119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.422497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cc4117ce-45c7-4ef3-9a7a-77abee5dcc89 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:34.423814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc4117ce-45c7-4ef3-9a7a-77abee5dcc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.482704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd8172-9ed2-46cd-a39e-da691fa809f4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.499214 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 716/1424] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:34.500901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.501191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.501531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.502874 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 717/1425] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:34.503586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.511080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.554095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec98ef0-ff6b-45b9-9304-13286de9f280 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.564662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.565541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.565848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.566109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.566798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.569066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3976b4-35da-4055-9b47-ffe0736e790a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.597671 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 718/1426] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:34.603166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b597-34f3-4c4d-b690-ab047a9725d0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.607299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b597-34f3-4c4d-b690-ab047a9725d0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.607579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b597-34f3-4c4d-b690-ab047a9725d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.644193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e9d6b597-34f3-4c4d-b690-ab047a9725d0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:34.644621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e9d6b597-34f3-4c4d-b690-ab047a9725d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.655144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 719/1427] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:34.656677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.656960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.657231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.662629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.664079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.664594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.665200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.669486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.674204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.685930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:34.687187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.692538 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 709/1428] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:34 2022] GET /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 393 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:34.695089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.712308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e61f5-753c-45c6-98ea-5f7341213097 tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.722750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.722750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.722750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.722750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.723004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.725232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.742661 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 710/1429] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:34.743656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.758317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec73e0-8736-4853-8878-b1c09355adf3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.764555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.766548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.767222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.767601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.768416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:34.769054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.771860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.791257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 720/1430] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:13:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:34.792148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.806345 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 711/1431] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:34.808852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:34.816017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159048-bd92-4c25-abbf-bada87cff104 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:34.816501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:34.821173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:34.821883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:34.822161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:34.822432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] PATH_INFO: `/v3/projects/283e7fd477334b879db6b49ee5cc509f/users/c7334417689847d18bc4c1b27d173a23/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:34.842143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=283e7fd477334b879db6b49ee5cc509f, user_id=c7334417689847d18bc4c1b27d173a23, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:34.845608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:34.946584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 721/1432] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:34 2022] PUT /identity/v3/projects/283e7fd477334b879db6b49ee5cc509f/users/c7334417689847d18bc4c1b27d173a23/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:34.950002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:35.064871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deae844-d128-4de7-95db-d55c1d7264bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.075840 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:35.099412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71a5fc-4c5f-4c79-98f9-e7cd81183d2b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.123376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.123376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.123376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.123376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.123703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.123703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd50982-7d99-4634-b88d-358a997b8750 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.185202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.185856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.186167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.186495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.244269 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 722/1433] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:34 2022] POST /identity/v3/projects => generated 409 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:35.245790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f50e-cc58-4eab-a475-eb5ff9d9f3cc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.246085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f50e-cc58-4eab-a475-eb5ff9d9f3cc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.246532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276f50e-cc58-4eab-a475-eb5ff9d9f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.292336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0276f50e-cc58-4eab-a475-eb5ff9d9f3cc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:35.295531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0276f50e-cc58-4eab-a475-eb5ff9d9f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.337566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.339012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.351125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 712/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:35.353810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:35.355207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.371487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da0f67-85b9-4dea-97ea-7f5dda388175 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.372528 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 723/1435] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:35.373971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.375072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.375072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.383151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.383846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.384128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.384564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] PATH_INFO: `/v3/projects/5f6196cf023248e3bb519426078e3f76` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.386851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6196cf023248e3bb519426078e3f76)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.388778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.390111 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 724/1436] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:35 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:35.391945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:35.393876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.412292 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:35.419977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ba74-8ec2-4e22-a570-e9dd3095ecee None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.426513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.427293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.427573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.428398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] PATH_INFO: `/v3/projects/810ecf55b8154c638346ce4cd5175139` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.429549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=810ecf55b8154c638346ce4cd5175139)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.433365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.523810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6196cf023248e3bb519426078e3f76', 'request_id': 'req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.532646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6196cf023248e3bb519426078e3f76', 'request_id': 'req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.538996 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:35.625228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810ecf55b8154c638346ce4cd5175139', 'request_id': 'req-793f0598-1fbd-43ba-ae3a-629cc435b99a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.655457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6196cf023248e3bb519426078e3f76', 'request_id': 'req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.668394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] The token cache is being invalidate because project 5f6196cf023248e3bb519426078e3f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:35.668680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.669394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.671349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 713/1437] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:35 2022] DELETE /identity/v3/projects/5f6196cf023248e3bb519426078e3f76 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:35.671999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:35.673357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.745423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810ecf55b8154c638346ce4cd5175139', 'request_id': 'req-793f0598-1fbd-43ba-ae3a-629cc435b99a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.748295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b3c6e-8b5b-4895-bdd4-00d0384b18e8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.758987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810ecf55b8154c638346ce4cd5175139', 'request_id': 'req-793f0598-1fbd-43ba-ae3a-629cc435b99a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.776187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] The token cache is being invalidate because project 810ecf55b8154c638346ce4cd5175139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:35.778133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.780596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:35.785639 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 725/1438] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:35 2022] DELETE /identity/v3/projects/810ecf55b8154c638346ce4cd5175139 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:35.787526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:35.790357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.843408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.844201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.849019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.849019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.849019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.849019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.909280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0598-1fbd-43ba-ae3a-629cc435b99a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:35.914944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:35.915848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.916191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.917518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.922271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.938745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:35.940509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5e7c7-a69e-4bc1-8790-f40a520f4236 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:35.947449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 714/1439] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:35 2022] POST /identity/v3/users => generated 305 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:35.948364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:13:35.950432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:35.957502 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 726/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:35.958824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d663b-f448-4d1b-93dd-a0cdbabfe351 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:35.959111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d663b-f448-4d1b-93dd-a0cdbabfe351 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:35.959388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d663b-f448-4d1b-93dd-a0cdbabfe351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:35.988496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d36d663b-f448-4d1b-93dd-a0cdbabfe351 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:35.991130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d36d663b-f448-4d1b-93dd-a0cdbabfe351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.007426 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 727/1441] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:36.008786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.009071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.009414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.046393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:36.047981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.058315 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 728/1442] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:36.059436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.060910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.077763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e0067-b6b8-4dae-a92a-bbcfead7e561 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.090882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.094438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.097672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.101766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.102677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.102677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.107041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.108197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70d98-de07-4966-a533-488f89e45eb2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.131070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 729/1443] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:36.131070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ea3f-6a2f-4df3-9b43-0f1df446620c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.131070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ea3f-6a2f-4df3-9b43-0f1df446620c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.131070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ea3f-6a2f-4df3-9b43-0f1df446620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.164939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9828ea3f-6a2f-4df3-9b43-0f1df446620c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:36.170027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9828ea3f-6a2f-4df3-9b43-0f1df446620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.201862 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 730/1444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:36.203635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.203927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.204202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.239223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a57cac-d512-4bc8-ae5e-a9e07967ea53 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.241442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:36.243447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.247796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24efaa8ae2f04bb5a447d610f7743fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cc6b17bab9147488735967e838892ca', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.249601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.250264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.255221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] PATH_INFO: `/v3/projects/895de57f9934430d82536a9252f6b39e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.255221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorizing `identity:get_project(project_id=895de57f9934430d82536a9252f6b39e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.257382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.259117 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 731/1445] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:36.259622 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 715/1446] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:13:35 2022] GET /identity/v3/projects/895de57f9934430d82536a9252f6b39e => generated 393 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:36.260254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.260359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.262303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.275050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f931d2-e144-453a-9095-b05ed39fc925 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.284259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.284259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.284259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.284811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.285600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.291258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.311755 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 732/1447] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:36.313123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.326552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71480f4-dc5e-4ff7-901e-29db6051e01d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.341489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.349886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.350174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.350453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.351203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:36.351465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.353103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.369525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 733/1448] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:36.370789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.383618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298c873-0acb-4374-9760-55f2d3dcc3c5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.391575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.392481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.392991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.394583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.395569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:36.396223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.398151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.409631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fc3d2-5b55-43b8-99d2-70fd9146d1ae tempest-FlavorsAccessNegativeTestJSON-1733783349 tempest-FlavorsAccessNegativeTestJSON-1733783349-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.417635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.418423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.418747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.419567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.422089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.431894 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 734/1449] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:36.436771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.438684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.448158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.462264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 716/1450] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:36.463227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.479780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7a4f-5417-4299-9072-6457eb033b6e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.489035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdefc9-9bcd-4bd9-8252-391b3d6803b9 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.497834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.498797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.499263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.500686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] PATH_INFO: `/v3/projects/40fddc54619245cb8359e4648cb25990/users/aef20737964b4057bdba12a91ef1c9b7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.501525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.502474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.503273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.504377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.505090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.517227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.519536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fddc54619245cb8359e4648cb25990, user_id=aef20737964b4057bdba12a91ef1c9b7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.523674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.626506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 735/1451] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:36 2022] PUT /identity/v3/projects/40fddc54619245cb8359e4648cb25990/users/aef20737964b4057bdba12a91ef1c9b7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:36.627588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.679419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 717/1452] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:36.680271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:36.685455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:36.751958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e0d66-4644-494d-a0af-a840dd0b744d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.842962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.844373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.844783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.845086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.846003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.849123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd1373-2f06-4223-bd09-1bd333f9f87b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.879244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8de-eb3e-4d65-94dc-515494bd4930 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:36.895437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:36.900793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.900793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.900793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] PATH_INFO: `/v3/users/d69604c3494f489b8d86c6dfa932b108` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.900793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69604c3494f489b8d86c6dfa932b108)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:36.900793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:36.921427 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:36.976518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 736/1453] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/projects => generated 369 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:36.988453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:36.988753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:36.989068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:36.996673 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:37.027905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] MFA Rules not processed for user `aef20737964b4057bdba12a91ef1c9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:37.029474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:37.200462 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 737/1454] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:37.201968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:37.222198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69604c3494f489b8d86c6dfa932b108'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:37.225049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69604c3494f489b8d86c6dfa932b108'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:37.261205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69604c3494f489b8d86c6dfa932b108'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:37.265268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69604c3494f489b8d86c6dfa932b108'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:37.335086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02201c39-45a4-4f1e-9ff8-6f2c0b19f907 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:37.347435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:37.348443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.348443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.348633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.349222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:37.351282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:37.411164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69604c3494f489b8d86c6dfa932b108'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:37.470805 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 718/1455] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:36 2022] DELETE /identity/v3/users/d69604c3494f489b8d86c6dfa932b108 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:37.472966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:37.478261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:37.511985 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 738/1456] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:37 2022] POST /identity/v3/users => generated 292 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:37.513227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:37.515510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:37.531253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a490-c09a-40ef-b63d-6410836db161 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:37.626946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:37.629870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.630342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.631438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.632412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:37.637314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dbe30-01f9-4ddb-b7cb-a4193cfb0195 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:37.637996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:37.666212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:37.667769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.668110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.668395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.672420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:37.679662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef071c-3cbc-44ec-b287-490b21607a80 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:37.823226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 719/1457] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:37 2022] POST /identity/v3/users => generated 285 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:37.823226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.823226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.823226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.823680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 739/1458] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:37 2022] POST /identity/v3/projects => generated 409 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:37.823973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:37.827641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:37.859834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:37.862811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:37.951773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c421f8-f02f-4db4-84e8-67a2161e1cca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:37.953495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 720/1459] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:37.954477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:37.970866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:37.971588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.971805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.972079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.972740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:37.974470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:37.975828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea61dd-afa7-452a-95f6-051deaf85a20 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:37.981621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:37.982335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:37.982692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:37.983035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:37.983762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:37.985678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:37.995792 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 740/1460] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:37.996840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.020248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f2bdf-7342-4228-9fb2-a02302d71d6c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.020502 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 721/1461] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:38.023365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.028712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:38.030816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.032320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.032700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.033069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.034000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.036385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.130816 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 741/1462] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:37 2022] POST /identity/v3/users => generated 311 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:38.131820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.152885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fb78-4f2e-4e01-a7c5-5c0d705f66f7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.165237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.166135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.166560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.167157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.168100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.170313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.184672 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 742/1463] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:38.185848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.195390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289c98-2f75-4c5b-98ca-08f90d99d869 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.208723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d536-da21-4eb6-ae29-49bc214166a4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.210935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.214091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.217375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.217375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.232936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.233871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.234346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.234952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.236621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.239007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.240765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.242514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.255122 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 743/1464] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:38.256914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.261634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 722/1465] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:38.262598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.279046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1349-81b9-459d-95a7-da656035a7e4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.282181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f2d0-4449-489a-b53f-13a9a7e1f351 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.290516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.291147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.291429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.292444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.293085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.293448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.293764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] PATH_INFO: `/v3/projects/d3822dc7d617431e8717f1540cc7ed7b/users/88d62ac1032847b2b6181b927a2f5401/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.295130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.299039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.299039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.323679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 744/1466] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:38.324743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.334149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3822dc7d617431e8717f1540cc7ed7b, user_id=88d62ac1032847b2b6181b927a2f5401, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.338317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433d6bd-7f13-4940-9531-954d4faf88ff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.347788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ed1de-7b6e-40db-92f9-2236f0ef9ebd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.356662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.357738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.358456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.358909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] PATH_INFO: `/v3/projects/c605bd2c76b4484990981eb9bd6e9595/users/6d1ef102da3a4c788abb0aef6b90d0bc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.387025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c605bd2c76b4484990981eb9bd6e9595, user_id=6d1ef102da3a4c788abb0aef6b90d0bc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.391343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:38.532057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 745/1467] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:38 2022] PUT /identity/v3/projects/c605bd2c76b4484990981eb9bd6e9595/users/6d1ef102da3a4c788abb0aef6b90d0bc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:38.532477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 723/1468] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:38 2022] PUT /identity/v3/projects/d3822dc7d617431e8717f1540cc7ed7b/users/88d62ac1032847b2b6181b927a2f5401/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:38.546545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:38.547533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cb8e-da88-415f-85c0-e2ebf3f16cfb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.548842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cb8e-da88-415f-85c0-e2ebf3f16cfb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.551400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cb8e-da88-415f-85c0-e2ebf3f16cfb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.553176 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 724/1469] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:13:38 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:38.554640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263439-4348-40bb-838c-88a90990e5f4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.555596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263439-4348-40bb-838c-88a90990e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.558170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263439-4348-40bb-838c-88a90990e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.624484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9a263439-4348-40bb-838c-88a90990e5f4 None None] MFA Rules not processed for user `6d1ef102da3a4c788abb0aef6b90d0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:38.627417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a263439-4348-40bb-838c-88a90990e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:38.763626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb708-eb70-44e9-9362-65508f1a1978 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:38.883771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 725/1470] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:38.886460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.886923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.887459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.924513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:38.925556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:38.925912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:38.926915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] PATH_INFO: `/v3/projects/429868cfe90f4e1384c1644727499906/users/9f8fcdf35ab541979c17671b12f5f5f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:38.948271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] MFA Rules not processed for user `88d62ac1032847b2b6181b927a2f5401`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:38.951367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:38.960243 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:38.966143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429868cfe90f4e1384c1644727499906, user_id=9f8fcdf35ab541979c17671b12f5f5f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:38.971140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17981471-cb52-4350-8359-da1a62972588 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:39.076290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 746/1471] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:38 2022] PUT /identity/v3/projects/429868cfe90f4e1384c1644727499906/users/9f8fcdf35ab541979c17671b12f5f5f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:39.078542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:39.078542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:39.078542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:39.095486 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 726/1472] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:39.104994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:39.137630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028a93-13e9-412c-924b-c6fb8064195c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:39.138471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:39.151496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:39.168573 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:39.295022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:39.295522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:39.295805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:39.296078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:39.300065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:39.304156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:39.318667 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 747/1473] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:39.320715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:39.323723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:39.347653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d9a59-e880-4a4c-a602-a9d4cf2b5a7e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:39.354926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:39.355576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:39.358106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:39.358106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] PATH_INFO: `/v3/projects/a171f2755be64d048fc4b422798ebc49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:39.358106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a171f2755be64d048fc4b422798ebc49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:39.361446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:39.453993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 727/1474] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:39 2022] POST /identity/v3/projects => generated 371 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:39.454971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:39.625638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123a3b4-86a4-4df7-be06-b5016f583e9c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:39.636338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a171f2755be64d048fc4b422798ebc49', 'request_id': 'req-091d2c90-4ed7-4a8e-8246-f9ff681d858f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:39.727194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:39.729825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:39.730722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:39.731349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:39.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:39.736357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:39.740255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a171f2755be64d048fc4b422798ebc49', 'request_id': 'req-091d2c90-4ed7-4a8e-8246-f9ff681d858f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:39.771103 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 728/1475] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:39.772632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:39.785243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a171f2755be64d048fc4b422798ebc49', 'request_id': 'req-091d2c90-4ed7-4a8e-8246-f9ff681d858f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:39.835342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] The token cache is being invalidate because project a171f2755be64d048fc4b422798ebc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:39.836571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:39.837682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:39.840857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 748/1476] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:39 2022] DELETE /identity/v3/projects/a171f2755be64d048fc4b422798ebc49 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:39.842463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:39.848212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:39.862677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7e9d6-236c-4c9e-816c-39441a7ea05b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:39.865694 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:39.898854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:39.901269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:39.902178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:39.906922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:39.907771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:39.910121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:39.993160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2c90-4ed7-4a8e-8246-f9ff681d858f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.001998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.003611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.004094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.004612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.007069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.078869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 729/1477] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:39 2022] POST /identity/v3/projects => generated 379 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:40.078869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.094081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.157645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.159963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.187714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 749/1478] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:40.189076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.191078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.214772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53d4d-e7eb-49a9-91b7-25ec55b2886d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.238261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba636a-dfd2-4635-a91e-637c8c743ac7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.244945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.245712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.246555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.246555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.247116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.249264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.329530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.330217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.330499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.331830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] PATH_INFO: `/v3/projects/429868cfe90f4e1384c1644727499906/users/9f8fcdf35ab541979c17671b12f5f5f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.336334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] RBAC: Authorizing `identity:create_grant(project_id=429868cfe90f4e1384c1644727499906, user_id=9f8fcdf35ab541979c17671b12f5f5f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.339293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.366016 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 750/1479] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:40 2022] PUT /identity/v3/projects/429868cfe90f4e1384c1644727499906/users/9f8fcdf35ab541979c17671b12f5f5f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:40.367099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.369036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.378629 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 730/1480] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:40 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:40.382644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.387169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.416087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0b576-200c-4571-bab2-45138150264c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.466734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69064d-193f-4dd1-81a3-824b73bb157d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.472992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.473730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.474012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.474574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] PATH_INFO: `/v3/users/24efaa8ae2f04bb5a447d610f7743fdc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.475643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24efaa8ae2f04bb5a447d610f7743fdc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.478323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.491286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.491940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.492245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.492506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.493764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.496232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b3f4e-6127-46bf-b73c-42411340b4de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.666976 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 731/1481] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:40 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:40.668500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.668948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.669051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.703559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] MFA Rules not processed for user `9f8fcdf35ab541979c17671b12f5f5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:40.704927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.738401 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:40.759573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24efaa8ae2f04bb5a447d610f7743fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:40.808447 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 732/1482] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:40.809556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.818463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24efaa8ae2f04bb5a447d610f7743fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:40.821413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24efaa8ae2f04bb5a447d610f7743fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:40.828056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575cf6f-6e7c-4d19-9679-3af4f80b64b9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.839516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:40.840369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.840719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.841100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.842042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:40.848672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24efaa8ae2f04bb5a447d610f7743fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:40.855248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:40.866382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a8ee728-8c49-4a51-a4d1-833e301e9751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24efaa8ae2f04bb5a447d610f7743fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:40.882643 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 751/1483] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:40 2022] DELETE /identity/v3/users/24efaa8ae2f04bb5a447d610f7743fdc => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:40.883841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:40.884127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:40.884400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:40.886749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 733/1484] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:40.888500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:40.899598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:40.917243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044e25c-03cc-4981-b10d-8ea374c9d814 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:40.936195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] MFA Rules not processed for user `056e59c7d4c2475eb66b64e0e24367be`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:40.937592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.019485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.020945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.020945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.020945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.021291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.023140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.036653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 734/1485] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:41.037599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.041554 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 752/1486] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:41.041554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.043444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.045510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.068937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f081173-3921-45fb-b4d7-e0cfe0b41f7a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.084133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.084133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.084133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.084133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] PATH_INFO: `/v3/projects/fa6904046f064899aec9bf3993d5ded7/users/ac3ae7fb69ab45379232774695a255bd/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.103852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6904046f064899aec9bf3993d5ded7, user_id=ac3ae7fb69ab45379232774695a255bd, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.108678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.211109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635223b-317f-436e-832d-0fcf4d55d324 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.212823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 753/1487] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:41 2022] PUT /identity/v3/projects/fa6904046f064899aec9bf3993d5ded7/users/ac3ae7fb69ab45379232774695a255bd/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:41.216644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.337626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.338259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.338601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.338791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.341841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.410272 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:41.424624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2454-f46f-4c2e-91a7-a049f2cb2200 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.441365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.442934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.445761 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:41.447181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.447674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] PATH_INFO: `/v3/projects/1e5347e81d634de7b87b5081c35cc28a/users/adc08512e7da400da8749c431eb269b4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.468187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.473727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.484313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5347e81d634de7b87b5081c35cc28a, user_id=adc08512e7da400da8749c431eb269b4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.488986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.498247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 735/1488] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:41.499149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.501117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.517225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc6dc-3e7b-48ce-92de-2b9eee2ab3cf service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.522620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.523242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.523709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.524145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.524881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.526898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a16aa-f595-4527-8831-a4f3b3410f34 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.575003 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 754/1489] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:41 2022] PUT /identity/v3/projects/1e5347e81d634de7b87b5081c35cc28a/users/adc08512e7da400da8749c431eb269b4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:41.576782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.658139 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 736/1490] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:41 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:41.664660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.665281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.665783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.709032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4050-854d-4c76-b9b6-ff1970a425eb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.756622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:41.760352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:41.818797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.819419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.819854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.820131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.820786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.835573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.836236 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:41.857879 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 755/1491] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:41.859342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.875047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb11ea-9b7e-4b64-a6ca-34b47469715a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.881733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.882703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.883195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.883681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.885112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.887859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:41.900068 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 756/1492] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:41.901804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.920952 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 737/1493] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:41.922254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:41.938613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174e249-bf7d-4b25-b38f-5a74752566dc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:41.946406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:41.947247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:41.947599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:41.947939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:41.948703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:41.950913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.036172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41ce5-b512-4982-b557-520ddd77eb33 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.046553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.047271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.047838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.048212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.051310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:42.074931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 738/1494] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:41 2022] POST /identity/v3/users => generated 308 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:42.076474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:42.100496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b2a1-d2a7-4a9e-8a2a-ad90be6c3050 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.110759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.110759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.110759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.110759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] PATH_INFO: `/v3/projects/fa6904046f064899aec9bf3993d5ded7/users/ac3ae7fb69ab45379232774695a255bd/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.111728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6904046f064899aec9bf3993d5ded7, user_id=ac3ae7fb69ab45379232774695a255bd, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.114604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.139079 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 739/1495] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:42 2022] PUT /identity/v3/projects/fa6904046f064899aec9bf3993d5ded7/users/ac3ae7fb69ab45379232774695a255bd/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:42.139079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:42.172053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.173772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.216014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 757/1496] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:42.216525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:42.238442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcedb9-f9af-4dec-86b7-3b2d697d6dbe service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.273117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea888f33-1a12-4999-bc9c-71039e5ef11d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.279737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.280999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.281505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.282148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] PATH_INFO: `/v3/projects/1e5347e81d634de7b87b5081c35cc28a/users/adc08512e7da400da8749c431eb269b4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.286144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5347e81d634de7b87b5081c35cc28a, user_id=adc08512e7da400da8749c431eb269b4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.291653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444cab-a5c9-4a6b-9eaf-3984e6e28ac6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.306095 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 740/1497] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:42 2022] PUT /identity/v3/projects/1e5347e81d634de7b87b5081c35cc28a/users/adc08512e7da400da8749c431eb269b4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:42.308495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.308970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.309463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.366539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] MFA Rules not processed for user `ac3ae7fb69ab45379232774695a255bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:42.367971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.368972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.369087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:42.369250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.369587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.370250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.372022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.388633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 758/1498] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:42.388633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:42.395091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:42.422957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac301-6923-4f75-b312-fd5ac0a3c0c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.462060 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:42.488693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 741/1499] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:42.489950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:42.491718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:42.564611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.566958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.567193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.567473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] PATH_INFO: `/v3/projects/7cc6b17bab9147488735967e838892ca` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.570363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc6b17bab9147488735967e838892ca)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.578167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.608717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cb4d9-fcdc-4cd5-b02d-6961089f106d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:42.622185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:42.626289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.626738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.627078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] PATH_INFO: `/v3/users/aef20737964b4057bdba12a91ef1c9b7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.630152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef20737964b4057bdba12a91ef1c9b7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:42.633236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:42.736250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc6b17bab9147488735967e838892ca', 'request_id': 'req-70bae95f-1d7c-48e8-aac0-af76a947d44e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.833008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc6b17bab9147488735967e838892ca', 'request_id': 'req-70bae95f-1d7c-48e8-aac0-af76a947d44e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.843300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc6b17bab9147488735967e838892ca', 'request_id': 'req-70bae95f-1d7c-48e8-aac0-af76a947d44e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.861899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef20737964b4057bdba12a91ef1c9b7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.864373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef20737964b4057bdba12a91ef1c9b7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.875165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] The token cache is being invalidate because project 7cc6b17bab9147488735967e838892ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:42.875532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.881771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-70bae95f-1d7c-48e8-aac0-af76a947d44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.891327 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 759/1500] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:42 2022] DELETE /identity/v3/projects/7cc6b17bab9147488735967e838892ca => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:42.891327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:42.891327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:42.894114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:42.904090 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:42.906353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef20737964b4057bdba12a91ef1c9b7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.911685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef20737964b4057bdba12a91ef1c9b7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:42.978123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef20737964b4057bdba12a91ef1c9b7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:43.008372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] MFA Rules not processed for user `adc08512e7da400da8749c431eb269b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:43.009547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.030158 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 742/1501] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:42 2022] DELETE /identity/v3/users/aef20737964b4057bdba12a91ef1c9b7 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:43.030750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:43.036681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.073447 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:43.160132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184450-92ee-41e4-9ca6-cab9fdd4f8e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:43.172259 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 760/1502] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:43.173595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:43.175935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.190748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:43.191998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.192283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.192558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] PATH_INFO: `/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0/users/1ff2e0be0f334ff4acb88d338e278d2b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:43.242860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b74fc3bb2cd47f98eda0ecf030102d0, user_id=1ff2e0be0f334ff4acb88d338e278d2b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:43.245735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:43.296982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93900856-7040-4c12-ad4c-4e329a3da8d1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:43.355336 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 743/1503] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:43 2022] PUT /identity/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0/users/1ff2e0be0f334ff4acb88d338e278d2b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:43.356335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:43.358281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.403965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:43.414055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.414464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.416276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:43.426332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.546571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95573-f04b-419c-9325-2fb9ae2b6184 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:43.563071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:43.564097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.564383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.564662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:43.569810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.619228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:43.623327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:43.657103 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 761/1504] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:13:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:43.658212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:43.662078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.696087 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:43.697906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797729f-e06e-406f-83e4-6d9012c0000a service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:43.704877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:43.709272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36ad34-2e5c-44dc-8d3a-6264757ccf1e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:43.763910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 744/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:43.770822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.773039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.778949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:43.795952 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:43.866314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:43.867520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:43.868520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.869076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.869755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] PATH_INFO: `/v3/users/65ebad647d6d4e8d944b60941642f876` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:43.871214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ebad647d6d4e8d944b60941642f876)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:43.872127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.873717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:43.902292 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 745/1506] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:43.903476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:43.907723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:43.958279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a67e2-bc55-4a55-9530-1dd0cc4adb76 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:43.973937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:43.974554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:43.974831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:43.975100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:44.141871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:44.152914 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:44.155533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:44.171737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ebad647d6d4e8d944b60941642f876'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:44.193974 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 746/1507] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:44.194673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:44.228481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3479a-7d25-4ad5-9917-97530835f21e service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:44.250075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:44.250740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:44.250990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:44.251268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:44.251979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:44.257014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589bd5e-3888-4a3f-a6c0-7e4d0e6196b8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:44.285194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ebad647d6d4e8d944b60941642f876'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:44.285586 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 747/1508] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:44.285891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ebad647d6d4e8d944b60941642f876'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:44.295994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:44.296299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:44.296581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:44.309903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ebad647d6d4e8d944b60941642f876'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:44.344852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ebad647d6d4e8d944b60941642f876'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:44.371024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 762/1509] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:43 2022] DELETE /identity/v3/users/65ebad647d6d4e8d944b60941642f876 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:44.374588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:44.374588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:44.401631 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:44.470809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:44.479271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:44.639639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47a3f3-cb1e-4680-b92b-4f7cb57fa9e7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:44.664100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:44.664100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:44.664100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:44.664100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:44.672287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:44.691843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 748/1510] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 30 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:44.693652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:44.697531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:44.710589 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:45.014824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaf3b5-123a-42e3-adc5-e73708e12589 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:45.014824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:45.014824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:45.014824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:45.015365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] PATH_INFO: `/v3/users/6d1ef102da3a4c788abb0aef6b90d0bc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:45.015365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1ef102da3a4c788abb0aef6b90d0bc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:45.015365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 763/1511] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:45.016466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c724b9b-1417-440d-b612-334fe1931f6d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:45.018538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:45.018538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:45.018538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:45.018538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] PATH_INFO: `/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0/users/1ff2e0be0f334ff4acb88d338e278d2b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:45.019059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b74fc3bb2cd47f98eda0ecf030102d0, user_id=1ff2e0be0f334ff4acb88d338e278d2b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:45.019059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:45.019059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 764/1512] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:44 2022] PUT /identity/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0/users/1ff2e0be0f334ff4acb88d338e278d2b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:45.019059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:45.224720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a025a9-fbae-4801-b5a2-7897742cb789 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:45.224720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:45.224720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:45.224720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:45.225317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:45.225317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:45.225317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:45.225317 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 765/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:45.519945 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:45.635390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1ef102da3a4c788abb0aef6b90d0bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:45.636286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1ef102da3a4c788abb0aef6b90d0bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:45.660953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1ef102da3a4c788abb0aef6b90d0bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:45.662229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1ef102da3a4c788abb0aef6b90d0bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:45.684586 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:45.724447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:45.727572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:45.764244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e0cee41e-d794-4abf-85f5-7fb47b2d5f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1ef102da3a4c788abb0aef6b90d0bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:45.826156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 749/1514] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:44 2022] DELETE /identity/v3/users/6d1ef102da3a4c788abb0aef6b90d0bc => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:45.833737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:45.834798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:45.835756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:45.914856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:45.920666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:46.095733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aed45-7294-4dbc-9212-590db9b3e904 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:46.127461 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:46.278243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 750/1515] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:46.314480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:46.318064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:46.355404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:46.358251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:46.358251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:46.358251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] PATH_INFO: `/v3/users/88d62ac1032847b2b6181b927a2f5401` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:46.370867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d62ac1032847b2b6181b927a2f5401)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:46.375215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:46.495600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c57f-655b-4077-badb-76d2d81ee0e1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:46.506606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:46.507342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:46.507626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:46.507950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:46.519416 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:46.544543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:46.547963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b15c30-84d6-4e90-a109-8cf4cf359e82 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:46.577723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 751/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:46.585115 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:46.696271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683d77-b93f-4f99-92a1-e778edec5e76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:46.696791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683d77-b93f-4f99-92a1-e778edec5e76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:46.697283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683d77-b93f-4f99-92a1-e778edec5e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:46.698123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d62ac1032847b2b6181b927a2f5401'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:46.767065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-73683d77-b93f-4f99-92a1-e778edec5e76 None None] MFA Rules not processed for user `c7334417689847d18bc4c1b27d173a23`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:46.772080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73683d77-b93f-4f99-92a1-e778edec5e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:46.800806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d62ac1032847b2b6181b927a2f5401'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:46.802079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d62ac1032847b2b6181b927a2f5401'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:46.848622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d62ac1032847b2b6181b927a2f5401'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:46.860750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d62ac1032847b2b6181b927a2f5401'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:46.880961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 766/1517] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:45 2022] DELETE /identity/v3/users/88d62ac1032847b2b6181b927a2f5401 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:46.882112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:46.882901 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 752/1518] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:46.887804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:46.888286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:46.889091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:46.898406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:46.934747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:46.936245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:46.984460 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:47.151829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88814b-de71-455e-874d-019f7fd5f325 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.153213 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 753/1519] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:13:47.153721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:47.155632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.163302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.164000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.164289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.164561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] PATH_INFO: `/v3/projects/895de57f9934430d82536a9252f6b39e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.166587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895de57f9934430d82536a9252f6b39e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.172394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fc6b2-7feb-4eab-bb6e-d92cb5368f8f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.174778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.179474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.180119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.180667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.181168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.182113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.188759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.244726 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:47.308220 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 754/1520] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:47 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:47.309367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:47.311718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.407109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895de57f9934430d82536a9252f6b39e', 'request_id': 'req-f6704e05-a3ad-4de3-be24-f5511ed76982'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:47.474977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895de57f9934430d82536a9252f6b39e', 'request_id': 'req-f6704e05-a3ad-4de3-be24-f5511ed76982'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:47.483922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bde41d-0b66-4918-bd8b-1eedd5fb0035 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.490147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895de57f9934430d82536a9252f6b39e', 'request_id': 'req-f6704e05-a3ad-4de3-be24-f5511ed76982'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:47.500346 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:47.534342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] The token cache is being invalidate because project 895de57f9934430d82536a9252f6b39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:47.534342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:47.535310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:47.545383 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 767/1521] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:46 2022] DELETE /identity/v3/projects/895de57f9934430d82536a9252f6b39e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:47.545383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:47.546360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.646248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.646869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.647152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.647465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.655241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.698878 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:47.720847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6704e05-a3ad-4de3-be24-f5511ed76982 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.736403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.737450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.740485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.740957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.742370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.754739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0598dd5-bbff-4e1d-87ac-0c9bd3ce357d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.798206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.799781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.833431 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 755/1522] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:47.834288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:47.835744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.844468 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 768/1523] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:47 2022] POST /identity/v3/users => generated 292 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:47.846108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.846551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.847042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.849582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e62d1-f8cc-4c72-acb0-999a327f2e5e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.855052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.875504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.881446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.881446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] PATH_INFO: `/v3/projects/c605bd2c76b4484990981eb9bd6e9595` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.883896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c605bd2c76b4484990981eb9bd6e9595)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.886552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.901005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:47.902498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:47.918908 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:47.931571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 769/1524] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:47.936484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:47.966163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caff12-e759-4a76-b1e6-59e9a837e454 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:47.973140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:47.974216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.974902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.975571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:47.976781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:47.978814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1703a03-7d99-41d5-b074-db4da26a2584 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:47.994360 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 770/1525] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:47.996243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:47.996741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:47.997618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:48.049247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:48.051965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:48.078557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 771/1526] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:48.079892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:48.093458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b5692-284b-4f44-a23e-4cfe32d63e1f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:48.098769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c605bd2c76b4484990981eb9bd6e9595', 'request_id': 'req-65670560-f85f-47f6-af66-d7c71f506bf3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.108669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c605bd2c76b4484990981eb9bd6e9595', 'request_id': 'req-65670560-f85f-47f6-af66-d7c71f506bf3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.207042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c605bd2c76b4484990981eb9bd6e9595', 'request_id': 'req-65670560-f85f-47f6-af66-d7c71f506bf3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.229118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:48.230081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:48.230599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:48.231034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] PATH_INFO: `/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73/users/2d5a735c942648c1b888e65e07394d0c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:48.231297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] The token cache is being invalidate because project c605bd2c76b4484990981eb9bd6e9595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:48.231742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.233204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.236201 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 756/1527] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:47 2022] DELETE /identity/v3/projects/c605bd2c76b4484990981eb9bd6e9595 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:48.244896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:48.250370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:48.274979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c3a4d65ca4e7d956f9ef4d7fa1a73, user_id=2d5a735c942648c1b888e65e07394d0c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:48.282778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:48.284023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65670560-f85f-47f6-af66-d7c71f506bf3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:48.291656 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:48.299396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:48.305806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:48.305806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:48.305806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:48.305806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:48.305806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:48.308790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:48.341112 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 757/1528] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:48.352625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:48.359660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:48.398169 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 772/1529] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:48 2022] PUT /identity/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73/users/2d5a735c942648c1b888e65e07394d0c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:48.398924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:48.401547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:48.402305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784003e-cd1f-4807-9fc2-6ced98296835 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:48.590064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3d5b-09f9-4be0-bc27-215cf9a2dc5d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:48.602869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:48.604414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:48.604708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:48.605945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] PATH_INFO: `/v3/users/ac3ae7fb69ab45379232774695a255bd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:48.610445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3ae7fb69ab45379232774695a255bd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:48.614185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:48.616117 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:48.670714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:48.671962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:48.672396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:48.673021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] PATH_INFO: `/v3/projects/40fddc54619245cb8359e4648cb25990` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:48.674621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fddc54619245cb8359e4648cb25990)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:48.677831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:48.855347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fddc54619245cb8359e4648cb25990', 'request_id': 'req-e9888f22-9a22-436e-a1f9-e4da4307d4b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.866055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fddc54619245cb8359e4648cb25990', 'request_id': 'req-e9888f22-9a22-436e-a1f9-e4da4307d4b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.869492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3ae7fb69ab45379232774695a255bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.945249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3ae7fb69ab45379232774695a255bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.946352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3ae7fb69ab45379232774695a255bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.968992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3ae7fb69ab45379232774695a255bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:48.983806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3ae7fb69ab45379232774695a255bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.009245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 773/1530] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:48 2022] DELETE /identity/v3/users/ac3ae7fb69ab45379232774695a255bd => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:49.010772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.014855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.044578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fddc54619245cb8359e4648cb25990', 'request_id': 'req-e9888f22-9a22-436e-a1f9-e4da4307d4b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.077627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] The token cache is being invalidate because project 40fddc54619245cb8359e4648cb25990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:49.078113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.079217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.093292 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 758/1531] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:48 2022] DELETE /identity/v3/projects/40fddc54619245cb8359e4648cb25990 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:49.096511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.101101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.235802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888f22-9a22-436e-a1f9-e4da4307d4b3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:49.242367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb0a78-204b-4828-b1fe-8363be9cae24 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:49.245784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:49.246421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.246705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.250200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.250200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:49.250406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:49.250514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaee360-fb73-4442-8e33-5dabafd50f14 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:49.250595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.250595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.250595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.252111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:49.254628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:49.276889 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 759/1532] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:49.278644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.278958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.279229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.281409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 760/1533] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:13:49.282201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.285348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.310429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb835e-5cdf-40c5-85e6-bf8c3c839653 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:49.327042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:49.328305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.328889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.330340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] PATH_INFO: `/v3/users/9f8fcdf35ab541979c17671b12f5f5f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.332066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8fcdf35ab541979c17671b12f5f5f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:49.334792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:49.446286 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 774/1534] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:49 2022] POST /identity/v3/projects => generated 393 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:49.446286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.603173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c79ae-fcf8-4da6-ab6f-b80218fa649e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:49.608700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:49.609429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.609771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.610059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] PATH_INFO: `/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73/users/2d5a735c942648c1b888e65e07394d0c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.613256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c3a4d65ca4e7d956f9ef4d7fa1a73, user_id=2d5a735c942648c1b888e65e07394d0c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:49.619563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdac3-6746-47e6-971a-8b69b1238fd0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:49.640520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 775/1535] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:49 2022] PUT /identity/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73/users/2d5a735c942648c1b888e65e07394d0c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:49.644741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:49.653003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:49.653003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:49.660865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8fcdf35ab541979c17671b12f5f5f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.663673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8fcdf35ab541979c17671b12f5f5f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.683256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:49.684813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.691777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8fcdf35ab541979c17671b12f5f5f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.693836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8fcdf35ab541979c17671b12f5f5f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.781530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8fcdf35ab541979c17671b12f5f5f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:49.841232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 761/1536] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:49 2022] DELETE /identity/v3/users/9f8fcdf35ab541979c17671b12f5f5f1 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:49.842300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.844410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.849542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 776/1537] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:13:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:49.854186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:49.861572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:49.940053 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:50.021087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc5b3-d6ab-487e-be64-51500a6486e2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.055646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719289-2fb1-4130-b8c3-3bec9c155d4f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.079465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.080526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.080999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.081539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] PATH_INFO: `/v3/projects/d3822dc7d617431e8717f1540cc7ed7b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.083547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3822dc7d617431e8717f1540cc7ed7b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.086742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:50.137102 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:50.220124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.220124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.220124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.220124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.223550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.228916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:50.324615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3822dc7d617431e8717f1540cc7ed7b', 'request_id': 'req-278ac363-86c5-41b7-aaec-0d85804a36c1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:50.334501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3822dc7d617431e8717f1540cc7ed7b', 'request_id': 'req-278ac363-86c5-41b7-aaec-0d85804a36c1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:50.396290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 777/1538] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:49 2022] POST /identity/v3/users => generated 297 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:50.398001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:50.408620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:50.438954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3822dc7d617431e8717f1540cc7ed7b', 'request_id': 'req-278ac363-86c5-41b7-aaec-0d85804a36c1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:50.458984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] The token cache is being invalidate because project d3822dc7d617431e8717f1540cc7ed7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:50.459287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:50.461300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:50.465956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 762/1539] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:49 2022] DELETE /identity/v3/projects/d3822dc7d617431e8717f1540cc7ed7b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:50.497244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:50.499687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:50.571080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f2416-8f89-4be3-8d9c-e80a291e67c8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.681992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.684095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.684686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.685655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.688055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:50.705121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.711476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:50.716518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ac363-86c5-41b7-aaec-0d85804a36c1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.749743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.752333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.752623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.753471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.760371 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 778/1540] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:50.760749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.762475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:50.763786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:50.775048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:50.806375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 763/1541] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:50.807046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c6908-fb97-4618-bd32-989ad17826ea service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.808869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:50.813799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:50.821155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.822050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.822433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.823019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] PATH_INFO: `/v3/projects/fa6904046f064899aec9bf3993d5ded7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.826044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6904046f064899aec9bf3993d5ded7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.828381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:50.864410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64365657-1e33-4cf7-8497-5afe1572b04c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:50.895923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:50.896581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:50.896943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:50.897123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] PATH_INFO: `/v3/users/adc08512e7da400da8749c431eb269b4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:50.913271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc08512e7da400da8749c431eb269b4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:50.915552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:51.033501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6904046f064899aec9bf3993d5ded7', 'request_id': 'req-25e012a4-55c6-43ad-91a5-0e0574a91191'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.109974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6904046f064899aec9bf3993d5ded7', 'request_id': 'req-25e012a4-55c6-43ad-91a5-0e0574a91191'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.117855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6904046f064899aec9bf3993d5ded7', 'request_id': 'req-25e012a4-55c6-43ad-91a5-0e0574a91191'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.144584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] The token cache is being invalidate because project fa6904046f064899aec9bf3993d5ded7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:51.145100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.145985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.150021 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 779/1542] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:50 2022] DELETE /identity/v3/projects/fa6904046f064899aec9bf3993d5ded7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:51.151129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:51.155987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.200782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc08512e7da400da8749c431eb269b4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.203283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc08512e7da400da8749c431eb269b4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.228111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc08512e7da400da8749c431eb269b4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.230418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc08512e7da400da8749c431eb269b4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.298502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e012a4-55c6-43ad-91a5-0e0574a91191 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:51.307411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:51.307411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.307775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.308302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.308985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:51.310913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b46d83-c727-4d2d-ae76-3ddef06319fb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:51.327722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 780/1543] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:51.327722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.327722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.327722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.337634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc08512e7da400da8749c431eb269b4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.372272 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 764/1544] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:50 2022] DELETE /identity/v3/users/adc08512e7da400da8749c431eb269b4 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:51.374347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:51.375821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.384441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:51.385304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.516760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 781/1545] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:51.517767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:51.520855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.528257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089d0b-6695-42e1-96d4-17c84c5c099d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:51.544488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5da630-1b07-4966-a947-64d06cf7a394 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:51.546686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:51.552047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.553305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.554709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] PATH_INFO: `/v3/projects/b7ff48e99652419eb70f954a5b0f8144/users/7d245ec1565b466b829170db2a9763b1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.559325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:51.561635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.562126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.563226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] PATH_INFO: `/v3/projects/429868cfe90f4e1384c1644727499906` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.564762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=429868cfe90f4e1384c1644727499906)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:51.570501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:51.607530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff48e99652419eb70f954a5b0f8144, user_id=7d245ec1565b466b829170db2a9763b1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:51.616032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4295129-ef0f-4a8b-8af4-e1a0b1116c15 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:51.733986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 765/1546] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:51 2022] PUT /identity/v3/projects/b7ff48e99652419eb70f954a5b0f8144/users/7d245ec1565b466b829170db2a9763b1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:51.738915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5f88-d7d5-43ca-a87b-e37497749127 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.740043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5f88-d7d5-43ca-a87b-e37497749127 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.744463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5f88-d7d5-43ca-a87b-e37497749127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.767086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c64c5f88-d7d5-43ca-a87b-e37497749127 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:51.769101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c64c5f88-d7d5-43ca-a87b-e37497749127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.785033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429868cfe90f4e1384c1644727499906', 'request_id': 'req-4774900f-9d88-455a-8b1e-c1ab544c2f4a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.911410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429868cfe90f4e1384c1644727499906', 'request_id': 'req-4774900f-9d88-455a-8b1e-c1ab544c2f4a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.921277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429868cfe90f4e1384c1644727499906', 'request_id': 'req-4774900f-9d88-455a-8b1e-c1ab544c2f4a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.931740 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 766/1547] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:51.934468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939ae72-4658-49b6-b235-0ed61b575235 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:51.936512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939ae72-4658-49b6-b235-0ed61b575235 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:51.937009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939ae72-4658-49b6-b235-0ed61b575235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:51.948592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] The token cache is being invalidate because project 429868cfe90f4e1384c1644727499906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:51.952234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.952234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:51.952234 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 782/1548] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:51 2022] DELETE /identity/v3/projects/429868cfe90f4e1384c1644727499906 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:51.954073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:51.960508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:51.998994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774900f-9d88-455a-8b1e-c1ab544c2f4a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.004514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4939ae72-4658-49b6-b235-0ed61b575235 None None] MFA Rules not processed for user `7d245ec1565b466b829170db2a9763b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:52.005872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4939ae72-4658-49b6-b235-0ed61b575235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:52.012608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.017434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677001-7e0e-4834-b91c-91fdeac20bec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.051960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 783/1549] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:52.053239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bc5db-758c-4821-8788-276ee859812c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.053651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bc5db-758c-4821-8788-276ee859812c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.054019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bc5db-758c-4821-8788-276ee859812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.075830 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:52.140654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-388bc5db-758c-4821-8788-276ee859812c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:52.142846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-388bc5db-758c-4821-8788-276ee859812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:52.151761 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:52.186960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 784/1550] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:52.187939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bc5db-758c-4821-8788-276ee859812c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.215504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 767/1551] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:52.215504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.215504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.215504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.216966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bc5db-758c-4821-8788-276ee859812c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.235141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.249204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.249204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.249204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.249204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.249204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.271246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:52.276529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:52.306305 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 768/1552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:52.306305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.309007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:52.328121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78507cc9-47af-42d6-acf7-bd799322b434 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.334783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.335404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.335717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.336001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.336651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.340614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.476961 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 769/1553] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:52.478661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.488360 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 785/1554] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/projects => generated 401 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:52.497578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.617990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b5bfc-93b2-4b39-be13-9ae9a9609474 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.734864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee428eb-f594-4f78-b264-9a7e145b1caf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.744561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.745896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.746180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.748227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.748953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.751091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.819956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.820588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.820840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.821123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.821872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:52.822179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.824084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.856995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 770/1555] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:52.856995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.897293 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 786/1556] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/users => generated 303 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:52.898427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:52.923541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece461-ae2d-4155-bfde-9a5aaec85f10 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.934337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d32eb-0949-4e8c-a983-94a35bba7dc0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:52.935288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.935940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.936822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.937103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.937825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.939919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:52.947632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:52.951911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:52.951911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:52.951911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:52.951911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:52.951911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.139057 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 771/1557] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/users => generated 301 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:53.140063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.144977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 787/1558] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:52 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:53.145949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.158442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:53.178548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4afa96-42e8-4b32-994d-3e02c520ac8d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.261824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30c858-b5c2-458b-a387-19ebd15b1374 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.270488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.271355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.271830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.272177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] PATH_INFO: `/v3/projects/1e5347e81d634de7b87b5081c35cc28a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.274551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5347e81d634de7b87b5081c35cc28a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.276979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.307734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.315903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.316491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.316973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.317918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.321783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.356111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 772/1559] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:53.356111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.373732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62163c-4a39-4b89-a557-0411ffb34c1e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.388356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.389025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.389322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.389649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.390353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.392582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.412261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 773/1560] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:53.412261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.442587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa11b-b0af-4aef-80e5-503cf6cd50a0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.471624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5347e81d634de7b87b5081c35cc28a', 'request_id': 'req-14478e87-1d1a-4b97-8695-99e51dc3ef56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:53.572934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.573642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.573925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.574192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.574855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.578928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5347e81d634de7b87b5081c35cc28a', 'request_id': 'req-14478e87-1d1a-4b97-8695-99e51dc3ef56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:53.588881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5347e81d634de7b87b5081c35cc28a', 'request_id': 'req-14478e87-1d1a-4b97-8695-99e51dc3ef56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:53.590236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.613823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] The token cache is being invalidate because project 1e5347e81d634de7b87b5081c35cc28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:13:53.614189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:53.615985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:53.618328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 788/1561] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:53 2022] DELETE /identity/v3/projects/1e5347e81d634de7b87b5081c35cc28a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:53.619413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.624644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:53.645933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14478e87-1d1a-4b97-8695-99e51dc3ef56 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.680677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.681634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.683214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.701305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] PATH_INFO: `/v3/projects/f40a3893301c428286d5c6b7eac24e7c/users/e1dda383cf1c453daba28b4bcb40922a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.705050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 774/1562] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:53 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:53.705861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.710556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:53.731638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69e48-fa34-4734-99aa-5265f0282426 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:53.738982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:53.739790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.740206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.740561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.741325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a3893301c428286d5c6b7eac24e7c, user_id=e1dda383cf1c453daba28b4bcb40922a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.741837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:53.743305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8118e1-4d0a-44c6-842c-624ca5df5924 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.751062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:53.758913 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 775/1563] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:53.761070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:53.761714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:53.762073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:53.811893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:53.816528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:53.844263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 776/1564] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:53.845195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.855025 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 789/1565] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:53 2022] PUT /identity/v3/projects/f40a3893301c428286d5c6b7eac24e7c/users/e1dda383cf1c453daba28b4bcb40922a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:53.856200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:53.863259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:53.893909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9cf75-85e4-41c4-9782-4410b3cc80c4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.053223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc2a7-41fd-4ca0-9f46-b227e8f80e56 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.067325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.068207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.070869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.071274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.072007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.072138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.072958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.073427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.073880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] PATH_INFO: `/v3/projects/2aad025de45d418183825f27941e622a/users/550f5106963b4d97a9effec784ee155d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.074745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47d0a6-7406-45b9-b8aa-f65ed57140b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.103771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 777/1566] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:54.106879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.108252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.109661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.119341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aad025de45d418183825f27941e622a, user_id=550f5106963b4d97a9effec784ee155d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.119341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.184559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:54.187455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:54.212075 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 790/1567] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:53 2022] PUT /identity/v3/projects/2aad025de45d418183825f27941e622a/users/550f5106963b4d97a9effec784ee155d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:54.212948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.228802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 778/1568] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:54.230766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.261468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7256-3518-4e05-b334-a41f8e8f27af None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.283779 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:54.386350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.387375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.387859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.388644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.389660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.391717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516f95a-d64c-4f4d-9837-7d28381e5657 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.404126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d7d40-acbd-4705-b115-db112254a621 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.416962 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:54.421157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.421157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.421157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.421614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.422211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.424259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.425864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 779/1569] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:54.428904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.432103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.433928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.449908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 791/1570] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:54.449908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.491786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87f25-8a92-4572-8da8-aeaf530c24d7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.512018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.514250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] MFA Rules not processed for user `550f5106963b4d97a9effec784ee155d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:54.515308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.517415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.524486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:54.524627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.524627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:13:54.524627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.536419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.583547 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 792/1571] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:13:54.598196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.652561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c513808-1823-470e-86db-efe049c42bc9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.665106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.667648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.667951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.668817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] PATH_INFO: `/v3/projects/72a83b0b15194aa69fc4d82876a1e6fd/users/464f9e9314154e3f9c779b9ae10b2a73/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.696582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a83b0b15194aa69fc4d82876a1e6fd, user_id=464f9e9314154e3f9c779b9ae10b2a73, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.696582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.705130 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 780/1572] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:54.706945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.739112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97e7d4-80c5-47bb-bf03-6ec50b64ce2d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:54.752039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:54.753982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:54.754351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:54.754963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] PATH_INFO: `/v3/projects/f40a3893301c428286d5c6b7eac24e7c/users/e1dda383cf1c453daba28b4bcb40922a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:54.761681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40a3893301c428286d5c6b7eac24e7c, user_id=e1dda383cf1c453daba28b4bcb40922a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:54.774468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:54.780175 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 793/1573] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:54 2022] PUT /identity/v3/projects/72a83b0b15194aa69fc4d82876a1e6fd/users/464f9e9314154e3f9c779b9ae10b2a73/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:54.781254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.818697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 781/1574] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:54 2022] PUT /identity/v3/projects/f40a3893301c428286d5c6b7eac24e7c/users/e1dda383cf1c453daba28b4bcb40922a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:54.824238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:54.977847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b8369-f320-42d6-b5d4-b979336a6e32 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:55.012977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb560d-6012-4925-a0bd-d12f1018f565 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:55.030954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:55.032198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:55.032753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:55.032962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:55.033827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:55.040062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0e870-4637-44cf-a084-b18a73284dbe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:55.112816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:55.113473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:55.113971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:55.114085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:55.114679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:55.116607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5db0f-1dc3-4cfc-987b-d57530f9bff7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:55.161185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 782/1575] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:54 2022] POST /identity/v3/projects => generated 403 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:55.162789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:55.164178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:55.165953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:55.273258 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 794/1576] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:54 2022] POST /identity/v3/projects => generated 387 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:55.274573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:55.274860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:55.275133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:55.292848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] MFA Rules not processed for user `464f9e9314154e3f9c779b9ae10b2a73`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:55.296754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:55.379307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] MFA Rules not processed for user `e1dda383cf1c453daba28b4bcb40922a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:55.389394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:55.433559 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:55.460005 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:55.620567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 783/1577] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:55.621666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:55.760746 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 795/1578] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:55.763213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:55.834726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54af79-c178-4661-8edd-4bdb59c5a455 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:55.840168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:55.840836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:55.841116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:55.841713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:55.842058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:55.845251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:55.962148 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:55.976065 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 784/1579] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:55 2022] POST /identity/v3/users => generated 308 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:55.977787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:55.984318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d168c0-eb5a-49e2-918f-8cdbfd2117f2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:55.999085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.000127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.000559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.000770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82ceb-3717-468c-9cee-f6c183b1ecfb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.001152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.001965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.004216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.023214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.025054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.025970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.026287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.026976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.029960 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:56.033844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.134212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 796/1580] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:55 2022] POST /identity/v3/users => generated 294 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:56.135324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.147591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657d9c-37c3-4633-9e7e-1c0d610ef915 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.154434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.156182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.156628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.157049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] PATH_INFO: `/v3/users/7d245ec1565b466b829170db2a9763b1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.158559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d245ec1565b466b829170db2a9763b1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.161269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.165260 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 785/1581] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:55 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:56.169910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.442882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce35aa8-f004-42e1-be24-aaaea253a012 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.446508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d245ec1565b466b829170db2a9763b1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:56.463069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.465159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.465583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.465941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.467429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.470999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.476352 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:56.500685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 786/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:56.502007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.521480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79a4ea-9095-4cd7-9aa7-b687d5dd5dfe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.528375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.529125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.529580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.529927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.531176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.534736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.549017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d245ec1565b466b829170db2a9763b1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:56.551399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d245ec1565b466b829170db2a9763b1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:56.555767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 787/1583] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:56.557715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.559799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:56.585435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d245ec1565b466b829170db2a9763b1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:56.588656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1479ca-60e2-408a-b7b8-b99b935510ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.594947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d245ec1565b466b829170db2a9763b1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:13:56.605963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.608224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.611043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.611695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.612934 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 797/1584] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:13:56 2022] DELETE /identity/v3/users/7d245ec1565b466b829170db2a9763b1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:56.614048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.614407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.616469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:56.621715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.639039 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:56.741326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05e553-4b40-4f53-9bba-2deac03f17a9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.752625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.753941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.754140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.754419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] PATH_INFO: `/v3/projects/ed039927d56a4fd282f80303e1b05002/users/f1347abbbbbb4038ad3cf84c40e73a55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.762688 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 788/1585] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:56 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:56.763768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.771371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:56.791714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed039927d56a4fd282f80303e1b05002, user_id=f1347abbbbbb4038ad3cf84c40e73a55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.794459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.814978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13216b4-937f-4d64-a100-1acc9dd36759 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:56.825099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:56.826048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.826396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.827795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.829133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:56.836891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ef3f1-a0ab-4fe3-9a5e-3451f0b3d586 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:56.871161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 789/1586] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:56.873592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:56.877402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:56.877402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:56.897947 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 798/1587] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:56 2022] PUT /identity/v3/projects/ed039927d56a4fd282f80303e1b05002/users/f1347abbbbbb4038ad3cf84c40e73a55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:56.899073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:56.954515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:56.956836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:57.051215 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:57.131707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7e8c-86ae-43a4-8e99-6c452b67e714 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.153061 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 790/1588] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:57.154202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:57.174423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.174807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.175663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.175934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.176607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.178495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.180010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eae934-58fb-4d09-9cec-ea2d5b7b9c93 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.200363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.201422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.202984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.202984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] PATH_INFO: `/v3/projects/c669e8bdf0104ba0bd8833a30b3af61d/users/add7b1afe7684147a6c1ae627c422b2a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.215901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 799/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:57.216892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:57.240702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c669e8bdf0104ba0bd8833a30b3af61d, user_id=add7b1afe7684147a6c1ae627c422b2a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.244033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.262989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33e5f4-9e44-403a-a721-2ab0f1da63a1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.275599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.276227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.276521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.276781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.277469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.279097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.307944 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 800/1590] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:57.310114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:57.334274 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 791/1591] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:57 2022] PUT /identity/v3/projects/c669e8bdf0104ba0bd8833a30b3af61d/users/add7b1afe7684147a6c1ae627c422b2a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:57.335476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:57.348204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:57.348455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac428bf-bc09-4e42-97c7-b19b1c362c0b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.509160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.510248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.511321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.511784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] PATH_INFO: `/v3/projects/b3dd7611342d442aa6828ec2659988d7/users/a1274b7f71f04b05ba1753727d2367d1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.513805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169f9ba-9375-4985-90d6-ecf819c39134 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.523312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.524553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.525445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.525777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.547410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dd7611342d442aa6828ec2659988d7, user_id=a1274b7f71f04b05ba1753727d2367d1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.550933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.551479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344c46f-a998-43b9-8888-f82e7a10c907 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.552504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.587435 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 792/1592] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:57.588403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:57.609250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb80d2-9d29-48ae-8e7b-148beb897d5c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:57.619835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:57.620585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.620920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.621296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] PATH_INFO: `/v3/projects/ed039927d56a4fd282f80303e1b05002/users/f1347abbbbbb4038ad3cf84c40e73a55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.623991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed039927d56a4fd282f80303e1b05002, user_id=f1347abbbbbb4038ad3cf84c40e73a55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:57.631825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bfa3b-fd84-4cca-9f12-e8bb3a6a22f8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:57.665389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 793/1593] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:57 2022] PUT /identity/v3/projects/ed039927d56a4fd282f80303e1b05002/users/f1347abbbbbb4038ad3cf84c40e73a55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:57.665389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.665389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.665389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.738919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 801/1594] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:57 2022] PUT /identity/v3/projects/b3dd7611342d442aa6828ec2659988d7/users/a1274b7f71f04b05ba1753727d2367d1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:57.738919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:57.738919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:57.738919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:57.739433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] MFA Rules not processed for user `add7b1afe7684147a6c1ae627c422b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:57.739433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:57.853487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] MFA Rules not processed for user `f1347abbbbbb4038ad3cf84c40e73a55`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:57.853487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:57.860754 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:57.988569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 794/1595] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:57.989542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:58.018362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 802/1596] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:58.023745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:58.226279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70d53-9b4f-4431-8770-d2cf9b9c3fc4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:58.251243 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:58.252499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:58.253141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.253518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.253860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.254616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:58.257534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:58.268367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b83ed-8aeb-45d0-9437-af326a7c179e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:58.293908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:58.294671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.294950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.295223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.296200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:58.297622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:58.339400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 795/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:58.340418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:58.342463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:58.417026 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 803/1598] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:13:58 2022] POST /identity/v3/projects => generated 391 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:58.417938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:58.527987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9bd70-66bc-4ea5-beba-aad912c056a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:58.639667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881130f-05aa-4846-975b-b9c0cef36d4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:58.646541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:58.648662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.649282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.649877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] PATH_INFO: `/v3/projects/b3dd7611342d442aa6828ec2659988d7/users/a1274b7f71f04b05ba1753727d2367d1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.657516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dd7611342d442aa6828ec2659988d7, user_id=a1274b7f71f04b05ba1753727d2367d1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:58.672839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:58.689546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:58.690745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.693907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.694374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.712568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 804/1599] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:58 2022] PUT /identity/v3/projects/b3dd7611342d442aa6828ec2659988d7/users/a1274b7f71f04b05ba1753727d2367d1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:13:58.727882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:58.865571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:58.867374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9749-8fb5-4001-aad6-a5da5a06b3b6 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:58.895377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08ba3-5d2a-4ad8-a892-692ccaaf2c85 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:58.905883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 796/1600] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:58 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:58.905883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7cb-f4e6-4588-babb-22f0fb55007d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.905883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7cb-f4e6-4588-babb-22f0fb55007d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.905883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada7cb-f4e6-4588-babb-22f0fb55007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.930045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:58.934514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:58.941465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:58.941465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:58.941465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:58.945234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:59.031826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b6ada7cb-f4e6-4588-babb-22f0fb55007d None None] MFA Rules not processed for user `a1274b7f71f04b05ba1753727d2367d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:59.033161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b6ada7cb-f4e6-4588-babb-22f0fb55007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:59.047498 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 805/1601] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:13:58 2022] POST /identity/v3/users => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:13:59.048976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:59.052746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:59.296074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e0ca4-6f2c-4716-9030-4e9933c0a908 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:59.313146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:59.313833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:59.314130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:59.314385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:59.320970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:59.467246 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:59.501180 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:59.521166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:59.526520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:59.561749 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 806/1602] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:13:59 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:13:59.566590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:59.600569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2a533-c462-4b87-872a-621e4e89ea88 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:59.627235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 797/1603] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 725 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:59.637374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:59.637374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:59.637374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:59.638793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:59.639573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:59.639859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:59.640129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:59.640892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:59.642522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:13:59.662057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 807/1604] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:13:59.670470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:59.681586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] MFA Rules not processed for user `464f9e9314154e3f9c779b9ae10b2a73`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:13:59.682382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:59.691337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cff83-3d7b-44bb-b77d-4635f82e3846 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:59.720176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:59.720848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:59.721126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:59.721422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] PATH_INFO: `/v3/projects/cde1722754b44bf28f11e48b228d8e2d/users/6e4716dc01b74d279da20fd1f4e44ec2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:59.859432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 798/1605] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:13:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:13:59.865089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:13:59.865089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:13:59.900057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad7711-4001-4016-9b17-fec5d9b6e422 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:13:59.913493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:13:59.914151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:13:59.914430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:13:59.914710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] PATH_INFO: `/v3/projects/b7ff48e99652419eb70f954a5b0f8144` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:13:59.918978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ff48e99652419eb70f954a5b0f8144)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:13:59.924952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.080424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde1722754b44bf28f11e48b228d8e2d, user_id=6e4716dc01b74d279da20fd1f4e44ec2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:00.088663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.100703 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:00.125586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ff48e99652419eb70f954a5b0f8144', 'request_id': 'req-48a89d17-49d3-4886-b483-fa95a0db95f5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.144573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ff48e99652419eb70f954a5b0f8144', 'request_id': 'req-48a89d17-49d3-4886-b483-fa95a0db95f5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.208112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ff48e99652419eb70f954a5b0f8144', 'request_id': 'req-48a89d17-49d3-4886-b483-fa95a0db95f5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.215156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 808/1606] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:13:59 2022] PUT /identity/v3/projects/cde1722754b44bf28f11e48b228d8e2d/users/6e4716dc01b74d279da20fd1f4e44ec2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:00.215887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.238675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] The token cache is being invalidate because project b7ff48e99652419eb70f954a5b0f8144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:00.238675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.240349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.248825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 799/1607] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:13:59 2022] DELETE /identity/v3/projects/b7ff48e99652419eb70f954a5b0f8144 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:00.250645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.257617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:00.394571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667932b-940d-4b72-b30c-c6e573d4e0d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:00.409629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:00.411477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:00.411825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:00.412335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:00.415348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:00.436411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d17-49d3-4886-b483-fa95a0db95f5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:00.516483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:00.516483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:00.516483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:00.516483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:00.517270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:00.520212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.533794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 800/1608] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:00.535721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.540556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:00.559661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b19bd-55b2-45cc-9c70-84b80c3e1957 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:00.567075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:00.568223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:00.569007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:00.569435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d2fa-7c25-4c19-8d79-e7cb6d91da3e service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.569564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:00.569779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] PATH_INFO: `/v3/users/e1dda383cf1c453daba28b4bcb40922a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:00.571330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dda383cf1c453daba28b4bcb40922a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:00.573309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.582833 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 809/1609] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:00.584532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:00.585039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:00.585406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:00.647685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] MFA Rules not processed for user `1ff2e0be0f334ff4acb88d338e278d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:00.650934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:00.779257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 810/1610] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:00.779257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.787246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a254dc-3983-40db-85fd-bbf61d09425a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:00.793369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:00.795345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:00.796172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:00.796172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] PATH_INFO: `/v3/projects/cde1722754b44bf28f11e48b228d8e2d/users/6e4716dc01b74d279da20fd1f4e44ec2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:00.798315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde1722754b44bf28f11e48b228d8e2d, user_id=6e4716dc01b74d279da20fd1f4e44ec2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:00.803653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:00.809249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dda383cf1c453daba28b4bcb40922a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.810886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dda383cf1c453daba28b4bcb40922a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.825424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 811/1611] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:00 2022] PUT /identity/v3/projects/cde1722754b44bf28f11e48b228d8e2d/users/6e4716dc01b74d279da20fd1f4e44ec2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:00.825424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.825424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:00.837868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dda383cf1c453daba28b4bcb40922a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.840566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dda383cf1c453daba28b4bcb40922a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.936947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dda383cf1c453daba28b4bcb40922a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:00.952206 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:00.979049 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 801/1612] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:00 2022] DELETE /identity/v3/users/e1dda383cf1c453daba28b4bcb40922a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:00.993501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:00.999070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.008013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ae9bc-6487-48d9-961f-b3d2ee237f25 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:01.022526 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.123915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f87ec-b9ac-48b9-828b-927769a28a66 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:01.132846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:01.133660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:01.134065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:01.134440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:01.137412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.190951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:01.190951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:01.190951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:01.190951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] PATH_INFO: `/v3/users/550f5106963b4d97a9effec784ee155d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:01.191403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=550f5106963b4d97a9effec784ee155d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:01.193416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:01.260799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:01.262554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7947ae-930c-4fc9-84a5-c6a427858e58 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:01.302763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 802/1613] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:01.304143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:01.304432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:01.304713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:01.314087 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.372593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] MFA Rules not processed for user `6e4716dc01b74d279da20fd1f4e44ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:01.377925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.397216 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.452420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550f5106963b4d97a9effec784ee155d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:01.527613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550f5106963b4d97a9effec784ee155d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:01.528497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550f5106963b4d97a9effec784ee155d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:01.541718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 803/1614] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:01.543381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:01.548540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.551078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550f5106963b4d97a9effec784ee155d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:01.573691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92a613a8-c47b-4c66-8ed9-bd1e9bf2c61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550f5106963b4d97a9effec784ee155d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:01.590405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9f207-a35b-4c6c-a945-3bac9b00483b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:01.591418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 812/1615] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:00 2022] DELETE /identity/v3/users/550f5106963b4d97a9effec784ee155d => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:01.599618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:01.600092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:01.600527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:01.662569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:01.664314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.721288 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.748396 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:01.806272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 813/1616] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:01.814867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:01.814867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:01.814867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:01.814867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:01.819494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.823849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:01.826956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:01.999768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0ab63-c573-4962-bc14-af98a2c1681e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:02.011073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:02.011720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:02.012061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:02.012443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:02.038106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:02.042193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:02.101731 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 814/1617] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:02.106562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:02.108574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:02.143348 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 804/1618] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:01 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:02.191318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:02.192824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:02.217771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a012a76-c311-46e8-b344-75e6268f385b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:02.243692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:02.244214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:02.244887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:02.245308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] PATH_INFO: `/v3/projects/f40a3893301c428286d5c6b7eac24e7c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:02.246691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40a3893301c428286d5c6b7eac24e7c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:02.248924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:02.254704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:02.254704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:02.283015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7ff2a-b9b4-42b4-9d55-9a2c5500d0a4 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:02.298411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:02.299358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:02.300767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:02.301251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:02.304893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:02.309825 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:02.396578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:02.398223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be3fd1-aa32-4bdf-847a-927661a2faef service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:02.412761 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 805/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:02.476282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40a3893301c428286d5c6b7eac24e7c', 'request_id': 'req-f8615587-56f0-4c36-b60c-7f1379997ae5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:02.579614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40a3893301c428286d5c6b7eac24e7c', 'request_id': 'req-f8615587-56f0-4c36-b60c-7f1379997ae5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:02.593727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40a3893301c428286d5c6b7eac24e7c', 'request_id': 'req-f8615587-56f0-4c36-b60c-7f1379997ae5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:02.629976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] The token cache is being invalidate because project f40a3893301c428286d5c6b7eac24e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:02.630189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:02.633157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:02.644383 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 815/1620] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:02 2022] DELETE /identity/v3/projects/f40a3893301c428286d5c6b7eac24e7c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:02.646477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e454c6-021d-4fd7-8b1b-e7bc39d8720b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:02.646995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e454c6-021d-4fd7-8b1b-e7bc39d8720b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:02.647176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e454c6-021d-4fd7-8b1b-e7bc39d8720b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:02.660632 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:02.754536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-06e454c6-021d-4fd7-8b1b-e7bc39d8720b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:02.760008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-06e454c6-021d-4fd7-8b1b-e7bc39d8720b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:02.846074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:02.851133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:02.959732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 806/1621] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:02.967385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:02.967675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:02.967929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:03.017080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:03.018390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:03.029403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 807/1622] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:03.032911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:03.052543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ea8a-e947-4a06-9478-d409f8840108 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:03.058445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:03.059580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:03.060549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:03.061049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:03.061964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:03.062474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:03.064723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:03.096513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 808/1623] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:03.101093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:03.117897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c7adc-892c-417b-806a-6f7c8b77a638 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:03.125019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:03.126042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:03.126527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:03.127000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:03.128506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:03.130955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:03.138284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8615587-56f0-4c36-b60c-7f1379997ae5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:03.144483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:03.145482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:03.145969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:03.146461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] PATH_INFO: `/v3/users/add7b1afe7684147a6c1ae627c422b2a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:03.148029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add7b1afe7684147a6c1ae627c422b2a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:03.150280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:03.523479 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:04.038138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 809/1624] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:03 2022] POST /identity/v3/projects => generated 389 bytes in 935 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:04.038138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:04.040184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.154473 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:04.184720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0c810-1bd8-45be-bf54-26fc4e7d6131 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:04.190146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:04.190880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:04.191164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:04.191452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] PATH_INFO: `/v3/projects/2aad025de45d418183825f27941e622a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:04.192790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aad025de45d418183825f27941e622a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:04.195087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:04.214979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add7b1afe7684147a6c1ae627c422b2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.325179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add7b1afe7684147a6c1ae627c422b2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.326442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add7b1afe7684147a6c1ae627c422b2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.377540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add7b1afe7684147a6c1ae627c422b2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.411074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add7b1afe7684147a6c1ae627c422b2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.433961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aad025de45d418183825f27941e622a', 'request_id': 'req-e01235da-3d2b-443a-8545-7d58888496fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.438379 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 816/1625] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:02 2022] DELETE /identity/v3/users/add7b1afe7684147a6c1ae627c422b2a => generated 0 bytes in 1593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:04.439504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:04.444206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.457154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aad025de45d418183825f27941e622a', 'request_id': 'req-e01235da-3d2b-443a-8545-7d58888496fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.601476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aad025de45d418183825f27941e622a', 'request_id': 'req-e01235da-3d2b-443a-8545-7d58888496fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.617015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844b5b9-607a-4476-af5d-aa6634bf7114 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:04.622567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] The token cache is being invalidate because project 2aad025de45d418183825f27941e622a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:04.623763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.624844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e01235da-3d2b-443a-8545-7d58888496fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:04.630557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 810/1626] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:04 2022] DELETE /identity/v3/projects/2aad025de45d418183825f27941e622a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:04.632839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:04.633063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:04.633778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:04.633896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:04.634020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:04.634112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:04.634112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:04.635262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:04.637218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:04.675146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:04.676600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.692611 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 811/1627] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:04.692611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:04.692611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.707958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d540e10-1cc4-4e13-bee6-c076d1726f38 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:04.717681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:04.718568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:04.720469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:04.721040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] PATH_INFO: `/v3/users/f1347abbbbbb4038ad3cf84c40e73a55` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:04.723307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1347abbbbbb4038ad3cf84c40e73a55)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:04.726510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:04.801019 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 817/1628] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:04 2022] POST /identity/v3/users => generated 295 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:04.803632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:04.805737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.912153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fca00f-69b4-46a9-9f44-b4bb0965ef8d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:04.919714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:04.920595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:04.920941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:04.921374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:04.932297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:04.934218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:04.947703 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 818/1629] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:04.948406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:04.950010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:04.993297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5f40b-fde4-4a5f-b804-ea1251f98a5a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:05.000893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1347abbbbbb4038ad3cf84c40e73a55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:05.006290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1347abbbbbb4038ad3cf84c40e73a55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:05.016063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1347abbbbbb4038ad3cf84c40e73a55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:05.018094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:05.018642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1347abbbbbb4038ad3cf84c40e73a55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:05.019268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.019553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.019823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.020478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:05.022124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:05.049115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 819/1630] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:05.052929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:05.057530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.122272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c351bb-ff26-4bc5-a216-1178a03a4c05 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:05.134923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:05.137701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.138185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.138464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.140978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:05.142854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f7439-f3af-46ca-92d2-d4f53aaac94d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:05.161586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1347abbbbbb4038ad3cf84c40e73a55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:05.166782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 820/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:05.170091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ee28-b70d-4da1-a186-400cdb6fe3cf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.171235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ee28-b70d-4da1-a186-400cdb6fe3cf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.172520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7ee28-b70d-4da1-a186-400cdb6fe3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.183990 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 812/1632] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:04 2022] DELETE /identity/v3/users/f1347abbbbbb4038ad3cf84c40e73a55 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:05.185016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:05.213859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dcc7ee28-b70d-4da1-a186-400cdb6fe3cf None None] MFA Rules not processed for user `2d5a735c942648c1b888e65e07394d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:05.215589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dcc7ee28-b70d-4da1-a186-400cdb6fe3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.353620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 821/1633] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:05.360783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.362996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.362996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.395865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b322-9f3e-46e5-88a2-b0dff3af1993 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:05.408782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:05.411527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.412385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.414879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] PATH_INFO: `/v3/projects/1c467cf21efd4aadbf05ded4ff3d2f40/users/fc425a8158474f1fae8733437a74eb9f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.420240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] MFA Rules not processed for user `c7334417689847d18bc4c1b27d173a23`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:05.421372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.472900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c467cf21efd4aadbf05ded4ff3d2f40, user_id=fc425a8158474f1fae8733437a74eb9f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:05.486557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1debd-9761-41a5-89fa-623568bf66cd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:05.556326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 822/1634] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:05.580052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:05.582127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.627225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 813/1635] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:05 2022] PUT /identity/v3/projects/1c467cf21efd4aadbf05ded4ff3d2f40/users/fc425a8158474f1fae8733437a74eb9f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:05.639149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.639446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.639734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.731204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cf02e-2282-482f-bbff-af444fea9d06 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:05.734754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] MFA Rules not processed for user `fc425a8158474f1fae8733437a74eb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:05.735995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.785281 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:05.908254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135b2c-2373-41af-836d-714b481323ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:05.911476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135b2c-2373-41af-836d-714b481323ca service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:05.913133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135b2c-2373-41af-836d-714b481323ca service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:05.913539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135b2c-2373-41af-836d-714b481323ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:05.919449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-16135b2c-2373-41af-836d-714b481323ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.942704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 814/1636] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:05.943647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:05.951481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:05.973770 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:06.033354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16135b2c-2373-41af-836d-714b481323ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.035701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16135b2c-2373-41af-836d-714b481323ca service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.074254 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 823/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:06.077941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135b2c-2373-41af-836d-714b481323ca service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:06.164546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de380e-916b-48e6-9fa7-7ead071a52fe None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:06.176852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:06.177967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:06.180052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:06.180492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] PATH_INFO: `/v3/projects/c669e8bdf0104ba0bd8833a30b3af61d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:06.182728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c669e8bdf0104ba0bd8833a30b3af61d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.190819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.318381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135b2c-2373-41af-836d-714b481323ca service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:06.323845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:06.325560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:06.326013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:06.326428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:06.327371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.339532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.410848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c669e8bdf0104ba0bd8833a30b3af61d', 'request_id': 'req-abe2c7d0-170c-42a3-874f-d412d36191ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.418883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c669e8bdf0104ba0bd8833a30b3af61d', 'request_id': 'req-abe2c7d0-170c-42a3-874f-d412d36191ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.466654 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 824/1638] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:06 2022] POST /identity/v3/projects => generated 389 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:06.470579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:06.478009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:06.538999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c669e8bdf0104ba0bd8833a30b3af61d', 'request_id': 'req-abe2c7d0-170c-42a3-874f-d412d36191ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.563321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] The token cache is being invalidate because project c669e8bdf0104ba0bd8833a30b3af61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:06.563500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.567663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.574680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 815/1639] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:05 2022] DELETE /identity/v3/projects/c669e8bdf0104ba0bd8833a30b3af61d => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:06.585656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:06.585656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:06.660770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae65988-4199-47e8-a730-33d5896c2ea3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:06.674963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:06.676765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:06.676765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:06.676765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] PATH_INFO: `/v3/projects/ed039927d56a4fd282f80303e1b05002` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:06.678580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed039927d56a4fd282f80303e1b05002)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.686110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.686251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2c7d0-170c-42a3-874f-d412d36191ef admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:06.690994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:06.692250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:06.692702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:06.693173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:06.693903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.696085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.808297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 816/1640] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:06 2022] POST /identity/v3/users => generated 301 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:06.809128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:06.818007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:06.828198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed039927d56a4fd282f80303e1b05002', 'request_id': 'req-753fa81e-4a11-42c4-a716-0cfd258d95bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.843705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b87b9-b10e-4e49-969a-53b92a938d12 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:06.957082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:06.958006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:06.958421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:06.958765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] PATH_INFO: `/v3/users/6e4716dc01b74d279da20fd1f4e44ec2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:06.960070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4716dc01b74d279da20fd1f4e44ec2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:06.962533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:06.966947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed039927d56a4fd282f80303e1b05002', 'request_id': 'req-753fa81e-4a11-42c4-a716-0cfd258d95bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:06.979907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed039927d56a4fd282f80303e1b05002', 'request_id': 'req-753fa81e-4a11-42c4-a716-0cfd258d95bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.017419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] The token cache is being invalidate because project ed039927d56a4fd282f80303e1b05002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:07.017719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.018521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-753fa81e-4a11-42c4-a716-0cfd258d95bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.023232 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 825/1641] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:06 2022] DELETE /identity/v3/projects/ed039927d56a4fd282f80303e1b05002 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:07.023232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.023232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.023232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.047702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:07.049102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.114131 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 826/1642] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:07.115394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.116694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.134005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44b0fd-527c-4f0a-b958-1f6e7bcf4669 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.141479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.142182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.142463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.142796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.144185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.146242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efbc1-a0d2-44fe-a8aa-bad750a83720 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.162782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 827/1643] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:07.164892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.165183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.165942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.197067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:07.198675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.210708 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 828/1644] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:07.211613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.216384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.234972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7730-ef7f-444b-b411-0b9f45a6a2d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.240331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.241095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.241464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.241840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.252873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.255389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.268050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 829/1645] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:07.291489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.292471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4716dc01b74d279da20fd1f4e44ec2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.293644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4716dc01b74d279da20fd1f4e44ec2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.320398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4716dc01b74d279da20fd1f4e44ec2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.321820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4716dc01b74d279da20fd1f4e44ec2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.328809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95f875-8e8f-44df-b649-320a1c856a3f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.343415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.344105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.344385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.344654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] PATH_INFO: `/v3/projects/9e08e00f6d124462bc36d474ac3d1e59/users/e590aac4a07f4867a249f723fa6a3d37/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.370977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e08e00f6d124462bc36d474ac3d1e59, user_id=e590aac4a07f4867a249f723fa6a3d37, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.375485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.397006 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:07.399049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-14b1c902-d59a-4414-a34e-332d455ff340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4716dc01b74d279da20fd1f4e44ec2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:07.444720 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 817/1646] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:06 2022] DELETE /identity/v3/users/6e4716dc01b74d279da20fd1f4e44ec2 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:07.447370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.452063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.452063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.475864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:07.477189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.479152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 830/1647] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:07 2022] PUT /identity/v3/projects/9e08e00f6d124462bc36d474ac3d1e59/users/e590aac4a07f4867a249f723fa6a3d37/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:07.483554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.488513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.603378 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 818/1648] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:07.604361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.618421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366423db-cfd9-4409-9a89-d68c3324fa0f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.623971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.624643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.624986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.625264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.626452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:07.626452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.630054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.643310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8a0f9-f6cb-4edc-b4b5-034301cb1a73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.652692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.652692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.652692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.653437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.653606 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 819/1649] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:07.654805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.655332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.657027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.671007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2dc5c-6fb1-4d8a-891e-4a0ea60f2f2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.673363 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 831/1650] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:07.678140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:07.681854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.683271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.683772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.684235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.685160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.688349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.697637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a539e2-482b-47c1-b734-f6cf3f1b5b5f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:07.704559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:07.705513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.705904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.706547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] PATH_INFO: `/v3/projects/9e08e00f6d124462bc36d474ac3d1e59/users/e590aac4a07f4867a249f723fa6a3d37/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.709536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e08e00f6d124462bc36d474ac3d1e59, user_id=e590aac4a07f4867a249f723fa6a3d37, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:07.714509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60cf96-94e2-45ee-b637-68e15e224f20 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:07.766640 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 832/1651] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:07 2022] PUT /identity/v3/projects/9e08e00f6d124462bc36d474ac3d1e59/users/e590aac4a07f4867a249f723fa6a3d37/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:07.768614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:07.769036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:07.769504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:07.849695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] MFA Rules not processed for user `e590aac4a07f4867a249f723fa6a3d37`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:07.854198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:07.905209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 820/1652] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:07.906887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.036699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be47e-24a3-49d4-acb2-93abe05c6804 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:08.047064 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 833/1653] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:08.072872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:08.073516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.073794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.074062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.075037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:08.077662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:08.141923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.143670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:08.207262 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 821/1654] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:07 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:08.213456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.256376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07806bf5-03c1-4c5b-9138-4a8a0910dace admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:08.262739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:08.264815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.264815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.264815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.265470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:08.268108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:08.292294 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 822/1655] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:08.293514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.306794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f03c-4ff0-421b-bbcd-ff6d6ec3273d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:08.313613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:08.314437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.317803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.317803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.317803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:08.318420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:08.326980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284473-6a7a-472c-8be4-78cb4a382710 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:08.336333 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 823/1656] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:08.338185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.350024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040321d-ffaf-4ea6-a041-bc4fbf8c730d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:08.357181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:08.358123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.358214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.358463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] PATH_INFO: `/v3/projects/98f8b4219c1c4d8ab45d9e2c8979f318/users/5b0eb321c3ba40be8e51b382802b6e90/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.384515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f8b4219c1c4d8ab45d9e2c8979f318, user_id=5b0eb321c3ba40be8e51b382802b6e90, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:08.388629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21420b9d-4c3c-4a24-866b-48e6f291615f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:08.423456 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:08.469493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:08.470100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.470386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.470658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.493426 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 824/1657] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:08 2022] PUT /identity/v3/projects/98f8b4219c1c4d8ab45d9e2c8979f318/users/5b0eb321c3ba40be8e51b382802b6e90/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:08.501847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.506258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.507714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.562697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:08.564821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5abb-6bb6-4566-9753-98c571de55d0 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:08.573961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] MFA Rules not processed for user `5b0eb321c3ba40be8e51b382802b6e90`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:08.576792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:08.580655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 834/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:08.629999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:08.630528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:08.630933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:08.710687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] MFA Rules not processed for user `056e59c7d4c2475eb66b64e0e24367be`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:08.712530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:08.747990 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 825/1659] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:08.748301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.750286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:08.804835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 835/1660] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:08.806047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:08.872177 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:09.010905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6c4e-c255-4f6f-ac74-adcf856c4ada None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:09.016681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465843-c58f-466b-9832-7aa2b39f11a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:09.026067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:09.027258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:09.028455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.028455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.028455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.029642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.029912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.030172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.034077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:09.035138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:09.037649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:09.169869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:09.171961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:09.186811 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 836/1661] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:08 2022] POST /identity/v3/projects => generated 373 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:09.190128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:09.193829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:09.254011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 826/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:09.255748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:09.296883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ed9da-2ecf-4cc1-9055-4224bea9726d service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:09.370582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4e2b-c887-438f-81ec-4f1bed258b2e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:09.384784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:09.385714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.385899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.386128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] PATH_INFO: `/v3/projects/cde1722754b44bf28f11e48b228d8e2d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.387990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde1722754b44bf28f11e48b228d8e2d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:09.404707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:09.549391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:09.550151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.550435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.550722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.551462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:09.554318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544717c-ce24-4ce7-a480-3d5aa60fb4d3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:09.607787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde1722754b44bf28f11e48b228d8e2d', 'request_id': 'req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:09.687838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde1722754b44bf28f11e48b228d8e2d', 'request_id': 'req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:09.698683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 827/1663] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:09 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:09.700974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005eea4-b6f7-4212-a439-5782f0ee7754 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.701684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005eea4-b6f7-4212-a439-5782f0ee7754 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.701981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005eea4-b6f7-4212-a439-5782f0ee7754 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.708346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde1722754b44bf28f11e48b228d8e2d', 'request_id': 'req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:09.709515 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 828/1664] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:14:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:09.711061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa713c6d-6e9e-48f0-9cc9-1980e80e8e15 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.711355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa713c6d-6e9e-48f0-9cc9-1980e80e8e15 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.711828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa713c6d-6e9e-48f0-9cc9-1980e80e8e15 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.713786 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 829/1665] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:09.714856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa713c6d-6e9e-48f0-9cc9-1980e80e8e15 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:09.740433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] The token cache is being invalidate because project cde1722754b44bf28f11e48b228d8e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:09.740699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:09.742134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-11a81d6e-4a7b-49fe-9b5c-9d0bb3f2e3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:09.744714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 837/1666] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:09 2022] DELETE /identity/v3/projects/cde1722754b44bf28f11e48b228d8e2d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:09.746343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d881d-a0ad-4d6e-a966-e82795eb6671 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.746629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d881d-a0ad-4d6e-a966-e82795eb6671 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.746906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d881d-a0ad-4d6e-a966-e82795eb6671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.794411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e36d881d-a0ad-4d6e-a966-e82795eb6671 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:09.795714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e36d881d-a0ad-4d6e-a966-e82795eb6671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:09.851048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa713c6d-6e9e-48f0-9cc9-1980e80e8e15 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:09.859426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:09.860173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.861513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.861856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.863156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:09.866066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88264d0-f648-4cc3-b9f7-df867ed4d575 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:09.915466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 830/1667] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:09.918321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:09.918817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:09.919163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:09.962928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:09.979131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.097240 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 838/1668] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:10.110494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.110839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.111186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.114726 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:10.115425 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 831/1669] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:10.120126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.120126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.141876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b54b-e7cd-4678-b163-9e3e79e17ff3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.152816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.152816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.152816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.152816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] PATH_INFO: `/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63/users/7676e4e6759844eb88f89bd4307fa477/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.183239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dc1425d5ae425c8e068b8ca745cb63, user_id=7676e4e6759844eb88f89bd4307fa477, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.188334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7788c-5aae-45e9-9d14-747b5c572f8c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.213587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:10.217830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.225602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 839/1670] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:10.226763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.228244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.275046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7797-9fcf-4d82-b3b8-c34a273253f6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.280118 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 832/1671] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:10 2022] PUT /identity/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63/users/7676e4e6759844eb88f89bd4307fa477/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:10.283248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.283537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.286149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.326626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:10.327948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.385017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.386158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.386640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.387162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.398165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.400670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.413994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 840/1672] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:10.415282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.484033 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:10.517855 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 833/1673] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:10.522667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.527659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.587304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cf8cf-38d4-4d04-9836-ce805860e76f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.595226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.596343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.598410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.598410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.598712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.601388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.622769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 841/1674] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:10.622769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.640152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5e1-c7e9-414f-84e0-341c690b7722 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.652569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.655582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.655582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.655582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.655582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:10.655582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.656607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.676986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 842/1675] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:10.678046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.680960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac154a00-6389-4341-a0fa-ea4ca36efc60 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.688741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.689642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.690068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.690544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.697130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92753d78-5a1d-4b4e-86b0-f05a7ddbcfe8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.702299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.704385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.706569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.707583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.707852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.708129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] PATH_INFO: `/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63/users/7676e4e6759844eb88f89bd4307fa477/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.711159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dc1425d5ae425c8e068b8ca745cb63, user_id=7676e4e6759844eb88f89bd4307fa477, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.714158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9433b5-8c4c-477c-9393-cfac78d3018c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:10.719481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 834/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:10.720813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:10.738728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18d9d1-6917-4bec-bc73-bcdabd3c109b service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:10.765479 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 843/1677] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:10 2022] PUT /identity/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63/users/7676e4e6759844eb88f89bd4307fa477/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:10.767071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.785556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.785556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.832859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] MFA Rules not processed for user `7676e4e6759844eb88f89bd4307fa477`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:10.834498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:10.906083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:10.907223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:10.907502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:10.907789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:10.908435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:10.915489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.004540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 844/1678] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:11.034846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 835/1679] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:10 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:11.039508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.055775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17be76-bc1c-462d-9811-333f316f8ccd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.148188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:11.149120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.149574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.149869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.150553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:11.152569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.243379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.254435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 845/1680] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:11 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:11.254956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:11.264180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.284543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc2c30-944e-4835-869b-2d7eaf3ecaa0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.291135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:11.292189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.292717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.293191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.294322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:11.298640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.313370 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 846/1681] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:11.317861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.324994 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.332027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26518fe3-eec4-4d65-8115-bf4bd906deb4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.339833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:11.342086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.342630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.343592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.344741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:11.348908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.379490 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 847/1682] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:11.383968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.402761 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.407372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7729d3-9cf8-4b99-b10b-3e23c903a308 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.413790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:11.414460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.414999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.415267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] PATH_INFO: `/v3/projects/61c209215195490b8123b949ccdeffab/users/ea6009a59ffa459fb74626d5ab2f7eee/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.426764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7bcae-1b71-48f4-b711-4984dcbe64c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.435729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:11.436315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c209215195490b8123b949ccdeffab, user_id=ea6009a59ffa459fb74626d5ab2f7eee, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:11.436452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.436688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.436965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.439332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a6ed0-e77a-4d30-91d6-7f91d15c659f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.539883 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 848/1683] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:11 2022] PUT /identity/v3/projects/61c209215195490b8123b949ccdeffab/users/ea6009a59ffa459fb74626d5ab2f7eee/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:11.540455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:11.542337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:11.554938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:11.556352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:11.556593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:11.570545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 836/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:11.660664 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.661172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] MFA Rules not processed for user `ea6009a59ffa459fb74626d5ab2f7eee`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:11.661172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:11.797358 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.808713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 849/1685] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:11.821654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:11.851424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465483b8-f587-4209-a8da-ffeaad98dcd8 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:11.906183 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:11.965748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.008370 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:12.033774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.034513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.034798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.035076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.035736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.037860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.125610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ac87-fc4e-4fd1-a9c1-45809d951ed8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.133580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.134209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.134648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.135277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.138487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:12.179972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 837/1686] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:11 2022] POST /identity/v3/projects => generated 375 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:12.187558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.243628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.245997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.262123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 850/1687] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:12.307114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53d00-e33c-4b8f-93d9-bbb88d0eb559 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.314977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.314977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.314977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.314977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.315355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.317231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.427209 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:12.437381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 838/1688] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:12 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:12.440371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.456318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34c84c-f8f6-470d-9ca8-663de2e15fdb service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.461078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.461744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.462024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.462294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.462972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.465091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2365ded-b5db-4828-ae04-73fc969b4dc6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.476366 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 851/1689] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:12.483444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.497779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4b162-c33c-49ce-91bb-94c4d5464616 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.522682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.523629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.523629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.524051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] PATH_INFO: `/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3/users/6827489b1573480fa171e7f3d9500ca8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.579004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bcfb211dea4e9cb344446f3f6c4eb3, user_id=6827489b1573480fa171e7f3d9500ca8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.582430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.687719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.688502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.689575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.715512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:12.715512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:12.716225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 839/1690] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:12 2022] PUT /identity/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3/users/6827489b1573480fa171e7f3d9500ca8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:12.717872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.830373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 852/1691] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Oct 30 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:12.843517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3667b3-228c-479d-8d0f-a179e29fb559 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.853916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.866527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.867250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.867600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.867970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.868717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.870434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.872940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1882c-2007-4efd-a8b1-2370b048fa24 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.878225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.878874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.879151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.879427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] PATH_INFO: `/v3/users/5b0eb321c3ba40be8e51b382802b6e90` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.881321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0eb321c3ba40be8e51b382802b6e90)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.884366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.894208 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 840/1692] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:12.899344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.901094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:12.922030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a37d17-1e59-45ed-9f68-dec824433b6d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.926340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.926956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.930173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.930173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.936317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.937937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.947350 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 841/1693] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:12.947828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:12.960893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1546a-771e-4c54-8a57-481a9b67922e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:12.966961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:12.967732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:12.974467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:12.974467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] PATH_INFO: `/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3/users/6827489b1573480fa171e7f3d9500ca8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:12.974467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bcfb211dea4e9cb344446f3f6c4eb3, user_id=6827489b1573480fa171e7f3d9500ca8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:12.974467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6672ff8-eeb1-40ef-a4b2-a4230609d2a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:12.988651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 842/1694] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:12 2022] PUT /identity/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3/users/6827489b1573480fa171e7f3d9500ca8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:13.001374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea022-290a-4990-b270-90946a874cb1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.007360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea022-290a-4990-b270-90946a874cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.007360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea022-290a-4990-b270-90946a874cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.025440 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:13.063855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-29fea022-290a-4990-b270-90946a874cb1 None None] MFA Rules not processed for user `6827489b1573480fa171e7f3d9500ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:13.065058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-29fea022-290a-4990-b270-90946a874cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.111758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0eb321c3ba40be8e51b382802b6e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.153406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 843/1695] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:13.153406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fea022-290a-4990-b270-90946a874cb1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:13.161626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-29fea022-290a-4990-b270-90946a874cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.219609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0eb321c3ba40be8e51b382802b6e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.220440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0eb321c3ba40be8e51b382802b6e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.230194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fea022-290a-4990-b270-90946a874cb1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:13.235577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:13.236478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.236837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.237182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] PATH_INFO: `/v3/users/fc425a8158474f1fae8733437a74eb9f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.238427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc425a8158474f1fae8733437a74eb9f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:13.239050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0eb321c3ba40be8e51b382802b6e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.240437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:13.248640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0eb321c3ba40be8e51b382802b6e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.259956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 853/1696] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:12 2022] DELETE /identity/v3/users/5b0eb321c3ba40be8e51b382802b6e90 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:13.262583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:13.263255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.343000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071269d8-4b81-4c2b-ba79-3554aa55bba1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:13.348741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:13.349527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.349659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.349918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.351734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.420774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:13.422479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6481576-0b4a-445f-abc8-4f0081aabcaa service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:13.424695 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:13.436649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 854/1697] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:13.438161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.438465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.438735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.465943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:13.467323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.542467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 855/1698] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:13.542659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc425a8158474f1fae8733437a74eb9f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.543291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc425a8158474f1fae8733437a74eb9f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.558153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc425a8158474f1fae8733437a74eb9f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.558591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:13.560324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.561192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc425a8158474f1fae8733437a74eb9f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.660891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-988e52f8-02ff-4e65-b9fa-e894e4e2ec7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc425a8158474f1fae8733437a74eb9f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:13.668552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf41c73-2ad1-4115-8fd8-3b31cd5cc2e8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:13.669114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:13.669487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.669831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.670236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.672115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.693096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:13.699931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:13.710950 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 844/1699] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:13 2022] DELETE /identity/v3/users/fc425a8158474f1fae8733437a74eb9f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:13.714404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:13.714965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:13.719898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:13.720032 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 856/1700] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:13.747005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:13.748230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.851627 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 845/1701] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:13.921111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:13.922442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:13.936942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c73b0b-08d4-454d-b2d2-4758794b7bde service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:14.015044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:14.015826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:14.016178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:14.016517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:14.031479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:14.032994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368896e-ccec-44f9-a175-cf4189296373 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:14.075287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 857/1702] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:14.214021 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:14.310844 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:14.605922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:14.607403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:14.628884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25376efa-7fb1-4c18-b743-01f8eca2115c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:14.635271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:14.635972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:14.642288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:14.642288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] PATH_INFO: `/v3/users/ea6009a59ffa459fb74626d5ab2f7eee` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:14.642288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6009a59ffa459fb74626d5ab2f7eee)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:14.642288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:14.720860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:14.873453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0fcd-d3c4-49d1-a294-3585870f10b6 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:14.873949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0fcd-d3c4-49d1-a294-3585870f10b6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:14.874335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0fcd-d3c4-49d1-a294-3585870f10b6 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:14.876099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 858/1703] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:14:14.909006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6009a59ffa459fb74626d5ab2f7eee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:14.910550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6009a59ffa459fb74626d5ab2f7eee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:14.918798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6009a59ffa459fb74626d5ab2f7eee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:14.919730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6009a59ffa459fb74626d5ab2f7eee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:14.935713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c786343-a3c1-49b6-9e37-2215e700b94a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:14.936293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c786343-a3c1-49b6-9e37-2215e700b94a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:14.936557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c786343-a3c1-49b6-9e37-2215e700b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:14.958397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0c786343-a3c1-49b6-9e37-2215e700b94a None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:14.959858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c786343-a3c1-49b6-9e37-2215e700b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.007866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6009a59ffa459fb74626d5ab2f7eee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.041988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 846/1704] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:14 2022] DELETE /identity/v3/users/ea6009a59ffa459fb74626d5ab2f7eee => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:15.053074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:15.055092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.058724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 859/1705] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:15.061228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.061557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.061836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.121245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:15.123895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.165686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c531-865d-48c1-8be8-cd86176cc4a7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:15.172134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:15.173391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.174268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.174268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] PATH_INFO: `/v3/projects/98f8b4219c1c4d8ab45d9e2c8979f318` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.175422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f8b4219c1c4d8ab45d9e2c8979f318)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:15.178087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:15.218324 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 860/1706] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:15.219508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:15.220947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.333875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f8b4219c1c4d8ab45d9e2c8979f318', 'request_id': 'req-a92085b1-e3de-4adc-9313-6bda34504d49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.342363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f8b4219c1c4d8ab45d9e2c8979f318', 'request_id': 'req-a92085b1-e3de-4adc-9313-6bda34504d49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.383410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c8fa2-25e1-4567-8912-74480698e18e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:15.458766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f8b4219c1c4d8ab45d9e2c8979f318', 'request_id': 'req-a92085b1-e3de-4adc-9313-6bda34504d49'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.474286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] The token cache is being invalidate because project 98f8b4219c1c4d8ab45d9e2c8979f318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:15.474668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.475655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.478392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 847/1707] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:15 2022] DELETE /identity/v3/projects/98f8b4219c1c4d8ab45d9e2c8979f318 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:15.479331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:15.481564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.482963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:15.483751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.484172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.491800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.494236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.516542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:15.521428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:15.541390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 861/1708] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:15.545713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:15.550200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.595480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92085b1-e3de-4adc-9313-6bda34504d49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:15.604088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:15.604727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.605056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.605360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.607427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.612219 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:15.729828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:15.731462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:15.746306 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 848/1709] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:15.747175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:15.748476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:15.763746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849820b-6db2-483e-8c35-dddacc29e730 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:15.767011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207393b6-e930-4a29-8078-ab584ec77bc0 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:15.769694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:15.770343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.770843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.771288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] PATH_INFO: `/v3/projects/1c467cf21efd4aadbf05ded4ff3d2f40` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.772583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:15.773183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:15.773494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:15.773599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c467cf21efd4aadbf05ded4ff3d2f40)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:15.773763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] PATH_INFO: `/v3/users/7676e4e6759844eb88f89bd4307fa477` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:15.775177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7676e4e6759844eb88f89bd4307fa477)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:15.775609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:15.777260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:15.901270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c467cf21efd4aadbf05ded4ff3d2f40', 'request_id': 'req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:15.908261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c467cf21efd4aadbf05ded4ff3d2f40', 'request_id': 'req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.032470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c467cf21efd4aadbf05ded4ff3d2f40', 'request_id': 'req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.053386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7676e4e6759844eb88f89bd4307fa477'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.057915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] The token cache is being invalidate because project 1c467cf21efd4aadbf05ded4ff3d2f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:16.058214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.058960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.060707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 849/1710] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:15 2022] DELETE /identity/v3/projects/1c467cf21efd4aadbf05ded4ff3d2f40 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:16.066435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:16.067842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:16.126214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7676e4e6759844eb88f89bd4307fa477'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.128782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7676e4e6759844eb88f89bd4307fa477'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.143415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7676e4e6759844eb88f89bd4307fa477'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.146862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a56c2-1a23-4eab-8e52-88a4f1cd78d3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:16.152256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:16.152908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:16.153188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:16.153499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] PATH_INFO: `/v3/users/e590aac4a07f4867a249f723fa6a3d37` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:16.156071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e590aac4a07f4867a249f723fa6a3d37)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:16.157189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7676e4e6759844eb88f89bd4307fa477'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.158210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:16.171563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 862/1711] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:15 2022] DELETE /identity/v3/users/7676e4e6759844eb88f89bd4307fa477 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:16.345604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e590aac4a07f4867a249f723fa6a3d37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.346469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e590aac4a07f4867a249f723fa6a3d37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.371284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e590aac4a07f4867a249f723fa6a3d37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.372107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e590aac4a07f4867a249f723fa6a3d37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.536891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e590aac4a07f4867a249f723fa6a3d37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:16.565694 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 850/1712] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:16 2022] DELETE /identity/v3/users/e590aac4a07f4867a249f723fa6a3d37 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:16.814134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:16.816233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:16.922258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3572eb-c8ec-4b0c-b481-80380f56e11c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:16.962107 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:17.002422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:17.004720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:17.016692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:17.017625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.017974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.018555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] PATH_INFO: `/v3/projects/61c209215195490b8123b949ccdeffab` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.020409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c209215195490b8123b949ccdeffab)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:17.022877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:17.115799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821351a4-9977-43e8-b092-d0a2e6da9a0c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:17.122030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:17.122918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.123610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.124034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] PATH_INFO: `/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.128898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dc1425d5ae425c8e068b8ca745cb63)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:17.130843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:17.195003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c209215195490b8123b949ccdeffab', 'request_id': 'req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.314544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dc1425d5ae425c8e068b8ca745cb63', 'request_id': 'req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.319265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c209215195490b8123b949ccdeffab', 'request_id': 'req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.324094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dc1425d5ae425c8e068b8ca745cb63', 'request_id': 'req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.331235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c209215195490b8123b949ccdeffab', 'request_id': 'req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.344262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] The token cache is being invalidate because project 61c209215195490b8123b949ccdeffab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:17.344999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.345855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.348580 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 863/1713] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:16 2022] DELETE /identity/v3/projects/61c209215195490b8123b949ccdeffab => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:17.349863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:17.351412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:17.434258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dc1425d5ae425c8e068b8ca745cb63', 'request_id': 'req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.452849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] The token cache is being invalidate because project d7dc1425d5ae425c8e068b8ca745cb63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:17.453128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.455547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.459093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f93fc-2d9a-476a-ad51-19e1ac884ec9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:17.460781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 851/1714] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:17 2022] DELETE /identity/v3/projects/d7dc1425d5ae425c8e068b8ca745cb63 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:17.461976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:17.464464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:17.537741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:17.538446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.538914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.539337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] PATH_INFO: `/v3/projects/9e08e00f6d124462bc36d474ac3d1e59` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.542087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e08e00f6d124462bc36d474ac3d1e59)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:17.545082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:17.545215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace0c3-6f0c-40da-b3af-ad3bc01f41f6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:17.552201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:17.552327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.552653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.553147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] PATH_INFO: `/v3/users/6827489b1573480fa171e7f3d9500ca8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.554403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6827489b1573480fa171e7f3d9500ca8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:17.556467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:17.696005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e08e00f6d124462bc36d474ac3d1e59', 'request_id': 'req-a11b75f2-0987-4574-b78b-454ea2501e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.794032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e08e00f6d124462bc36d474ac3d1e59', 'request_id': 'req-a11b75f2-0987-4574-b78b-454ea2501e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.801660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e08e00f6d124462bc36d474ac3d1e59', 'request_id': 'req-a11b75f2-0987-4574-b78b-454ea2501e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.822482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6827489b1573480fa171e7f3d9500ca8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.823533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6827489b1573480fa171e7f3d9500ca8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.826031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] The token cache is being invalidate because project 9e08e00f6d124462bc36d474ac3d1e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:17.827360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.828313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a11b75f2-0987-4574-b78b-454ea2501e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.831264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 864/1715] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:17 2022] DELETE /identity/v3/projects/9e08e00f6d124462bc36d474ac3d1e59 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:17.832038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6827489b1573480fa171e7f3d9500ca8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.832742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6827489b1573480fa171e7f3d9500ca8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.833665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7603df-22dd-40ef-a9b3-ae1c2cb68b03 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.834138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7603df-22dd-40ef-a9b3-ae1c2cb68b03 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.835009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7603df-22dd-40ef-a9b3-ae1c2cb68b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.870633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6a7603df-22dd-40ef-a9b3-ae1c2cb68b03 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:17.871930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6a7603df-22dd-40ef-a9b3-ae1c2cb68b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:17.904724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04e07ba6-b590-41a6-a9d5-e524b70c199e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6827489b1573480fa171e7f3d9500ca8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:17.943580 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 852/1716] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:17 2022] DELETE /identity/v3/users/6827489b1573480fa171e7f3d9500ca8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:17.944865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe852-652f-4f3c-a5fc-47e0261b162a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.945149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe852-652f-4f3c-a5fc-47e0261b162a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.945541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe852-652f-4f3c-a5fc-47e0261b162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:17.973575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5ebfe852-652f-4f3c-a5fc-47e0261b162a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:17.974834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ebfe852-652f-4f3c-a5fc-47e0261b162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:17.980476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 865/1717] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:17.986551 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:17.989942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:17.992577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:17.992577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.022914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:18.024132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:18.076439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 853/1718] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:18.086309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.086575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.087307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.113370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:18.114259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:18.127820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 866/1719] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:18.132185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.141090 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 854/1720] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:18.146068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.148641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba988ca0-624a-44f1-b95c-52324e19ae12 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.162986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.163626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.163904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.164174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.164907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:18.165132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.166878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.167113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd58a-81f9-475f-9bfd-747818915dbc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.177030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.177696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.183456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.183456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.183456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:18.183456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.183456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.188598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 867/1721] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:18.193743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.201957 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 855/1722] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:18.206993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.210404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60679bb4-37a0-4043-b914-d96bf370ede0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.218830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.219453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.219795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.220256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.221043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55fac-03f5-47d4-897d-239199cc34c7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.221152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.223567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.227097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.227950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.228340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.228918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.229688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.231702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.330301 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 868/1723] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:18.334147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.337390 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 856/1724] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:18.341207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.413409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77353-1c0e-4e11-a748-c472e155a31b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.430782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75cbeb-99fe-46ae-8be8-21150fe292fb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.437987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.439102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.439410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.439668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.440314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.443644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.498556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.499260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.499617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.500134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.500844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.502890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.554951 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 857/1725] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:18.559468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.570178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49e64-5ed1-4ac6-9d13-849f973aad3e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.575910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.576525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.576807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.577080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.577761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.579376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.594569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 858/1726] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:18.595690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.606239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e5d1-8067-4177-ba5b-34d56049691a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.611235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.611884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.612157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.613092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.613799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.615426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.627141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 859/1727] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:18.632035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.642266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b720-8e7d-4f95-9427-92a15425bda9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.647755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.648388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.648668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.648943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] PATH_INFO: `/v3/projects/65a9647d312745afab80a9306dc44f64/users/8181a1d70f7d481ea6e7ccdf04d4905f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.666093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a9647d312745afab80a9306dc44f64, user_id=8181a1d70f7d481ea6e7ccdf04d4905f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.669048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.699486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 869/1728] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/users => generated 299 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:18.716244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.728573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf76b4-e132-433a-81d8-f45468112aab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.733771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.734392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.734674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.734952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.735704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.737944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.752719 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 870/1729] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:18.755044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.766336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896c088-c1bb-4e56-b7bb-becb1ff93638 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.771089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.771710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.772350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.772637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.773279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:18.775103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b626fd9-3480-4efc-8ed9-7f16b6bbe94d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:18.786057 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 860/1730] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:18 2022] PUT /identity/v3/projects/65a9647d312745afab80a9306dc44f64/users/8181a1d70f7d481ea6e7ccdf04d4905f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:18.790635 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 871/1731] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:18.794683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.796577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.796859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.797123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.831281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] MFA Rules not processed for user `8181a1d70f7d481ea6e7ccdf04d4905f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:18.832671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:18.927876 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:18.957006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d250ea-6a96-4226-a5e8-06c49db8fc1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:18.962837 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 872/1732] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:18.963757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:18.964344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:18.964623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:18.965198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:18.965528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] PATH_INFO: `/v3/projects/301cee87901844ed94e635eca054960d/users/2096bbb8aff742b1837931e52ac1c9ae/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:18.966848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:18.993555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8884-3cf8-4264-b3a8-db773e7c885e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.000111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.001027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.001484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.002660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] PATH_INFO: `/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.004106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bcfb211dea4e9cb344446f3f6c4eb3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.008399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.014995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301cee87901844ed94e635eca054960d, user_id=2096bbb8aff742b1837931e52ac1c9ae, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.022587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.133993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 861/1733] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:18 2022] PUT /identity/v3/projects/301cee87901844ed94e635eca054960d/users/2096bbb8aff742b1837931e52ac1c9ae/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:19.133993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.161000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bcfb211dea4e9cb344446f3f6c4eb3', 'request_id': 'req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:19.235201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325848f-cb9a-4aba-8150-9a8e6424f548 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.309750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.310582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.311000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.311542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.312287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.314710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64da3ab-ac7e-41aa-a78e-57ad38402acc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.323871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bcfb211dea4e9cb344446f3f6c4eb3', 'request_id': 'req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:19.332460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bcfb211dea4e9cb344446f3f6c4eb3', 'request_id': 'req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:19.345913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] The token cache is being invalidate because project 57bcfb211dea4e9cb344446f3f6c4eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:19.346272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:19.346919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa6cece-a61f-432c-8d5e-c8dbfc13fee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:19.352668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 873/1734] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:18 2022] DELETE /identity/v3/projects/57bcfb211dea4e9cb344446f3f6c4eb3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:19.352668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f118ed-006e-434b-8372-18ae62a55f36 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.352668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f118ed-006e-434b-8372-18ae62a55f36 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.352668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f118ed-006e-434b-8372-18ae62a55f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.372697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21f118ed-006e-434b-8372-18ae62a55f36 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:19.373979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21f118ed-006e-434b-8372-18ae62a55f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:19.382628 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 874/1735] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:19.383870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.384151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.384420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.405548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:19.406859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:19.415650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 875/1736] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:19.416399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.417780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:19.434805 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 862/1737] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:19.436767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.438128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.438682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.462832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:19.464336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:19.525122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f15fe-95cd-4c9e-83dc-3b75287d4e5e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.588986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 863/1738] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:19.590094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.591857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:19.605655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c3c8-1967-40d2-941e-e1741e8b2a1c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.613464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.614269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.614627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.614968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.615749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.619417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.656265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.656913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.657189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.662364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.682790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.684245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.705059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 876/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:19.705953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.715724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5568-9c23-4ea7-96ee-e6f338aa5111 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.722587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.722834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.723109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.723355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.724008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:19.724565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.726034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.741075 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 877/1740] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:19.746538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.759745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 864/1741] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:19.760586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a12352-54f4-49ea-8a36-a6e3b68b0e10 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.763432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.772894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.773588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.773833 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:19.773949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.774126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.775008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.782249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b0e6-644d-457b-aa09-a6347a310c39 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.785852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.796629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.797265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.797589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.798574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.799231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.812578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.851001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 865/1742] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:19.852113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.865823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c2313-978e-4d0f-8dd9-ca42cde74b04 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:19.871690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:19.872414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:19.872695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:19.872969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] PATH_INFO: `/v3/projects/eed72c15c2e74cc991dc483719fdd2ab/users/03a40c4ca30a4ae4a2fc574998ed5dc3/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:19.895777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed72c15c2e74cc991dc483719fdd2ab, user_id=03a40c4ca30a4ae4a2fc574998ed5dc3, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:19.896585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:19.917911 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 878/1743] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:19.927822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:19.996621 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 866/1744] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:19 2022] PUT /identity/v3/projects/eed72c15c2e74cc991dc483719fdd2ab/users/03a40c4ca30a4ae4a2fc574998ed5dc3/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:19.998132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.029839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3b0d-8f46-4798-9dfe-44656ca5bb1e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.102434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41dd7-1fce-400c-a519-71493107dc27 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.108886 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:20.113181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.114126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.114544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.114662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.115296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.118480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.139447 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 867/1745] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:20.144426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.145153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.145501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.146153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.146583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.147599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.150713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.169835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aeee65-0a6f-40a7-92f0-498ce04d8c70 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.181603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.182268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.182847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.183121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] PATH_INFO: `/v3/projects/eed72c15c2e74cc991dc483719fdd2ab/users/03a40c4ca30a4ae4a2fc574998ed5dc3/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.188005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed72c15c2e74cc991dc483719fdd2ab, user_id=03a40c4ca30a4ae4a2fc574998ed5dc3, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.192376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a7e18-5df7-4259-a994-8a4b52bdd7c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.219074 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 868/1746] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:20 2022] PUT /identity/v3/projects/eed72c15c2e74cc991dc483719fdd2ab/users/03a40c4ca30a4ae4a2fc574998ed5dc3/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:20.231245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.232034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.232034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.266428 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 879/1747] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:19 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:20.270890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.289972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf109-6b13-48e6-8489-3d637b71e939 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.320666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] MFA Rules not processed for user `03a40c4ca30a4ae4a2fc574998ed5dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:20.322862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:20.435194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.436091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.436512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.438037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.439082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.441098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.454399 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 880/1748] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:20.458361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.474371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795878-7b89-4477-9861-1cae489901fe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.480287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.481808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.482330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.482744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.486182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.486182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.492445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 869/1749] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:20.500036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.512377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df0bfa-8bab-4d24-88ab-dc3f8b495d3f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.518586 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 881/1750] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:20.521589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.521918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.522205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.523688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.523791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:20.524154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.525862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.526992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.542668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5427c5d-6ce9-4edd-bf7f-7dd8bbbabc1f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.547782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 870/1751] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:20.551941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.553007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.553522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.554006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] PATH_INFO: `/v3/projects/c345b7715cca426599dce98b8906ef8e/users/c9e2d5caf6c64b5eb508c47bbbc13892/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.556192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.586895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29fe79-78c5-4021-8f22-84c696517a9d tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:20.601658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:20.602301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.602580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.602857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.603596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.604522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c345b7715cca426599dce98b8906ef8e, user_id=c9e2d5caf6c64b5eb508c47bbbc13892, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:20.605549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.616084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b417b-24ab-4865-9fe5-78a3ffa1eb30 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:20.733509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 882/1752] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:20 2022] PUT /identity/v3/projects/c345b7715cca426599dce98b8906ef8e/users/c9e2d5caf6c64b5eb508c47bbbc13892/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:20.744091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:20.744452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:20.744790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:20.775361 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 871/1753] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:20 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:20.779908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:20.852345 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:20.865108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] MFA Rules not processed for user `c9e2d5caf6c64b5eb508c47bbbc13892`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:20.872596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:20.945670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0cf9-e741-4a0e-abaa-5c541cfbcc20 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.025942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.028580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.028580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.028580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.028580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:21.028899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.031216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.059311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 872/1754] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:21.162224 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 883/1755] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:21.166547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.203667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.205965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:21.273780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c478230-a3d6-45e8-8394-29aa3f9b4b18 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.281218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.282418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.282932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.283410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.285020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.287999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.347961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78a175-4d2a-4fd0-8538-a76ed9a1eb73 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.353722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.354358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.354638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.354911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.371917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.373623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a90d78-284f-41a9-8473-3f239560e7fe service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.391408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 884/1756] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:21.416691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.416961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.417237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.418998 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 885/1757] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:21.427953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:21.444096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 873/1758] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:21 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:21.445274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.453839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.467680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdde1-7554-4474-a1da-6f4cb8d4fdf8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.577863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f20-fb9c-4fdb-90a3-34eb978a2caa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.583270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.583727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.584346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.584738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.585003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.585261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects/2cdc637333db40698091d929231a22b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.585704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.586238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.586727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cdc637333db40698091d929231a22b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.587239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.590333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.591036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.593779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 886/1759] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:21 2022] GET /identity/v3/projects/2cdc637333db40698091d929231a22b3 => generated 371 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:21.689098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 874/1760] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:21 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:21.690542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.701446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba77160-e3f7-42b7-aca5-2a51ad428377 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.707378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.707916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.708198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.708468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.709140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.710923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054614e5-9fe2-433b-b220-4fc659131b3e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.722617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 887/1761] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:21.730002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.740606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055b4d-28ca-4538-8c87-146571cd3649 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.746463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.746911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.747192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.747962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] PATH_INFO: `/v3/projects/d50c0edb547944728cce0f12105fa7bb/users/d7e4d8a849c94a829cbf0c23b1a20555/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.767499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50c0edb547944728cce0f12105fa7bb, user_id=d7e4d8a849c94a829cbf0c23b1a20555, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.771251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.780621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.780979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.781387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.782904 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 888/1762] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:14:21.788540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:21.845959 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 875/1763] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:21 2022] PUT /identity/v3/projects/d50c0edb547944728cce0f12105fa7bb/users/d7e4d8a849c94a829cbf0c23b1a20555/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:21.859319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.874288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.889010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4b493-cc52-47c9-8998-ed7d172a9234 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.935320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ec98-ee8a-4c0d-be82-083a79707180 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.940467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.941210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.941589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.941929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.942646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.944438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.959249 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 876/1764] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:21.960062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:21.970055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3604278-367f-425a-b42d-945c98b9b075 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:21.971013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.972530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.972886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.973290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects/2cdc637333db40698091d929231a22b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.974498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cdc637333db40698091d929231a22b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.976012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:21.976675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:21.976784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6d6ec-6d0f-4ef0-af11-ec53ae7c0556 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.976960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:21.977237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] PATH_INFO: `/v3/projects/d50c0edb547944728cce0f12105fa7bb/users/d7e4d8a849c94a829cbf0c23b1a20555/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:21.978973 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 889/1765] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:21 2022] GET /identity/v3/projects/2cdc637333db40698091d929231a22b3 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:21.980558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50c0edb547944728cce0f12105fa7bb, user_id=d7e4d8a849c94a829cbf0c23b1a20555, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:21.983313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:21.996233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 877/1766] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:21 2022] PUT /identity/v3/projects/d50c0edb547944728cce0f12105fa7bb/users/d7e4d8a849c94a829cbf0c23b1a20555/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:22.008354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959915-152a-44bc-85e9-614fa93048fd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.009519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959915-152a-44bc-85e9-614fa93048fd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.009519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959915-152a-44bc-85e9-614fa93048fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.051704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2f959915-152a-44bc-85e9-614fa93048fd None None] MFA Rules not processed for user `d7e4d8a849c94a829cbf0c23b1a20555`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:22.053617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f959915-152a-44bc-85e9-614fa93048fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:22.057241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:22.091310 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:22.194072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 890/1767] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:22.205106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.205735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.207550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.241787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdad37d-78ef-4bc0-ad13-73de3578298f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:22.251669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] MFA Rules not processed for user `c9e2d5caf6c64b5eb508c47bbbc13892`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:22.256251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:22.257159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:22.258120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.259178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.260634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.261525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:22.262328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:22.266046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:22.339274 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 878/1768] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:22.340876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:22.377496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22208c8-8750-41cd-a16d-6261503bae6b tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:22.407713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:22.409510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.414109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.414728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.415509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:22.418771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56db74-daab-4425-b2ba-ed3631d98dbc tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:22.439849 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 891/1769] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:22.452616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:22.455748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:22.551332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a19b8-6657-4b40-9001-59ce00f7bc08 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:22.558071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:22.558822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.559156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.559493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.570389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:22.572421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:22.587974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 892/1770] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:22.611780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 879/1771] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:22 2022] POST /identity/v3/users => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:22.616173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:22.652624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dbd8-cb24-42c5-9783-76deef2301b6 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:22.670401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:22.671110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.671408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.671682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.672358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:22.672671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:22.674344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:22.707428 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 893/1772] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:22.898785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803049b-87be-4b83-a479-345d7510cf73 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.899066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803049b-87be-4b83-a479-345d7510cf73 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.899422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803049b-87be-4b83-a479-345d7510cf73 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.904593 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 880/1773] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:22.907494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:22.926696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:22.937635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3f5dd-2c72-47a3-a961-88046a065f52 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:22.945314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:22.945763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:22.946040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:22.946317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects/2cdc637333db40698091d929231a22b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:22.948328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cdc637333db40698091d929231a22b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:22.951061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:22.953180 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 894/1774] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:22 2022] GET /identity/v3/projects/2cdc637333db40698091d929231a22b3 => generated 371 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:23.292338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40492f4-1016-44d3-8f19-3fee78e528d2 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:23.292856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40492f4-1016-44d3-8f19-3fee78e528d2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:23.293251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40492f4-1016-44d3-8f19-3fee78e528d2 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:23.294724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 881/1775] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:14:23.301552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:23.320409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:23.331031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d3d9e-3664-4f5b-967b-b32c4d7103ee tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:23.339575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:23.341263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:23.341764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:23.342215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects/2cdc637333db40698091d929231a22b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:23.345001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:get_project(project_id=2cdc637333db40698091d929231a22b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:23.347860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:23.350091 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 895/1776] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:23 2022] GET /identity/v3/projects/2cdc637333db40698091d929231a22b3 => generated 371 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:23.386982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40492f4-1016-44d3-8f19-3fee78e528d2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:23.421246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40492f4-1016-44d3-8f19-3fee78e528d2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:23.439438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:23.440265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:23.440596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:23.447469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/users/d8e32fa36bb44c7abbf5ffd35fdac21b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:23.476441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d8e32fa36bb44c7abbf5ffd35fdac21b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:23.479052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:23.509057 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:23.732527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e32fa36bb44c7abbf5ffd35fdac21b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:23.733214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e32fa36bb44c7abbf5ffd35fdac21b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:23.743967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e32fa36bb44c7abbf5ffd35fdac21b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:23.744844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e32fa36bb44c7abbf5ffd35fdac21b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:23.834014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e32fa36bb44c7abbf5ffd35fdac21b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:23.901985 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 882/1777] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:23 2022] DELETE /identity/v3/users/d8e32fa36bb44c7abbf5ffd35fdac21b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:23.906538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:23.908914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:23.935833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc4466-6955-4e1c-9ee3-e75c9ce1e662 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:24.058474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03a40c4ca30a4ae4a2fc574998ed5dc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eed72c15c2e74cc991dc483719fdd2ab', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:24.059548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:24.060074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:24.060489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] PATH_INFO: `/v3/projects/2cdc637333db40698091d929231a22b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:24.062232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2cdc637333db40698091d929231a22b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:24.064501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:24.235184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdc637333db40698091d929231a22b3', 'request_id': 'req-5b2d2aa4-5568-4d8f-b51a-d30573693508'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:24.470601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdc637333db40698091d929231a22b3', 'request_id': 'req-5b2d2aa4-5568-4d8f-b51a-d30573693508'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:24.478707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdc637333db40698091d929231a22b3', 'request_id': 'req-5b2d2aa4-5568-4d8f-b51a-d30573693508'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:24.496001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] The token cache is being invalidate because project 2cdc637333db40698091d929231a22b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:24.497123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:24.502776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5b2d2aa4-5568-4d8f-b51a-d30573693508 tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:24.507063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 896/1778] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:23 2022] DELETE /identity/v3/projects/2cdc637333db40698091d929231a22b3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:24.514592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:24.516186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:24.647450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a239c-9e1e-4171-af29-48756350adeb tempest-QuotasAdminTestV236-1878291940 tempest-QuotasAdminTestV236-1878291940-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:24.782507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:24.783325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:24.783700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:24.784072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] PATH_INFO: `/v3/users/8181a1d70f7d481ea6e7ccdf04d4905f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:24.787545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8181a1d70f7d481ea6e7ccdf04d4905f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:24.791168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:25.083750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8181a1d70f7d481ea6e7ccdf04d4905f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:25.088441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8181a1d70f7d481ea6e7ccdf04d4905f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:25.102326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8181a1d70f7d481ea6e7ccdf04d4905f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:25.103131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8181a1d70f7d481ea6e7ccdf04d4905f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:25.213489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8181a1d70f7d481ea6e7ccdf04d4905f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:25.213799 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:25.236207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 883/1779] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:24 2022] DELETE /identity/v3/users/8181a1d70f7d481ea6e7ccdf04d4905f => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:25.241997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:25.242767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:25.243108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:25.267932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:25.269434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:25.388618 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 897/1780] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:25.411338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:25.414163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:25.512239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d03fed-7718-41fd-96a3-cb7e3d5aa5b4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:25.517205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:25.518035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:25.521311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:25.522172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:25.545658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:25.548195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:25.570125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 884/1781] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:26.299763 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:26.522128 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:26.846511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:26.854473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:26.871766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d33111-3db7-4836-b278-0b8088e0edc5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:26.898006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:26.899018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:26.899858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:26.900240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] PATH_INFO: `/v3/projects/65a9647d312745afab80a9306dc44f64` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:26.902609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a9647d312745afab80a9306dc44f64)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:26.904681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:27.113018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a9647d312745afab80a9306dc44f64', 'request_id': 'req-8dcdf564-67ae-4cab-9116-590f9a5f5fae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.251438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a9647d312745afab80a9306dc44f64', 'request_id': 'req-8dcdf564-67ae-4cab-9116-590f9a5f5fae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.266877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a9647d312745afab80a9306dc44f64', 'request_id': 'req-8dcdf564-67ae-4cab-9116-590f9a5f5fae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.300266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] The token cache is being invalidate because project 65a9647d312745afab80a9306dc44f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:27.300865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.302062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.303939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 898/1782] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:26 2022] DELETE /identity/v3/projects/65a9647d312745afab80a9306dc44f64 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:27.308751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:27.325197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08ffe-79a1-4c4d-aa42-62e5334b4598 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:27.474262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:27.475689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:27.476122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:27.476402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] PATH_INFO: `/v3/users/03a40c4ca30a4ae4a2fc574998ed5dc3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:27.478280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a40c4ca30a4ae4a2fc574998ed5dc3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:27.480468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:27.783181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a40c4ca30a4ae4a2fc574998ed5dc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.785580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a40c4ca30a4ae4a2fc574998ed5dc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.798601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a40c4ca30a4ae4a2fc574998ed5dc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.800513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a40c4ca30a4ae4a2fc574998ed5dc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.936076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bde0f74-e904-4860-9c3b-7d0c6b108979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a40c4ca30a4ae4a2fc574998ed5dc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:27.965387 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 885/1783] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:27 2022] DELETE /identity/v3/users/03a40c4ca30a4ae4a2fc574998ed5dc3 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:28.152785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:28.156107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:28.328357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdf564-67ae-4cab-9116-590f9a5f5fae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:28.462963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:28.468521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:28.468815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:28.469127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:28.476365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:28.584388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:28.590314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:28.637561 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 899/1784] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:28.830229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:28.838315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:28.838315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:28.867946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] MFA Rules not processed for user `2096bbb8aff742b1837931e52ac1c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:28.869445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:28.978677 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 886/1785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:28.987275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:28.987275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:29.029053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:29.030997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:29.124827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5757e-56b9-4cc5-8071-1990b60d7bc8 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:29.133670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:29.134497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:29.135004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:29.135374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:29.136554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:29.144311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:29.194961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b1db2-da4e-4456-8ac9-39838288861b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:29.203698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:29.204956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:29.205645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:29.206505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] PATH_INFO: `/v3/projects/eed72c15c2e74cc991dc483719fdd2ab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:29.208617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed72c15c2e74cc991dc483719fdd2ab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:29.211626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:29.565965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 900/1786] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:28 2022] POST /identity/v3/projects => generated 397 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:29.579082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:29.644943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4d834-725f-4120-8c04-d9c5c5b3c7da admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:29.651273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:29.651918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:29.652198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:29.652469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:29.653114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:29.655074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:29.697072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed72c15c2e74cc991dc483719fdd2ab', 'request_id': 'req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:29.702283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed72c15c2e74cc991dc483719fdd2ab', 'request_id': 'req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:29.788760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 901/1787] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:29 2022] POST /identity/v3/users => generated 305 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:29.799426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:29.799426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:29.825147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed72c15c2e74cc991dc483719fdd2ab', 'request_id': 'req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:29.851411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] The token cache is being invalidate because project eed72c15c2e74cc991dc483719fdd2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:29.852707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:29.855395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5eabb744-0b1d-4867-8d03-9f1eb82cd66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:29.859530 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 887/1788] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:29 2022] DELETE /identity/v3/projects/eed72c15c2e74cc991dc483719fdd2ab => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:29.861250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:29.861705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:29.862053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:29.914860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] MFA Rules not processed for user `464f9e9314154e3f9c779b9ae10b2a73`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:29.916094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:29.936114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0974a-e905-472d-bc61-4c8a5955aea0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.020597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 888/1789] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:30.021643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.025137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:30.088128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.088861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.090367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.090653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.094285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:30.179636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600759e7-3eb0-45da-af3c-0bcd9de26a04 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.186699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.187714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.188376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.189107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.190106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.192949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219537ba-2b50-47ed-bed2-fae6f4ca3e0b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.211312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.213734 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 889/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:30.215327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16952e-d4b4-4c4d-935d-f39a7c9e1570 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.215714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16952e-d4b4-4c4d-935d-f39a7c9e1570 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.216090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16952e-d4b4-4c4d-935d-f39a7c9e1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.219028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.234914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 902/1791] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:30.237001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.248060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd16952e-d4b4-4c4d-935d-f39a7c9e1570 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:30.249457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd16952e-d4b4-4c4d-935d-f39a7c9e1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:30.257233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d4a42-b565-4a09-be39-1ad80d69b831 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.263481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 890/1792] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:30.269651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.271597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.272068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.272547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] PATH_INFO: `/v3/projects/8348044d5ea546a48d0ad2d2de60298b/users/87e70e80072d4b4b86392aae982b9d06/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.272960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.273457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.273946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.295419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8348044d5ea546a48d0ad2d2de60298b, user_id=87e70e80072d4b4b86392aae982b9d06, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.299811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.300493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:30.303994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:30.318161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 891/1793] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:30.322322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.340458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db865bc3-7cf7-4485-9bba-e9b4cbe23f85 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.349436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.349436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.349436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.349436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.349840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:30.350212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.352876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.366899 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 903/1794] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:30 2022] PUT /identity/v3/projects/8348044d5ea546a48d0ad2d2de60298b/users/87e70e80072d4b4b86392aae982b9d06/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:30.371189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.395023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 892/1795] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:30.396738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.410200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028d97-0595-4f1f-8687-c6977db7e84c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.484806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babf68-f5a3-4326-a3f4-f7d4777a58c7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.491419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.492102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.492380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.493009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.494024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.494355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.495336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.495758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.496136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.496954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.497487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.500227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.531269 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 904/1796] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:30.533647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.546194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70274e7-049b-40b3-ae2c-dea2cd297bb6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.552263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.554011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.554290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.554555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] PATH_INFO: `/v3/projects/8348044d5ea546a48d0ad2d2de60298b/users/87e70e80072d4b4b86392aae982b9d06/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.556811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8348044d5ea546a48d0ad2d2de60298b, user_id=87e70e80072d4b4b86392aae982b9d06, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.560300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:30.576242 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 905/1797] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:30 2022] PUT /identity/v3/projects/8348044d5ea546a48d0ad2d2de60298b/users/87e70e80072d4b4b86392aae982b9d06/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:30.659996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 893/1798] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:30 2022] POST /identity/v3/projects => generated 375 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:30.665469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:30.817283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9689bcc-0252-4e53-aaf9-313c19b943f1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:30.954571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:30.961441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:30.963216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:30.963510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:30.964517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:30.973493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:31.114144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 906/1799] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:30 2022] POST /identity/v3/users => generated 288 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:31.127107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:31.151969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebb64-a55e-4c12-98da-a973464a9532 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:31.158210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:31.159862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:31.160308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:31.160789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:31.161607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:31.163356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:31.176015 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 894/1800] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:31.180433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:31.192924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c93d9-f902-4350-baa0-52cfabf23406 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:31.199009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:31.199851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:31.200200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:31.200482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:31.201428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:31.203324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7b4e6-35bf-456f-bbf0-4a63c40b8cc3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:31.216243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 907/1801] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:31.220216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:31.251406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce7df2-dc09-4480-b39b-8814579229a7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:31.266306 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:31.266306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:31.266306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:31.266306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:31.266770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] PATH_INFO: `/v3/projects/237945179ea74c5da014b93bd4f042fc/users/e9df19b810714890b5a3b67e405eee60/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:31.333217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237945179ea74c5da014b93bd4f042fc, user_id=e9df19b810714890b5a3b67e405eee60, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:31.336435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:31.464847 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 895/1802] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:31 2022] PUT /identity/v3/projects/237945179ea74c5da014b93bd4f042fc/users/e9df19b810714890b5a3b67e405eee60/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:31.464940 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:31.466954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:31.467459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:31.467916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:31.536862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] MFA Rules not processed for user `e9df19b810714890b5a3b67e405eee60`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:31.538317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:31.753717 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 908/1803] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:31.754396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:31.928797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743c1ed-c82b-4f99-a479-d55fea3c4544 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:31.954544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:31.955354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:31.955785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:31.956132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:31.960281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:31.973414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:32.105877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:32.107636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:32.126403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 896/1804] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:32.132036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:32.270848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9834b2-f993-4540-835f-87a2d03c3d45 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:32.332585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a8025-c9f5-4dcb-b8f7-4accdbfe95d3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:32.357874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:32.361844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:32.368254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:32.368847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:32.370325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:32.380248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:32.483182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:32.483850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:32.484111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:32.484700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:32.487517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:32.572710 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 897/1805] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:32 2022] POST /identity/v3/users => generated 293 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:32.577897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:32.602639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:32.604732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:32.627128 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 909/1806] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:32.631100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595b1b-dee4-4afe-864d-c58dbf80ca6a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:32.647260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:32.648563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:32.649018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:32.649642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:32.650922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:32.653529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:32.681446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 898/1807] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:32.685114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:32.700266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98b89-943e-46e9-98b0-cbd2350a9ae8 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:32.707538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:32.707538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:32.707538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:32.708413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] PATH_INFO: `/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1/users/7d80c4224e7345989d98ff2cc02acac1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:32.734310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7074abc92f4a0dad3022657ec5d6b1, user_id=7d80c4224e7345989d98ff2cc02acac1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:32.738099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:32.885800 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 910/1808] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:32 2022] PUT /identity/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1/users/7d80c4224e7345989d98ff2cc02acac1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:32.889908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:32.917041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fef1f-1480-4de6-9b90-6f84be2b2e9f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.022647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.024423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.025033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.025452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.026256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.028733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91901bb3-23fb-43ef-978b-a9d10d6383e7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.056725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 899/1809] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:33.060805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:33.074624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19218eb-3619-4761-9181-d2d19e13a305 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.080592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.080758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.080982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.081956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] PATH_INFO: `/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1/users/7d80c4224e7345989d98ff2cc02acac1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.087597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7074abc92f4a0dad3022657ec5d6b1, user_id=7d80c4224e7345989d98ff2cc02acac1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.091387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.108273 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 911/1810] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:33 2022] PUT /identity/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1/users/7d80c4224e7345989d98ff2cc02acac1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:33.124990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.125431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.125783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.160873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] MFA Rules not processed for user `7d80c4224e7345989d98ff2cc02acac1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:33.160873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:33.255689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 900/1811] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:33.263065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:33.275985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253ab9-8913-4172-a2b7-cd46566a961d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.282797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.283623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.283967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.284380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.285096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:33.285523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.287249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.305536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:33.305796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 912/1812] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:33.317067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9be62-be17-4297-a3ee-a442cfb34f73 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.333220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.334234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.334669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.336106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.336106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.337704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.506341 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 901/1813] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:33 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:33.510529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:33.525967 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:33.541588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085cb7c-5923-41c8-b91c-7bf5228a62a7 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.678615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.680162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.681684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.682112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.683239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:33.685831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.688919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.690114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:33.692861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:33.741503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 913/1814] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:33.791845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbddd0c-b98f-40f7-9ae3-42f50aa1ee56 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:33.801452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:33.802079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:33.802357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:33.813831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:33.816522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:33.834936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:33.834936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ec1d7-9885-4b4c-8ec1-3f8402ce9436 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:33.844370 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 902/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:33.884523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:34.015679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efd193-3edf-4fb4-9981-3fd44de5aafa tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:34.024006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:34.024872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:34.025157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:34.025467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:34.036548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:34.037813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:34.050649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 914/1816] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:34.072953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344c06-35ba-4190-b797-5649b5ceb284 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:34.073613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344c06-35ba-4190-b797-5649b5ceb284 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:34.074080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344c06-35ba-4190-b797-5649b5ceb284 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:34.077148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 903/1817] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:34.083286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:34.098695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:34.111202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e515a-315a-465e-be41-af57c6cd9990 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:34.120784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:34.121583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:34.122403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:34.122754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects/418a796af9844d45b2e4fe65ad1f9f61` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:34.125528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a796af9844d45b2e4fe65ad1f9f61)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:34.127765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:34.139664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 915/1818] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:34 2022] GET /identity/v3/projects/418a796af9844d45b2e4fe65ad1f9f61 => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:34.853139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce298ae-d0cf-4e63-96f9-5bb5e53a2bcb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:34.863562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce298ae-d0cf-4e63-96f9-5bb5e53a2bcb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:34.863562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce298ae-d0cf-4e63-96f9-5bb5e53a2bcb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:34.863562 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 904/1819] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:34.864060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:34.881385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:34.902947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568fd43-d3b0-4495-8049-b6dbee547fc5 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:34.925941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:34.927073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:34.927359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:34.927625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects/418a796af9844d45b2e4fe65ad1f9f61` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:34.929178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a796af9844d45b2e4fe65ad1f9f61)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:34.934191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:34.953639 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 916/1820] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:34 2022] GET /identity/v3/projects/418a796af9844d45b2e4fe65ad1f9f61 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:35.005263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce298ae-d0cf-4e63-96f9-5bb5e53a2bcb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:35.023612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce298ae-d0cf-4e63-96f9-5bb5e53a2bcb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:35.033622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:35.036937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.036937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.036937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.036937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:35.036937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:35.038343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:35.061834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 905/1821] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:35.063608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:35.093282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee170d0-41f9-48b3-ba13-bfc5a6c6822f tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:35.114221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:35.117554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.117554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.117554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.117554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:35.120151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018738-2c1b-4081-9690-fea949baa807 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:35.142366 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:35.305968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 917/1822] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:35 2022] POST /identity/v3/users => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:35.307242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:35.327621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36becfc1-28b7-412a-b607-c796a959faa1 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:35.333643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:35.334833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.335284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.335719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.336551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:35.337028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:35.338880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79175b52-a5ab-4432-b38f-13edbb9a1c61 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:35.369412 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 906/1823] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:35.737810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.738494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.738977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.741100 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 918/1824] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:35.749527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee430c-d93b-4875-b5c3-e5c55674b50e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.751507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee430c-d93b-4875-b5c3-e5c55674b50e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.751507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee430c-d93b-4875-b5c3-e5c55674b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.788401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-54ee430c-d93b-4875-b5c3-e5c55674b50e None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:35.789921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54ee430c-d93b-4875-b5c3-e5c55674b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:35.817057 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 907/1825] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:14:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:35.859595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:35.868078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:35.924534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.925999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.925999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.928222 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 908/1826] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:14:35.949060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:35.968472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:35.981186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4029-39ca-4f2d-97c3-b01b1cb2ea86 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:35.989148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:35.990408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:35.990960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:35.991442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects/418a796af9844d45b2e4fe65ad1f9f61` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:35.993182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a796af9844d45b2e4fe65ad1f9f61)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:35.995771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4eca-e0d8-4ee0-9fb9-0745bc4e98e0 tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:35.998169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 909/1827] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:35 2022] GET /identity/v3/projects/418a796af9844d45b2e4fe65ad1f9f61 => generated 371 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:36.048993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203a5b9-860c-4a6e-b548-4b7a6dd18110 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:36.054771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:36.055757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:36.056396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:36.056896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:36.071745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:36.074280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:36.093840 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 919/1828] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:36.120010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fc07-cd8c-4f32-9b44-82a6c487ed74 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:36.121048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fc07-cd8c-4f32-9b44-82a6c487ed74 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:36.121692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fc07-cd8c-4f32-9b44-82a6c487ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:36.150631 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:36.177380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c487fc07-cd8c-4f32-9b44-82a6c487ed74 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:36.179770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c487fc07-cd8c-4f32-9b44-82a6c487ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:36.194766 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 910/1829] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:36.220990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:36.236024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d2bb5-1964-4251-a6a0-a27afdfea1b2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:36.246076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:36.246696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:36.246972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:36.247238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:36.271602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:36.274885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:36.298584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 920/1830] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:37.271541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c84c5f-3b7c-4798-afbe-e0cb0ce61074 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:37.273047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c84c5f-3b7c-4798-afbe-e0cb0ce61074 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:37.273583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c84c5f-3b7c-4798-afbe-e0cb0ce61074 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:37.276693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 911/1831] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:14:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:14:37.281824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:14:37.305367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:37.326588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e525-12b0-4efe-a66a-dabde0da205d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:37.334435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:37.334727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:37.335320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:37.337608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects/418a796af9844d45b2e4fe65ad1f9f61` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:37.339395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:get_project(project_id=418a796af9844d45b2e4fe65ad1f9f61)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:37.341750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:37.343981 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 921/1832] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:14:37 2022] GET /identity/v3/projects/418a796af9844d45b2e4fe65ad1f9f61 => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:37.401299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c84c5f-3b7c-4798-afbe-e0cb0ce61074 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:37.431892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c84c5f-3b7c-4798-afbe-e0cb0ce61074 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:37.453593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:37.456134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:37.456473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:37.456754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/users/09a48d36a0b546cd8c86e0c745b47d27` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:37.501815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:delete_user(user_id=09a48d36a0b546cd8c86e0c745b47d27)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:37.504588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:37.720614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a48d36a0b546cd8c86e0c745b47d27'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:37.721314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a48d36a0b546cd8c86e0c745b47d27'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:37.730828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a48d36a0b546cd8c86e0c745b47d27'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:37.732244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a48d36a0b546cd8c86e0c745b47d27'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:37.854898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a48d36a0b546cd8c86e0c745b47d27'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:37.904072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 912/1833] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:37 2022] DELETE /identity/v3/users/09a48d36a0b546cd8c86e0c745b47d27 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:37.908135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:37.911660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:37.942243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb55b9-b0c4-4ca2-9707-28b2a5c3241a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:38.113183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d80c4224e7345989d98ff2cc02acac1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc7074abc92f4a0dad3022657ec5d6b1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:38.113839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:38.114294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:38.114734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] PATH_INFO: `/v3/projects/418a796af9844d45b2e4fe65ad1f9f61` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:38.116209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorizing `identity:delete_project(project_id=418a796af9844d45b2e4fe65ad1f9f61)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:38.118750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:38.133887 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:38.305146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418a796af9844d45b2e4fe65ad1f9f61', 'request_id': 'req-32669c8c-0256-47e5-9b70-b57a808128cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.386065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418a796af9844d45b2e4fe65ad1f9f61', 'request_id': 'req-32669c8c-0256-47e5-9b70-b57a808128cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.389472 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:38.395807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418a796af9844d45b2e4fe65ad1f9f61', 'request_id': 'req-32669c8c-0256-47e5-9b70-b57a808128cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.426889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] The token cache is being invalidate because project 418a796af9844d45b2e4fe65ad1f9f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:38.429383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.430760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.438457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 922/1834] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:37 2022] DELETE /identity/v3/projects/418a796af9844d45b2e4fe65ad1f9f61 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:38.444546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:38.444990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:38.592171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74c644-842f-4d0f-b819-f1c9df2daa8a tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:38.698920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:38.699826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:38.700269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:38.700709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] PATH_INFO: `/v3/users/e9df19b810714890b5a3b67e405eee60` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:38.702379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9df19b810714890b5a3b67e405eee60)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:38.704589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:38.838416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:38.840703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:38.869147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669c8c-0256-47e5-9b70-b57a808128cc tempest-QuotasAdminTestV257-389695146 tempest-QuotasAdminTestV257-389695146-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:38.873988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:38.874632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:38.874905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:38.875179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] PATH_INFO: `/v3/users/ae9211a459e946c1a114983c531a8897` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:38.876372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9211a459e946c1a114983c531a8897)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:38.878424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:38.959532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9df19b810714890b5a3b67e405eee60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.960508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9df19b810714890b5a3b67e405eee60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.977595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9df19b810714890b5a3b67e405eee60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:38.980343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9df19b810714890b5a3b67e405eee60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.076611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c73286a-9d1f-4be0-92f5-2f72c9a79348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9df19b810714890b5a3b67e405eee60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.101034 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 913/1835] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:38 2022] DELETE /identity/v3/users/e9df19b810714890b5a3b67e405eee60 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:39.106669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4457-5b7f-4e1d-9dcd-2c89b6a6511c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:39.107025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4457-5b7f-4e1d-9dcd-2c89b6a6511c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:39.107878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d4457-5b7f-4e1d-9dcd-2c89b6a6511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:39.144762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b42d4457-5b7f-4e1d-9dcd-2c89b6a6511c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:39.146369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b42d4457-5b7f-4e1d-9dcd-2c89b6a6511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:39.151435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9211a459e946c1a114983c531a8897'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.245571 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 914/1836] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:39.254952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9211a459e946c1a114983c531a8897'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.255677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9211a459e946c1a114983c531a8897'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.276246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9211a459e946c1a114983c531a8897'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.319378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9211a459e946c1a114983c531a8897'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:39.357486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 923/1837] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:38 2022] DELETE /identity/v3/users/ae9211a459e946c1a114983c531a8897 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:39.363402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:39.363402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:39.363402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:39.373976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:39.396069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:39.434496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:39.435852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:39.537102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 915/1838] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:39.570777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376caf3-541e-4284-9e5b-a987085f797d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:39.578466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:39.578466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:39.578466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:39.578466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:39.580389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:39.584433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:39.586324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:39.607320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf7feb-fbff-4f39-81f5-6eb192b55e13 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:39.616950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:39.618027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:39.625119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:39.625119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d66c4b-e830-4338-add9-b48186c9cf6c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:39.625648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:39.626383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:39.645585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:39.655792 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 924/1839] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:39.656078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15decc50-c615-44ef-a103-3881efe56237 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:39.667966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 916/1840] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:40.017592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:40.018559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:40.020959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:40.125591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] MFA Rules not processed for user `87e70e80072d4b4b86392aae982b9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:40.127168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.184513 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:40.315381 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 925/1841] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:40.327743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:40.328032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:40.328362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:40.363743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] MFA Rules not processed for user `2096bbb8aff742b1837931e52ac1c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:40.366071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.463129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 917/1842] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:40.486135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:40.491478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.583997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:40.583997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.604565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7addc2-73b7-4f96-8235-10a563198580 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:40.604718 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:40.623054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e932-4351-49db-882c-355dd273e0fc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:40.629902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:40.630660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:40.630798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:40.631141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:40.631358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:40.631596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] PATH_INFO: `/v3/projects/ce6543b666064cd78c02ec5a471d003f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:40.631726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:40.631975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:40.637001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6543b666064cd78c02ec5a471d003f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:40.640810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.642370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:40.678756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:40.678756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:40.685415 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 926/1843] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:40.813177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6543b666064cd78c02ec5a471d003f', 'request_id': 'req-ca12fb66-9250-4ea5-b774-dc0883c13225'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:40.820858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6543b666064cd78c02ec5a471d003f', 'request_id': 'req-ca12fb66-9250-4ea5-b774-dc0883c13225'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:40.839131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:40.840580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.857795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ecd23-1f2e-4c37-bd80-815672bdcfe5 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:40.905410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6543b666064cd78c02ec5a471d003f', 'request_id': 'req-ca12fb66-9250-4ea5-b774-dc0883c13225'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:40.924671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] The token cache is being invalidate because project ce6543b666064cd78c02ec5a471d003f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:40.925749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:40.926217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:40.928145 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 918/1844] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:40 2022] DELETE /identity/v3/projects/ce6543b666064cd78c02ec5a471d003f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:40.932236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:40.933944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:40.964542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:40.965642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:40.966107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:40.966596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] PATH_INFO: `/v3/projects/237945179ea74c5da014b93bd4f042fc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:40.968411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237945179ea74c5da014b93bd4f042fc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:40.970895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:41.022152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12fb66-9250-4ea5-b774-dc0883c13225 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:41.036326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:41.042583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:41.057369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:41.057369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] PATH_INFO: `/v3/users/b96f9e0241064bb69711a89f1f0bc2ae` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:41.057369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96f9e0241064bb69711a89f1f0bc2ae)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:41.057369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:41.118806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237945179ea74c5da014b93bd4f042fc', 'request_id': 'req-3244ee07-84f5-4a00-86f0-e87c82c212c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.189319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237945179ea74c5da014b93bd4f042fc', 'request_id': 'req-3244ee07-84f5-4a00-86f0-e87c82c212c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.202861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237945179ea74c5da014b93bd4f042fc', 'request_id': 'req-3244ee07-84f5-4a00-86f0-e87c82c212c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.235528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] The token cache is being invalidate because project 237945179ea74c5da014b93bd4f042fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:41.235880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.236646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.239002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 927/1845] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:40 2022] DELETE /identity/v3/projects/237945179ea74c5da014b93bd4f042fc => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:41.243956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:41.246731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:41.256617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96f9e0241064bb69711a89f1f0bc2ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.257624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96f9e0241064bb69711a89f1f0bc2ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.275216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96f9e0241064bb69711a89f1f0bc2ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.276208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96f9e0241064bb69711a89f1f0bc2ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.332898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96f9e0241064bb69711a89f1f0bc2ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.360643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244ee07-84f5-4a00-86f0-e87c82c212c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:41.363847 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 919/1846] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:40 2022] DELETE /identity/v3/users/b96f9e0241064bb69711a89f1f0bc2ae => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:41.479133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:41.481872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:41.482569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:41.482844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] PATH_INFO: `/v3/users/7d80c4224e7345989d98ff2cc02acac1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:41.485162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d80c4224e7345989d98ff2cc02acac1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:41.487215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:41.653052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:41.655179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:41.674778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee20c5-6fc0-4df8-a82e-ca8dcb331a6b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:41.677018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:41.677742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:41.678035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:41.678312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] PATH_INFO: `/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:41.679687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd04564aa9a44f7bff9ed4d1d322176)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:41.681706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:41.748377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d80c4224e7345989d98ff2cc02acac1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.814938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd04564aa9a44f7bff9ed4d1d322176', 'request_id': 'req-b72c75f7-20ca-481f-b27d-93fdb3167eec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.874563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd04564aa9a44f7bff9ed4d1d322176', 'request_id': 'req-b72c75f7-20ca-481f-b27d-93fdb3167eec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.894527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d80c4224e7345989d98ff2cc02acac1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.895374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d80c4224e7345989d98ff2cc02acac1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.918579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d80c4224e7345989d98ff2cc02acac1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.957057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1dc40da-76be-4bd9-b375-c29ed97a6c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d80c4224e7345989d98ff2cc02acac1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:41.979503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 928/1847] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:41 2022] DELETE /identity/v3/users/7d80c4224e7345989d98ff2cc02acac1 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:41.991865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd04564aa9a44f7bff9ed4d1d322176', 'request_id': 'req-b72c75f7-20ca-481f-b27d-93fdb3167eec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.008033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] The token cache is being invalidate because project dcd04564aa9a44f7bff9ed4d1d322176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:42.008455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.013874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.026695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:41 2022] DELETE /identity/v3/projects/dcd04564aa9a44f7bff9ed4d1d322176 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:42.029988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6ca7-96c1-4f76-bcc5-ea2694621454 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.030338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6ca7-96c1-4f76-bcc5-ea2694621454 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.030611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba6ca7-96c1-4f76-bcc5-ea2694621454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.059195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3dba6ca7-96c1-4f76-bcc5-ea2694621454 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:42.062567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3dba6ca7-96c1-4f76-bcc5-ea2694621454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.082121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.084426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.199125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 929/1849] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:42.200613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.200931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.201790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.236331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:42.238423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.256117 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 930/1850] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:42.257963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.273257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c75f7-20ca-481f-b27d-93fdb3167eec admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.273537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412869-a259-461f-972b-678d2f6d5e37 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.289734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.289734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.289922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.289922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.290099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.290099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] PATH_INFO: `/v3/users/3d46ad002b4d4e7b82c455ee8d2cd2ab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.297388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.297388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.297857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d46ad002b4d4e7b82c455ee8d2cd2ab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.297857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.298037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:42.298037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.299964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.324687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 931/1851] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:42.329357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.342106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdde7b-e751-4b1f-9f34-85fa6ad81419 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.349213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.350103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.353253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.353253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.353253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.354546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.481704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 932/1852] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:42.486059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.550920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d46ad002b4d4e7b82c455ee8d2cd2ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.553620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d46ad002b4d4e7b82c455ee8d2cd2ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.561178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6787d4-b3c0-4058-80d7-5044abd90db9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.565494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d46ad002b4d4e7b82c455ee8d2cd2ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.571448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d46ad002b4d4e7b82c455ee8d2cd2ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.571584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.571584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.571584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.571584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.571906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.571906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.711991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d46ad002b4d4e7b82c455ee8d2cd2ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:42.720927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 933/1853] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:42 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:42.720927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.724540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.751438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 921/1854] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:42 2022] DELETE /identity/v3/users/3d46ad002b4d4e7b82c455ee8d2cd2ab => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:42.752190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.756035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.772124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f882-53cf-4037-b4d6-c7894caf1ed2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.873820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.874570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.875038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.875385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] PATH_INFO: `/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.877656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7074abc92f4a0dad3022657ec5d6b1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.880064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.880209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979b3c-ab8e-4fc3-b11a-87fdcea2fd3c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:42.888363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:42.890341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.892453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.892453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.892453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:42.895123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c3823-b8b4-49d4-a87e-b17e04594d20 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:42.913501 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 922/1855] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:42.913501 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:42.921284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:42.921284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:42.921284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:42.947343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:42.965607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:42.965607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 923/1856] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:42.967632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:42.989822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcded7b4-d189-480c-9a68-de9e48fb21f4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.000883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.001813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.002093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.002365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.003018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.005398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.020395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 924/1857] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:43.024884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.027228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.041712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7074abc92f4a0dad3022657ec5d6b1', 'request_id': 'req-aed6408d-f7c7-436f-94b9-81e2e500208e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:43.126313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7074abc92f4a0dad3022657ec5d6b1', 'request_id': 'req-aed6408d-f7c7-436f-94b9-81e2e500208e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:43.135124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03756e2-7639-4fc2-a8d4-34be50b3bdf2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.136144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7074abc92f4a0dad3022657ec5d6b1', 'request_id': 'req-aed6408d-f7c7-436f-94b9-81e2e500208e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:43.157382 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:43.162676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] The token cache is being invalidate because project dc7074abc92f4a0dad3022657ec5d6b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:43.162970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:43.163843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:43.165820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 934/1858] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:42 2022] DELETE /identity/v3/projects/dc7074abc92f4a0dad3022657ec5d6b1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:43.166744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.168541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.215438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.216022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.216420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.216938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.219537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.283263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6408d-f7c7-436f-94b9-81e2e500208e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.290207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.290798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.291073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.291349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] PATH_INFO: `/v3/projects/0893c86ffc274a5e88fad1572c298336/users/5213b6a5279a41f0a59b075d641da09a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.344799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0893c86ffc274a5e88fad1572c298336, user_id=5213b6a5279a41f0a59b075d641da09a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.350482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.351933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa3942-129f-4b83-b898-36eaf2143e0d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.360919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e91dd9-3b76-47a1-9745-6324c614b8cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.374967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 925/1859] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:43.376303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2eece-ee9b-4222-98a0-353c7ad1efbe None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.376589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2eece-ee9b-4222-98a0-353c7ad1efbe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.376864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2eece-ee9b-4222-98a0-353c7ad1efbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.403634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-def2eece-ee9b-4222-98a0-353c7ad1efbe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:43.405731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-def2eece-ee9b-4222-98a0-353c7ad1efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.420926 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 926/1860] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:43.429820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.430331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.430801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.455450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:43.458398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.471911 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 927/1861] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:43.474463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.485508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27befd7-7df1-4d24-9a42-661b5183e186 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.492097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.492727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.493135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.493468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.494114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:43.495338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.496105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.519866 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 928/1862] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:43.527745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.528909 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 935/1863] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:43 2022] PUT /identity/v3/projects/0893c86ffc274a5e88fad1572c298336/users/5213b6a5279a41f0a59b075d641da09a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:43.540817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.541181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.541496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.545861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e555a2-20d0-495e-9f5d-f52fe53be9f9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.616187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] MFA Rules not processed for user `5213b6a5279a41f0a59b075d641da09a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:43.628037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:43.683873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.684487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.684741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.685013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.685686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.687817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.717982 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 936/1864] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:43.722819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.739216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec032f-51d1-46a0-bd79-0642ae7b47cb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:43.755693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:43.756521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:43.756858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:43.757285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:43.758217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:43.760372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:43.846128 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 929/1865] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/projects => generated 391 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:43.855069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:43.891831 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 937/1866] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:43.898145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.007118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbff8db-e24d-4738-b1b6-33924a9c9495 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.025881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dee9f-c327-43eb-a80a-12c52454c6c0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.031018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.032235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.033357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.033921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.036467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.043933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.048378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.049325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.050131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.051105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.051858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.054118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.140746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 930/1867] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:44.146796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.163546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4a56-667e-4efc-916a-2b5143399b9f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.175699 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 938/1868] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:43 2022] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:44.180269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.180629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.182696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.183358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.185129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.185861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.187566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.197690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c6220-643b-42ec-9115-342a67d31438 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.208228 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:44.208569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.209449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.210044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.210814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.211774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.212345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.213857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.236326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 939/1870] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:44.237674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609396ed-256d-4036-aa97-801a9ffbed12 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.241965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.247431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.248072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.248346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.248613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.249275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.252679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.255948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc78ed-115b-49fe-85f4-d3e738de0048 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.261553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.262565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.262883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.263254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] PATH_INFO: `/v3/projects/ff67f50f216e4532b774954bf311b5f1/users/89b622b3fa7d42acae17f76213d4298c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.267994 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 932/1871] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:44.274088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.289240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab13ab-ffa8-4d68-b8f7-e283e52daae7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.291918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff67f50f216e4532b774954bf311b5f1, user_id=89b622b3fa7d42acae17f76213d4298c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.294879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.297027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.298161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.298560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.299481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] PATH_INFO: `/v3/projects/3ee1e04c04bc40568e43eb98df39e7e6/users/51ccc0bfdee94961aa198e3abf0d85cc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.325616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1e04c04bc40568e43eb98df39e7e6, user_id=51ccc0bfdee94961aa198e3abf0d85cc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.328722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c249-f84f-440d-b83d-7b8b3c5918a8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.373515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 940/1872] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:44 2022] PUT /identity/v3/projects/ff67f50f216e4532b774954bf311b5f1/users/89b622b3fa7d42acae17f76213d4298c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:44.378485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.411146 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 933/1873] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:44 2022] PUT /identity/v3/projects/3ee1e04c04bc40568e43eb98df39e7e6/users/51ccc0bfdee94961aa198e3abf0d85cc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:44.423554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.424099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.424373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.486168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] MFA Rules not processed for user `51ccc0bfdee94961aa198e3abf0d85cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:44.488181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:44.499435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2b8e1-7cfa-4d2c-8eb3-8c09a72ba6f0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.569914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.570885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.571552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.572206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.573400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.575190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.595143 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 941/1874] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:44.595331 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 934/1875] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:44.596136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.596250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.597905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:44.610687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41a597-b9d3-4100-a42a-64216d94a1c2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.617313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf24-a1ac-4cfa-9dcc-7380d47f754f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.617834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.618441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.618886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.619172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] PATH_INFO: `/v3/projects/ff67f50f216e4532b774954bf311b5f1/users/89b622b3fa7d42acae17f76213d4298c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.621459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff67f50f216e4532b774954bf311b5f1, user_id=89b622b3fa7d42acae17f76213d4298c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.622338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.623125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.623479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.623847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] PATH_INFO: `/v3/projects/7125ddd978584c4b8f1b196e6cc62e94` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.624174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.625168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7125ddd978584c4b8f1b196e6cc62e94)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.627515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.640597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 935/1876] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:44 2022] PUT /identity/v3/projects/ff67f50f216e4532b774954bf311b5f1/users/89b622b3fa7d42acae17f76213d4298c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:44.641617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.731123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c41b5-062e-4073-ae39-0bfd49f2a663 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:44.736591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:44.737209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.737629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.737921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.738566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:44.740493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d818a29-8eac-4416-8264-d508b549e8ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:44.788395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7125ddd978584c4b8f1b196e6cc62e94', 'request_id': 'req-0d6230c2-9174-492a-9a08-4fd9362abe84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:44.832418 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 936/1877] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:44 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:44.834083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:44.834549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:44.835028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:44.875615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7125ddd978584c4b8f1b196e6cc62e94', 'request_id': 'req-0d6230c2-9174-492a-9a08-4fd9362abe84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:44.876822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] MFA Rules not processed for user `89b622b3fa7d42acae17f76213d4298c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:44.879025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:44.886495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7125ddd978584c4b8f1b196e6cc62e94', 'request_id': 'req-0d6230c2-9174-492a-9a08-4fd9362abe84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:44.900500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] The token cache is being invalidate because project 7125ddd978584c4b8f1b196e6cc62e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:44.900878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:44.901675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:44.906724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 942/1878] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:44 2022] DELETE /identity/v3/projects/7125ddd978584c4b8f1b196e6cc62e94 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:44.906724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.906724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:44.973300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 937/1879] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:44.974429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:44.975943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:45.004372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6230c2-9174-492a-9a08-4fd9362abe84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.079002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28813941-6df8-4864-864c-e2d12b10fe11 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.086593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.087332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.087679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.088023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] PATH_INFO: `/v3/users/aa3da3ec33c7409a8c0463bf64d50400` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.089229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3da3ec33c7409a8c0463bf64d50400)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:45.091326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:45.094354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.095295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.095793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.096282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.097493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:45.102160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:45.245775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 943/1880] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:44 2022] POST /identity/v3/users => generated 302 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:45.247044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:45.250953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:45.332024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3da3ec33c7409a8c0463bf64d50400'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:45.333111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3da3ec33c7409a8c0463bf64d50400'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:45.358873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3da3ec33c7409a8c0463bf64d50400'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:45.363610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3da3ec33c7409a8c0463bf64d50400'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:45.384404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6120-560a-4c49-88f8-8dcbabdb0726 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.396093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.397519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.397881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.399144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.401682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:45.420857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:45.422799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:45.439773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 944/1881] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:45.441114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:45.442605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:45.458354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3da3ec33c7409a8c0463bf64d50400'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:45.466963 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:45.473179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa4dc7-c102-42f7-8268-8ab80f8cb5c6 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.490049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.495685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.495685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.495685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.495685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:45.502428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:45.508717 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 938/1882] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:44 2022] DELETE /identity/v3/users/aa3da3ec33c7409a8c0463bf64d50400 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:45.528338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 945/1883] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:45.533804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:45.697917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57442-e26a-4122-8c36-1801bcd2d551 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.705518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.706877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.707514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.707514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] PATH_INFO: `/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed/users/e5cba98608e84304913424e7704c7227/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.766671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:45.767455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4e7dc475b4830af3bbc7a7ba767ed, user_id=e5cba98608e84304913424e7704c7227, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:45.771394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:45.788750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:45.811399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc904c-4032-4ef8-86de-928199a96e66 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:45.863359 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 939/1884] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:45 2022] PUT /identity/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed/users/e5cba98608e84304913424e7704c7227/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:45.867941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:45.936753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:45.938064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:45.938579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:45.939072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:45.946468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.002158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1750f9-8fca-4b63-bb6b-51776b058881 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:46.032012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:46.033514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.033962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.034440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.035468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:46.038310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:46.067843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 940/1885] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:46.070261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:46.096117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c792c9-9648-4d7e-84cb-4f9c95537a5c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:46.113934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:46.114083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:46.114083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.114083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.114083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] PATH_INFO: `/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed/users/e5cba98608e84304913424e7704c7227/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.114436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00989b-06cf-43fd-8615-4fcca10a4196 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:46.124451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4e7dc475b4830af3bbc7a7ba767ed, user_id=e5cba98608e84304913424e7704c7227, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:46.134709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dd1a9-4bc7-4df4-9c43-874faa29ab6f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:46.148620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 946/1886] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:46.180207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 941/1887] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:46 2022] PUT /identity/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed/users/e5cba98608e84304913424e7704c7227/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:46.194552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.195320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.195818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.197853 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:46.252809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] MFA Rules not processed for user `e5cba98608e84304913424e7704c7227`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:46.255750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.388207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 947/1888] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:46.400359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.400643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.401086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.420783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] MFA Rules not processed for user `51ccc0bfdee94961aa198e3abf0d85cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:46.422160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.427541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:46.429253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.521383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 942/1889] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:46.529494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:46.539749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c7c6-c690-43c5-8501-aba7152a21b6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:46.550681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:46.551630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.552071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.552711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] PATH_INFO: `/v3/projects/c63e7b7a4aef41adaa41001c0129434c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.554116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63e7b7a4aef41adaa41001c0129434c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:46.556675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:46.623876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb03486-cd98-4435-a59d-6b5678999d60 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:46.631824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:46.632456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.632730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.633006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.634826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.646279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:46.648180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0163-8825-4da9-b849-dbac169c6392 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:46.657711 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 943/1890] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:46.706114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63e7b7a4aef41adaa41001c0129434c', 'request_id': 'req-4a937a95-b759-4567-ac5d-6e729ccc0f57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:46.777471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63e7b7a4aef41adaa41001c0129434c', 'request_id': 'req-4a937a95-b759-4567-ac5d-6e729ccc0f57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:46.792660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63e7b7a4aef41adaa41001c0129434c', 'request_id': 'req-4a937a95-b759-4567-ac5d-6e729ccc0f57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:46.808725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] The token cache is being invalidate because project c63e7b7a4aef41adaa41001c0129434c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:46.809018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:46.810021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a937a95-b759-4567-ac5d-6e729ccc0f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:46.816504 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 948/1891] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:46 2022] DELETE /identity/v3/projects/c63e7b7a4aef41adaa41001c0129434c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:46.818452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.819460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.819460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:46.851189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:46.852662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:46.987141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 944/1892] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:46.995726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:46.996298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:46.996777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.040398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:47.041888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:47.063255 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 949/1893] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:47.069872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.084410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba7705-9d5a-4a13-9bdd-afea5d5e820b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.091464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.091891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.092354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.092882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.093641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:47.094032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.095728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.136812 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 945/1894] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:47.138369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.149610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b309b3-c26b-451a-a998-1523bd98b38c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.154586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.155402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.155697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.155966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.156605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.159095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.296400 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 950/1895] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:47 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:47.299427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.323397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcecfa-c4f7-41dc-86e9-e21f564ec927 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.424114 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:47.450056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.457059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.457059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.457059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.457059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.458664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.593035 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 946/1896] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:47 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:47.593635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.593990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.599361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:47.614263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46c123-275d-4285-b137-97cc954b71a2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.622307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.622943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.623482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.624195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.624868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.627434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.630336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1225e2c-bdea-4a10-be9e-e3ec33291824 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.636449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.637200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.637594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.638880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] PATH_INFO: `/v3/users/5213b6a5279a41f0a59b075d641da09a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.640280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5213b6a5279a41f0a59b075d641da09a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.642224 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 947/1897] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:47.642347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.647378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.663761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e135-d2a8-4476-ae3f-85d9b78db311 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.672032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.673477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.673477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.673477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.674397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.682161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.697354 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 948/1898] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:47.705516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:47.719105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96511d6-4cd3-4150-a7ad-37f323162bb3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:47.726633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:47.727461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.727868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.728240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] PATH_INFO: `/v3/projects/e60bc6bb6d7147c9a66f834e9ed1f142/users/b513f0ad8d5940e88a8d5e5a6cc182ba/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.749253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60bc6bb6d7147c9a66f834e9ed1f142, user_id=b513f0ad8d5940e88a8d5e5a6cc182ba, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:47.752528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d0545-8fea-4b31-80a9-fcd51f000548 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:47.896117 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 949/1899] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:47 2022] PUT /identity/v3/projects/e60bc6bb6d7147c9a66f834e9ed1f142/users/b513f0ad8d5940e88a8d5e5a6cc182ba/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:47.908179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:47.914116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:47.914116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:47.916339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5213b6a5279a41f0a59b075d641da09a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:47.970982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] MFA Rules not processed for user `b513f0ad8d5940e88a8d5e5a6cc182ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:47.973005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:48.000583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5213b6a5279a41f0a59b075d641da09a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:48.001628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5213b6a5279a41f0a59b075d641da09a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:48.025433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5213b6a5279a41f0a59b075d641da09a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:48.044397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-78947ec2-62b3-4ee0-ae06-9928bd50206f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5213b6a5279a41f0a59b075d641da09a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:48.055783 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 951/1900] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:47 2022] DELETE /identity/v3/users/5213b6a5279a41f0a59b075d641da09a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:48.061317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:48.061317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:48.061317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:48.082558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:48.084144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:48.161682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 950/1901] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:48.176797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:48.179054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:48.217740 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 952/1902] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:48.232240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:48.234924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:48.243653 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:48.278242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10473aca-ddd2-44a1-961c-f0ae140f4d2d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:48.347487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:48.347487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:48.347487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:48.347487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:48.365892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386bfe6-fba9-47f2-b915-0bd858fe254b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:48.374320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:48.375616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:48.375893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:48.376163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:48.387201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:48.388622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:48.436006 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 953/1903] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:48.440323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:48.442598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:48.454910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 951/1904] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:49.000488 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:49.235788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:49.237366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.250584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb834c4-3991-4480-9032-42ebee817a00 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:49.255862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:49.256579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:49.256924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:49.257261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] PATH_INFO: `/v3/users/b513f0ad8d5940e88a8d5e5a6cc182ba` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:49.259159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b513f0ad8d5940e88a8d5e5a6cc182ba)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:49.260644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:49.328634 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:49.481299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b513f0ad8d5940e88a8d5e5a6cc182ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.501656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:49.503939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.524414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb6e57-d54a-4eac-bb4b-2713c664cbe6 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:49.529900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:49.533289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:49.533289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:49.533289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] PATH_INFO: `/v3/projects/0893c86ffc274a5e88fad1572c298336` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:49.533289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0893c86ffc274a5e88fad1572c298336)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:49.534230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:49.579637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b513f0ad8d5940e88a8d5e5a6cc182ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.580263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b513f0ad8d5940e88a8d5e5a6cc182ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.605482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b513f0ad8d5940e88a8d5e5a6cc182ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.613147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d281c0d-d64d-4bef-80e7-f32278ce6211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b513f0ad8d5940e88a8d5e5a6cc182ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.619205 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 954/1905] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:49 2022] DELETE /identity/v3/users/b513f0ad8d5940e88a8d5e5a6cc182ba => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:49.623456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:49.623811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:49.624095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:49.643841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0893c86ffc274a5e88fad1572c298336', 'request_id': 'req-02a15215-4f91-49bc-b396-3341e426993a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.645377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:49.646605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.652952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0893c86ffc274a5e88fad1572c298336', 'request_id': 'req-02a15215-4f91-49bc-b396-3341e426993a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.707814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 955/1906] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:49.717841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:49.719431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.745165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0893c86ffc274a5e88fad1572c298336', 'request_id': 'req-02a15215-4f91-49bc-b396-3341e426993a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.762810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] The token cache is being invalidate because project 0893c86ffc274a5e88fad1572c298336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:49.763109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.767149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.767149 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 952/1907] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:49 2022] DELETE /identity/v3/projects/0893c86ffc274a5e88fad1572c298336 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:49.769579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:49.771020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.780487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed33d4-7aae-42ea-ab04-6f587783ae4b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:49.783598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15215-4f91-49bc-b396-3341e426993a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:49.786453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:49.787519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:49.787519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:49.787841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:49.789671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:49.789783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:49.790481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:49.790826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:49.791175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] PATH_INFO: `/v3/users/89b622b3fa7d42acae17f76213d4298c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:49.792330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b622b3fa7d42acae17f76213d4298c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:49.794399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:49.802985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:49.804432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:49.814720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 956/1908] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:49.992530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b622b3fa7d42acae17f76213d4298c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:49.993491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b622b3fa7d42acae17f76213d4298c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.001236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b622b3fa7d42acae17f76213d4298c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.002010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b622b3fa7d42acae17f76213d4298c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.093805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28a5108c-a7db-4e9b-9952-5d0f558e6f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b622b3fa7d42acae17f76213d4298c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.135230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 953/1909] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:49 2022] DELETE /identity/v3/users/89b622b3fa7d42acae17f76213d4298c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:50.424690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:50.426286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:50.445710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f10472-14df-4959-be4f-ce902a74354e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:50.573295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:50.574270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:50.574543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:50.574822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] PATH_INFO: `/v3/projects/e60bc6bb6d7147c9a66f834e9ed1f142` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:50.576058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60bc6bb6d7147c9a66f834e9ed1f142)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:50.578389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:50.794698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60bc6bb6d7147c9a66f834e9ed1f142', 'request_id': 'req-4e92925e-b990-4298-85bc-2a5b012c9d3b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.909300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60bc6bb6d7147c9a66f834e9ed1f142', 'request_id': 'req-4e92925e-b990-4298-85bc-2a5b012c9d3b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.919144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60bc6bb6d7147c9a66f834e9ed1f142', 'request_id': 'req-4e92925e-b990-4298-85bc-2a5b012c9d3b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.932274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] The token cache is being invalidate because project e60bc6bb6d7147c9a66f834e9ed1f142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:50.932500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.933565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4e92925e-b990-4298-85bc-2a5b012c9d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:50.935364 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 957/1910] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:50 2022] DELETE /identity/v3/projects/e60bc6bb6d7147c9a66f834e9ed1f142 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:50.942931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:50.943454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:50.943718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:50.967179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:50.969326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.082244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 954/1911] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:51.091345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.091699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.091895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.132049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.133543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.157154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:51.158454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.164753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586c74-faaf-4a7c-a7ee-19b9f069b14b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.174525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.177110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.177280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.177583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] PATH_INFO: `/v3/projects/ff67f50f216e4532b774954bf311b5f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.181067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff67f50f216e4532b774954bf311b5f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.187983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.189614 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 958/1912] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:51.195346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.201156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f55e-d98c-479e-ae86-99089d69ff2c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.211297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.212091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.212469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.212751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.213714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:51.214044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.215813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.233918 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 959/1913] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:51.240524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.251385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd361c71-4457-4425-8376-6a95c3e9e67b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.263764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.265118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.265118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.265118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.267061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.268594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.341138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff67f50f216e4532b774954bf311b5f1', 'request_id': 'req-a7eaac8a-2aa3-4a56-af96-842979d3de68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:51.348853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff67f50f216e4532b774954bf311b5f1', 'request_id': 'req-a7eaac8a-2aa3-4a56-af96-842979d3de68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:51.380453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 960/1914] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:51.384676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.453366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc74986-666b-4ed8-97fa-4f0435e47853 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.461153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.462115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.462791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.463052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.464367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.468695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.494173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff67f50f216e4532b774954bf311b5f1', 'request_id': 'req-a7eaac8a-2aa3-4a56-af96-842979d3de68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:51.507597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] The token cache is being invalidate because project ff67f50f216e4532b774954bf311b5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:51.507945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:51.508552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7eaac8a-2aa3-4a56-af96-842979d3de68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:51.510122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 955/1915] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:51 2022] DELETE /identity/v3/projects/ff67f50f216e4532b774954bf311b5f1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:51.514935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadce-512f-4cfe-91dd-a601ab5bb39e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.515214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadce-512f-4cfe-91dd-a601ab5bb39e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.515490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadce-512f-4cfe-91dd-a601ab5bb39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.535878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-afdaadce-512f-4cfe-91dd-a601ab5bb39e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:51.537138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afdaadce-512f-4cfe-91dd-a601ab5bb39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.546002 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 956/1916] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:51.556297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.556641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.556925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.589826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:51.591425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.603003 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 957/1917] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:51.608624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.626654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3004d3-51a4-4171-bbd4-04f401be14f9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.632019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.632644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.632994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.633275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.633966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:51.634315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.636203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.649286 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 958/1918] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:14:51.653756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.664321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183338c-659a-4eae-95a2-7f58fb408288 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.669323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.670098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.670534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.671099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.671782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.673777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.718734 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:51.753382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 961/1919] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:51.756050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.757786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:51.770949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a778-ef88-4227-8ced-b20e1bab4389 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.775981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.776604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.776885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.777497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.778227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.779977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.792109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 962/1920] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:51.795946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.808004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31849e2b-870c-442b-ae63-5ba5fdc9653f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.815398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.815398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.815696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.816102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.817009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.817386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 959/1921] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:51.818470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.819633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.843281 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 963/1922] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:51.857551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:51.892341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d191a3-49e6-401a-9ec6-b71939a036b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.923873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5704e-8717-4a60-a334-0caf27a03a1e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:51.932034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.932804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.933707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.934016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:51.934664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:51.936623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:51.980496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:51.981150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:51.981455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:51.981724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] PATH_INFO: `/v3/projects/655e0c44b17841e9983d8d6aa2ae123e/users/a86c7309cd844c8eb980e555b668c6bf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.002144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655e0c44b17841e9983d8d6aa2ae123e, user_id=a86c7309cd844c8eb980e555b668c6bf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.002361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65c4f5-94bd-47f4-8ccf-05c5733c3d25 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.084567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 960/1923] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:51 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:52.086130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.099907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9918b-e510-405f-a2fa-0a64571c8167 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.100902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 964/1924] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:51 2022] PUT /identity/v3/projects/655e0c44b17841e9983d8d6aa2ae123e/users/a86c7309cd844c8eb980e555b668c6bf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:52.112567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.112949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.113221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.132943 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:52.169230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] MFA Rules not processed for user `a86c7309cd844c8eb980e555b668c6bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:52.170647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:52.189898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.205600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.205600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.205600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.205600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.205600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.206458 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 961/1925] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:14:52.211002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.226516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2eba-2217-4d35-9093-cf00bc94f086 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.232928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.233813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.234090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.234363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.235001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.236629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.242190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 965/1926] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:52.249379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 962/1927] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:52.250676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.253861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.264029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b96f2f-bbb6-41cf-ae74-e40323afeb46 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.266647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c6383-b013-4591-b01e-fb6149084da2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.269936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.270543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.270880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.271151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.271844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.272850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.273620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.273978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.274302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] PATH_INFO: `/v3/projects/4631423951934658b5e0779610214038/users/7b92764477794f2a89d990369e789e1a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.280311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f9ed7-4ff2-4892-a124-4d6c980ce2f0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.290105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4631423951934658b5e0779610214038, user_id=7b92764477794f2a89d990369e789e1a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.292839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.403781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 963/1928] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:52 2022] PUT /identity/v3/projects/4631423951934658b5e0779610214038/users/7b92764477794f2a89d990369e789e1a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:52.404067 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 966/1929] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:52 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:52.408032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.414852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.415301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.415573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.622448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] MFA Rules not processed for user `7b92764477794f2a89d990369e789e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:52.624814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:52.644771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab83e6-f199-4845-8bc4-d39a2b468ea9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.731691 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 967/1930] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:52.746476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.796900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.797694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.798176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.798521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.799252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.802486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.896225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be980443-4304-4ecc-8e86-52ae15f6c9e8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.904336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.905235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.905875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.907142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.907142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.910136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:52.953802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 964/1931] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:52 2022] POST /identity/v3/users => generated 295 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:52.957462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:52.970357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b4467-70db-4904-b320-2a2e8c426879 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:52.988315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:52.989753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:52.990100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:52.991060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:52.991940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:52.993853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab40a14-0297-4538-bd0c-64a3b58a5654 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.009452 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 965/1932] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:53.009452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.009452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.009452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.011193 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 968/1933] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:52 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:53.012199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.033316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] MFA Rules not processed for user `c7334417689847d18bc4c1b27d173a23`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:53.035146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:53.092337 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:53.096446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3cef-d5c3-4d3a-a15c-bdb39a665dc2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.102426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.102637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.102912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.103030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.103644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.105848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.117673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 966/1934] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:53.117673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.136424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6828c-3fb1-4f7b-8710-43ba023f22ec None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.143376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.144968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.147281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.147281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] PATH_INFO: `/v3/projects/c648950e1bfa4caf9c19655aaf184953/users/6584b02690e74f7b8498d63f92705a1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.171356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c648950e1bfa4caf9c19655aaf184953, user_id=6584b02690e74f7b8498d63f92705a1e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.176965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.201720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 969/1935] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:53 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:53.203722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.216111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f31b8f-7cc4-48bf-b67d-4852354ad049 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.221943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.224110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.225058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.225058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.225481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.227123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.238741 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 970/1936] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:53.242602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.252934 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 967/1937] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:53 2022] PUT /identity/v3/projects/c648950e1bfa4caf9c19655aaf184953/users/6584b02690e74f7b8498d63f92705a1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:53.257506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.272396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668dca2-53b8-47bc-9fc8-ab55ea2e6794 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.387287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816ba57-ded9-46bc-8f87-e7fc668f118c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.389927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.390598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.390877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.391140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] PATH_INFO: `/v3/projects/bcc06d8d33074676bf7434902440d9d7/users/bf27ab80b04748a8b8ecee846dd8464a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.393628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.398682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.398682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.398682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.398682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.401267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.409227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc06d8d33074676bf7434902440d9d7, user_id=bf27ab80b04748a8b8ecee846dd8464a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.415717 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 968/1938] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:53.415909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.418335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.427965 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:53.431946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c286-63f6-4309-a764-81c441845b4e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.437235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.438013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.438292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.438563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] PATH_INFO: `/v3/projects/c648950e1bfa4caf9c19655aaf184953/users/6584b02690e74f7b8498d63f92705a1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.440547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c648950e1bfa4caf9c19655aaf184953, user_id=6584b02690e74f7b8498d63f92705a1e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.443408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c70b3-d7fd-46f7-ad43-cd2ece975318 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.454742 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 969/1939] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:53 2022] PUT /identity/v3/projects/c648950e1bfa4caf9c19655aaf184953/users/6584b02690e74f7b8498d63f92705a1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:53.466268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.466553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.466825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.500526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] MFA Rules not processed for user `6584b02690e74f7b8498d63f92705a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:53.501758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:53.513598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 971/1940] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:53 2022] PUT /identity/v3/projects/bcc06d8d33074676bf7434902440d9d7/users/bf27ab80b04748a8b8ecee846dd8464a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:14:53.518379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.595999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 970/1941] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:14:53.596188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad41c94-12d0-48d9-8477-666116d807cd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.600197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.600983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.601279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.601756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.602410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.604053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a0baf-014d-45ed-ab28-b216e0ef9ba1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.615298 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 972/1942] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:53.622195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:53.692767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadde2bb-d185-4e87-8575-60d4147e557d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:53.698058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:53.698554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.698971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.699268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] PATH_INFO: `/v3/projects/bcc06d8d33074676bf7434902440d9d7/users/bf27ab80b04748a8b8ecee846dd8464a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.701356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc06d8d33074676bf7434902440d9d7, user_id=bf27ab80b04748a8b8ecee846dd8464a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:53.704167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:53.730664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 971/1943] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:53 2022] PUT /identity/v3/projects/bcc06d8d33074676bf7434902440d9d7/users/bf27ab80b04748a8b8ecee846dd8464a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:53.741559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:53.751746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:53.751746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:53.788115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] MFA Rules not processed for user `bf27ab80b04748a8b8ecee846dd8464a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:53.789702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:53.896974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 973/1944] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:54.119932 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:54.260866 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:54.264820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:54.271103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:54.379470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600396f-8543-434e-989b-3018da94c9f7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:54.386392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:54.387299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:54.387507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:54.388719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:54.462292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:54.464801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:54.478080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 972/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:54.684454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:54.708691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fe9d9-2280-4082-8946-3ff8b5045cd5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:54.721237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:54.723062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:54.723608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:54.724227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:54.740513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:54.742651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d1508-c55f-4f62-b000-5862e9dbfceb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:54.792907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 974/1946] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:55.160802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:55.259760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf9238-5d67-4790-9000-aefbe613960a service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:55.265180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:55.266047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:55.266494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:55.266769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] PATH_INFO: `/v3/users/7b92764477794f2a89d990369e789e1a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:55.268168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b92764477794f2a89d990369e789e1a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:55.270709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:55.281323 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:55.528492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b92764477794f2a89d990369e789e1a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:55.529220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b92764477794f2a89d990369e789e1a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:55.536862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b92764477794f2a89d990369e789e1a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:55.537841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b92764477794f2a89d990369e789e1a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:55.635332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b92764477794f2a89d990369e789e1a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:55.662108 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 973/1947] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:55 2022] DELETE /identity/v3/users/7b92764477794f2a89d990369e789e1a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:55.666803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:55.667093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:55.667390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:55.692789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:55.694090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:55.765187 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 975/1948] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:55.775431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:55.776881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:55.854256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94c35-8154-46bc-9bb1-c4f6be766cee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:55.859683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:55.860456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:55.860867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:55.861239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:55.871838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:55.873271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:55.886170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 974/1949] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:56.404555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:56.412547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:56.412641 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:56.424738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce00c21-472b-4437-b2b0-ba130aa8f466 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:56.431051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:56.431717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:56.432027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:56.432298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] PATH_INFO: `/v3/projects/4631423951934658b5e0779610214038` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:56.433778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4631423951934658b5e0779610214038)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:56.435939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:56.573134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4631423951934658b5e0779610214038', 'request_id': 'req-47389d53-c556-4cf0-93b4-cde5b8de1cf4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:56.654796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4631423951934658b5e0779610214038', 'request_id': 'req-47389d53-c556-4cf0-93b4-cde5b8de1cf4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:56.663120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4631423951934658b5e0779610214038', 'request_id': 'req-47389d53-c556-4cf0-93b4-cde5b8de1cf4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:56.676340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] The token cache is being invalidate because project 4631423951934658b5e0779610214038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:56.676624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:56.677324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:56.678863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 976/1950] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:56 2022] DELETE /identity/v3/projects/4631423951934658b5e0779610214038 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:56.683538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:56.698120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2221d5-a260-472b-bfe7-94541a58ab69 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:56.822926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:56.823575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:56.823854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:56.824142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] PATH_INFO: `/v3/users/bf27ab80b04748a8b8ecee846dd8464a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:56.826029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf27ab80b04748a8b8ecee846dd8464a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:56.828008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:56.873679 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:56.913816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:56.913816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:57.019322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47389d53-c556-4cf0-93b4-cde5b8de1cf4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:57.029487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:57.030607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:57.030977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:57.031328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:57.034724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:57.102027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf27ab80b04748a8b8ecee846dd8464a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:57.102258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf27ab80b04748a8b8ecee846dd8464a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:57.111466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf27ab80b04748a8b8ecee846dd8464a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:57.112204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf27ab80b04748a8b8ecee846dd8464a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:57.158209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:57.160086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:57.176325 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 977/1951] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:14:57.203366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-98cd718e-8847-4765-b189-5825a2a2da62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf27ab80b04748a8b8ecee846dd8464a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:57.242273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 975/1952] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:14:56 2022] DELETE /identity/v3/users/bf27ab80b04748a8b8ecee846dd8464a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:57.863406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:57.866559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:57.933808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fbfed-2404-4226-8f3f-77961e4a1978 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:58.007440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:58.008077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.008358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.008783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] PATH_INFO: `/v3/projects/bcc06d8d33074676bf7434902440d9d7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.010141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc06d8d33074676bf7434902440d9d7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:58.012109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:58.142452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc06d8d33074676bf7434902440d9d7', 'request_id': 'req-6ad4edbe-9bff-47d0-b677-597a5338655b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:58.248421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc06d8d33074676bf7434902440d9d7', 'request_id': 'req-6ad4edbe-9bff-47d0-b677-597a5338655b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:58.257485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc06d8d33074676bf7434902440d9d7', 'request_id': 'req-6ad4edbe-9bff-47d0-b677-597a5338655b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:58.279144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] The token cache is being invalidate because project bcc06d8d33074676bf7434902440d9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:14:58.279435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:58.280230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:14:58.282217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 978/1953] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:14:57 2022] DELETE /identity/v3/projects/bcc06d8d33074676bf7434902440d9d7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:58.287277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edd0f-e085-43a4-9651-ec9a0cae2f19 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.287805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edd0f-e085-43a4-9651-ec9a0cae2f19 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.288415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886edd0f-e085-43a4-9651-ec9a0cae2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.296814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:58.298397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:58.314724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-886edd0f-e085-43a4-9651-ec9a0cae2f19 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:58.317406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-886edd0f-e085-43a4-9651-ec9a0cae2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:58.407970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4edbe-9bff-47d0-b677-597a5338655b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:58.418850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:58.419802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.420241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.420506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.422760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:58.429488 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 976/1954] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:58.443398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.443766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.444107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.477646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:58.479544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:58.494140 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 977/1955] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:58.502413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:58.518032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29e357-ede0-4778-b288-d7eeb6ae61e5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:58.529255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:58.530366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.531097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.531697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.532933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:14:58.533718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:58.536764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:58.539378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:58.542011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:58.561563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 979/1956] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:14:58.562386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 978/1957] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:14:58.569189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:58.592206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acfd0c-85f9-4bcc-9a0a-49d0a04a4c95 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:58.601516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:58.602849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.603330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.603800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.605084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:58.609031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:58.753028 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 980/1958] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:58 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:58.754131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:58.764979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921bc88b-1d6b-4dfe-9c39-4f5b19f268e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:58.833979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:58.836392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:58.836814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:58.837207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:58.838073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:58.840768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:58.982478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 979/1959] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:58 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:58.985249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:58.999351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1182795-8c9a-4f6e-a944-2ba8b15a0655 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.009779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:59.011980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.012636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.013450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.014665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:59.017773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:59.042650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 981/1960] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:59.047030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:59.077489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f96c9-7841-4c48-9865-f390cf995661 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.086349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:59.087141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.087524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.087903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.089296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:59.092984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c42ac9-7ca5-4727-a113-be34002f5a55 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:59.112444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 980/1961] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:14:59.120288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:59.135620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ca331-6c35-40d3-94ea-cb198bbb9517 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.151200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:59.151895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.152174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.152444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] PATH_INFO: `/v3/projects/d3105da6423e4f5e891408b2562a7c5d/users/cd567d45e2e34a8ba2ed9b8779e2cead/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.164815 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:59.173891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3105da6423e4f5e891408b2562a7c5d, user_id=cd567d45e2e34a8ba2ed9b8779e2cead, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:59.177075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:59.275784 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 982/1962] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:14:59 2022] PUT /identity/v3/projects/d3105da6423e4f5e891408b2562a7c5d/users/cd567d45e2e34a8ba2ed9b8779e2cead/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:14:59.278911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.279206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.283208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.319018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] MFA Rules not processed for user `cd567d45e2e34a8ba2ed9b8779e2cead`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:14:59.324611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:14:59.469089 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 981/1963] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:14:59.474900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:59.579323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800570-5637-4884-8dca-497e47461754 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.588589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:59.589328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.589736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.590115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.590888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:59.591197 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:14:59.593120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:59.705047 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 983/1964] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:14:59 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:14:59.709891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:59.722411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d243-e496-4a67-a95c-65f0d1e1eeda None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.847734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:14:59.849310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:14:59.850274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:14:59.850274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:14:59.853728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:14:59.856670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:14:59.948809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 982/1965] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:14:59 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:14:59.952847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:14:59.981300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70523e1-810e-41e5-9213-a4e6fc739014 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:14:59.997854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:00.002162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:00.002449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:00.004195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:00.004195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:00.005743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:00.033727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 984/1966] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:00.035044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:00.048367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888d809-d77d-49cc-a6c2-cd37f3b87296 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:00.054752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:00.055613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:00.056099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:00.056447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] PATH_INFO: `/v3/projects/5bca41bdc4e24715892bef686c30bc83/users/0531049c1e3c4ae68f2cb22a28ce5aa8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:00.079822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bca41bdc4e24715892bef686c30bc83, user_id=0531049c1e3c4ae68f2cb22a28ce5aa8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:00.083368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:00.193592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 983/1967] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:00 2022] PUT /identity/v3/projects/5bca41bdc4e24715892bef686c30bc83/users/0531049c1e3c4ae68f2cb22a28ce5aa8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:00.197922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:00.209121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978fb71-c36d-4298-9ec6-f3ae57094f60 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:00.349782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:00.350886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:00.351270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:00.351708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:00.352410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:00.360274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b982-36b4-4b60-950a-d10c10826447 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:00.379174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 985/1968] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:00.382008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:00.408540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a3e57-6de3-47ae-9f7d-58f9e681ed91 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:00.421471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:00.422739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:00.423246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:00.423844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] PATH_INFO: `/v3/projects/5bca41bdc4e24715892bef686c30bc83/users/0531049c1e3c4ae68f2cb22a28ce5aa8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:00.428344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bca41bdc4e24715892bef686c30bc83, user_id=0531049c1e3c4ae68f2cb22a28ce5aa8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:00.434296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:00.446572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 984/1969] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:00 2022] PUT /identity/v3/projects/5bca41bdc4e24715892bef686c30bc83/users/0531049c1e3c4ae68f2cb22a28ce5aa8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:00.458002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:00.458424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:00.458826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:00.490162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] MFA Rules not processed for user `0531049c1e3c4ae68f2cb22a28ce5aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:00.491534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:00.574110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 986/1970] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:01.163050 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:01.200684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:01.203853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:01.321874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d22b69-8e76-4572-86e2-1e13e9c94260 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:01.328880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:01.329580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:01.329871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:01.330123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:01.341648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:01.343226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:01.354829 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 985/1971] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:02.087139 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:03.145845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:03.235646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:03.237141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.319594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bad648-06d4-4840-b4ba-ab5b56ab11d5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:03.326078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:03.326914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.327215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.327487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] PATH_INFO: `/v3/users/464f9e9314154e3f9c779b9ae10b2a73` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.328690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=464f9e9314154e3f9c779b9ae10b2a73)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:03.330822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:03.558309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464f9e9314154e3f9c779b9ae10b2a73'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:03.620702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:03.633318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a895-cc66-499e-af3d-a327a40f9818 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:03.638913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:03.639515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.639789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.640057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.641840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.654306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464f9e9314154e3f9c779b9ae10b2a73'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:03.655012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464f9e9314154e3f9c779b9ae10b2a73'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:03.666640 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:03.671738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464f9e9314154e3f9c779b9ae10b2a73'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:03.679352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40116614-fdd0-48bd-80ac-c197286eb375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464f9e9314154e3f9c779b9ae10b2a73'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:03.686025 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 987/1972] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:03 2022] DELETE /identity/v3/users/464f9e9314154e3f9c779b9ae10b2a73 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:03.690263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f88b0-fa9c-4ea6-b63c-64dc66643f95 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.690543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f88b0-fa9c-4ea6-b63c-64dc66643f95 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.690840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f88b0-fa9c-4ea6-b63c-64dc66643f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.707498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:03.709093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:03.712116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bc6f88b0-fa9c-4ea6-b63c-64dc66643f95 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:03.713416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc6f88b0-fa9c-4ea6-b63c-64dc66643f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.719876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 986/1973] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:03.751327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:03.763092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6481e-5da1-49c8-ad39-6388343fcccd service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:03.787549 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 988/1974] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:03.788865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.789102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.789405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.812703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] MFA Rules not processed for user `51ccc0bfdee94961aa198e3abf0d85cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:03.813949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.839164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:03.839886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.840162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.840434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.842381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.874927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 989/1975] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:03.876968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:03.880782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:03.899480 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:03.917078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:03.918733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:03.928905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 987/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:03.942516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5821ca3-0f87-4490-9f08-8e4f54abf35b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:03.947557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:03.947557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:03.947557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:03.947557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:03.957268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:03.958742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:03.970616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 990/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:04.234448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:04.235927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:04.251165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3534-7875-4c5e-b247-345229206275 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:04.257238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:04.258526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:04.258811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:04.259085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] PATH_INFO: `/v3/projects/72a83b0b15194aa69fc4d82876a1e6fd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:04.260234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a83b0b15194aa69fc4d82876a1e6fd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:04.262620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:04.461094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a83b0b15194aa69fc4d82876a1e6fd', 'request_id': 'req-b3e20e72-ac12-482b-9c55-e78a49a73e2a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:04.463162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a83b0b15194aa69fc4d82876a1e6fd', 'request_id': 'req-b3e20e72-ac12-482b-9c55-e78a49a73e2a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:04.590191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a83b0b15194aa69fc4d82876a1e6fd', 'request_id': 'req-b3e20e72-ac12-482b-9c55-e78a49a73e2a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:04.603614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] The token cache is being invalidate because project 72a83b0b15194aa69fc4d82876a1e6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:04.603873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:04.604658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:04.606186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 988/1978] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:04 2022] DELETE /identity/v3/projects/72a83b0b15194aa69fc4d82876a1e6fd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:04.610281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:04.623836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736726d-d3e0-4d25-baae-0f09ccaa6393 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:04.693010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:04.693684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:04.693960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:04.694228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] PATH_INFO: `/v3/users/a1274b7f71f04b05ba1753727d2367d1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:04.695339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1274b7f71f04b05ba1753727d2367d1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:04.697321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:04.929440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1274b7f71f04b05ba1753727d2367d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.013277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1274b7f71f04b05ba1753727d2367d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.020307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1274b7f71f04b05ba1753727d2367d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.043084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1274b7f71f04b05ba1753727d2367d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.053443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1274b7f71f04b05ba1753727d2367d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.063499 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 991/1979] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:04 2022] DELETE /identity/v3/users/a1274b7f71f04b05ba1753727d2367d1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:05.250058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:05.254281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:05.283788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e20e72-ac12-482b-9c55-e78a49a73e2a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:05.381443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:05.382205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:05.382857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:05.383135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:05.383386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:05.383493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] PATH_INFO: `/v3/users/cd567d45e2e34a8ba2ed9b8779e2cead` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:05.384630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd567d45e2e34a8ba2ed9b8779e2cead)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:05.386603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:05.402084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b63e5-f272-428a-943c-dc4e9e6014d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:05.414275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:05.416329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:05.416828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:05.417920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] PATH_INFO: `/v3/projects/b3dd7611342d442aa6828ec2659988d7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:05.420902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3dd7611342d442aa6828ec2659988d7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:05.423156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:05.475497 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:05.687746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3dd7611342d442aa6828ec2659988d7', 'request_id': 'req-55b21e13-80c1-41fa-bab3-ca89d197271d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.690608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd567d45e2e34a8ba2ed9b8779e2cead'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.692495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd567d45e2e34a8ba2ed9b8779e2cead'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.705379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd567d45e2e34a8ba2ed9b8779e2cead'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.705379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd567d45e2e34a8ba2ed9b8779e2cead'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.840219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3dd7611342d442aa6828ec2659988d7', 'request_id': 'req-55b21e13-80c1-41fa-bab3-ca89d197271d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.842181 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:05.848985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3dd7611342d442aa6828ec2659988d7', 'request_id': 'req-55b21e13-80c1-41fa-bab3-ca89d197271d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.864407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] The token cache is being invalidate because project b3dd7611342d442aa6828ec2659988d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:05.866292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.866292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55b21e13-80c1-41fa-bab3-ca89d197271d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.874008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 992/1980] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:05 2022] DELETE /identity/v3/projects/b3dd7611342d442aa6828ec2659988d7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:05.876164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d8f-05b7-48a5-a424-92d7b4e2e1a9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:05.876678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d8f-05b7-48a5-a424-92d7b4e2e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:05.877158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044d8f-05b7-48a5-a424-92d7b4e2e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:05.914300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f361e145-c8af-4004-9934-22c4451b3fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd567d45e2e34a8ba2ed9b8779e2cead'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:05.928908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-03044d8f-05b7-48a5-a424-92d7b4e2e1a9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:05.928908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-03044d8f-05b7-48a5-a424-92d7b4e2e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:05.952653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 989/1981] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:05 2022] DELETE /identity/v3/users/cd567d45e2e34a8ba2ed9b8779e2cead => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:05.955291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1622fd9-8008-493b-931a-542638698375 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:05.956399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1622fd9-8008-493b-931a-542638698375 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:05.956399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1622fd9-8008-493b-931a-542638698375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:05.995836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e1622fd9-8008-493b-931a-542638698375 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:05.997092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1622fd9-8008-493b-931a-542638698375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.072692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 993/1982] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:06.085622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.086110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.086421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.116100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:06.117816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.149080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 990/1983] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:06.166005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1622fd9-8008-493b-931a-542638698375 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.169254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1622fd9-8008-493b-931a-542638698375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.252943 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 994/1984] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:06.258038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.267490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f12e-4ae0-4f1c-84f2-12d36586fcf8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.274364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.275082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.275194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1622fd9-8008-493b-931a-542638698375 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.275619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.275710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.276343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:06.276638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.278307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.279336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.280010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.280422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.280820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.290598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 995/1985] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:15:06.292393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.293967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.295609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.304875 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 991/1986] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:06.305491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc805-aad2-4ee4-85aa-46d838d40f08 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.310801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.311416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.311696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.311967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.312605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.314648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.391231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.392665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.407523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065d16d-9207-4dda-b7ee-4706d5bea594 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.412456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.413090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.413497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.413789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] PATH_INFO: `/v3/users/a86c7309cd844c8eb980e555b668c6bf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.415113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86c7309cd844c8eb980e555b668c6bf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.416875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.468553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 996/1987] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:06 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:06.472976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.552108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82217e-c16e-4405-91e7-24038f54091d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.557924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.561244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.561244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.561244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.561244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.562608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.693965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86c7309cd844c8eb980e555b668c6bf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:06.694544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86c7309cd844c8eb980e555b668c6bf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:06.707208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86c7309cd844c8eb980e555b668c6bf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:06.708130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86c7309cd844c8eb980e555b668c6bf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:06.730009 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 997/1988] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:06 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:06.734288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.736976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.769489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf84b-2344-43f8-a4d9-9fe3e2721bba admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.778175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.779059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.779713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.780147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.781116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.784291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.784843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85875f81-be75-4f68-8e2e-731d8016adee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86c7309cd844c8eb980e555b668c6bf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:06.808396 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 998/1989] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:06.812619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.826276 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 992/1990] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:06 2022] DELETE /identity/v3/users/a86c7309cd844c8eb980e555b668c6bf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:06.826480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213cc3-af0e-486b-b554-0d4b85bda604 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.829901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.830456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.830811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.856974 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:06.859454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:06.861221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.927678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.928922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.929300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.929694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.930642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.932390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:06.948774 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 999/1991] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:06.950040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.952456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:06.969387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784bcaf-0141-4457-ad71-e82b13f739b7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:06.975977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:06.976868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:06.986397 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 993/1992] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:06.986588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:06.994385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:06.994385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] PATH_INFO: `/v3/projects/d3105da6423e4f5e891408b2562a7c5d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:06.994385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3105da6423e4f5e891408b2562a7c5d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:06.996596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.005381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c23db-dfc4-4ad2-b0f7-0b1c0c714ab5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.021395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.022574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.029546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.029546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] PATH_INFO: `/v3/projects/ad621909b99143dd9885006238de72a6/users/4f1fe6e04e064dfba969b07d4188ab38/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.054022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad621909b99143dd9885006238de72a6, user_id=4f1fe6e04e064dfba969b07d4188ab38, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.057100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.212512 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 994/1993] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:06 2022] PUT /identity/v3/projects/ad621909b99143dd9885006238de72a6/users/4f1fe6e04e064dfba969b07d4188ab38/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:07.214812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:07.217058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:07.217189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3105da6423e4f5e891408b2562a7c5d', 'request_id': 'req-d0d7eb78-9149-452f-8d12-e2f3e78adcef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.310339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bc1c6-182b-4b25-a5ae-0b4c4af89772 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.326380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3105da6423e4f5e891408b2562a7c5d', 'request_id': 'req-d0d7eb78-9149-452f-8d12-e2f3e78adcef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.335909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3105da6423e4f5e891408b2562a7c5d', 'request_id': 'req-d0d7eb78-9149-452f-8d12-e2f3e78adcef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.389221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] The token cache is being invalidate because project d3105da6423e4f5e891408b2562a7c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:07.390167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.390500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.391232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.391524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.391799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.392315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0d7eb78-9149-452f-8d12-e2f3e78adcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.402422 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1000/1994] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:06 2022] DELETE /identity/v3/projects/d3105da6423e4f5e891408b2562a7c5d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:07.404192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.407547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.408070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.468256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] MFA Rules not processed for user `4f1fe6e04e064dfba969b07d4188ab38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:07.473100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:07.508764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.518906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.565252 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 995/1995] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:07.567355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:07.583513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e66d8f-603a-4da3-883c-592b0aff4208 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.598708 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1001/1996] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:07.603038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:07.604435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:07.609853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.610606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.610890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.611159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] PATH_INFO: `/v3/users/0531049c1e3c4ae68f2cb22a28ce5aa8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.613972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0531049c1e3c4ae68f2cb22a28ce5aa8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.621952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.628627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6b254-c1f2-469d-bd77-f0bc1803001c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.634086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.634544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.634827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.635096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.635975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.637877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.754893 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1002/1997] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:07 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:07.758920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:07.827129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814cf0e-97a7-43f1-b77b-f5a67e66adc3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.834969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.835129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.835387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.835631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.836371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.838939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:07.912558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0531049c1e3c4ae68f2cb22a28ce5aa8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.913284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0531049c1e3c4ae68f2cb22a28ce5aa8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.922770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0531049c1e3c4ae68f2cb22a28ce5aa8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.924294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0531049c1e3c4ae68f2cb22a28ce5aa8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:07.942787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1003/1998] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:07 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:07.946868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:07.954887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:07.977597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3671e8-6e7c-4a5b-99c4-baf796f88e1e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:07.986758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:07.989146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:07.990818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:07.991373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:07.992480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:07.995363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.009378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1004/1999] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:08.012231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.024225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226701b3-bca5-4196-86f9-cbacbe1f4104 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.025022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0531049c1e3c4ae68f2cb22a28ce5aa8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.030592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.032358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.033066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.033620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] PATH_INFO: `/v3/projects/8212ea2596df443dbc6cf5494d994b7b/users/1d811dc93ede4dbebc25f91027b6dfa9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.047093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 996/2000] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:07 2022] DELETE /identity/v3/users/0531049c1e3c4ae68f2cb22a28ce5aa8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:08.061415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8212ea2596df443dbc6cf5494d994b7b, user_id=1d811dc93ede4dbebc25f91027b6dfa9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.064949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.197288 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1005/2001] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:08 2022] PUT /identity/v3/projects/8212ea2596df443dbc6cf5494d994b7b/users/1d811dc93ede4dbebc25f91027b6dfa9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:08.198926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.256507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.261599 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:08.261599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:08.298858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabbaa4-3c98-4077-b05c-83055cff0408 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.347983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b410f2-e7e8-4a5b-b5b7-3cd880e8342c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.355398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.356579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.356862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.357119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] PATH_INFO: `/v3/projects/655e0c44b17841e9983d8d6aa2ae123e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.361226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] RBAC: Authorizing `identity:delete_project(project_id=655e0c44b17841e9983d8d6aa2ae123e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.361226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.402513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.407210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.407210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.407210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.407210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.407210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.419971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 997/2002] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:08.423604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.435552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134910b-c35a-455c-9000-e4d7e6f6f55a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.440731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.441986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.442332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.442705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] PATH_INFO: `/v3/projects/8212ea2596df443dbc6cf5494d994b7b/users/1d811dc93ede4dbebc25f91027b6dfa9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.447511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8212ea2596df443dbc6cf5494d994b7b, user_id=1d811dc93ede4dbebc25f91027b6dfa9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.451115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d871d3-bace-46c2-ba1f-fd734169254b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.471029 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 998/2003] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:08 2022] PUT /identity/v3/projects/8212ea2596df443dbc6cf5494d994b7b/users/1d811dc93ede4dbebc25f91027b6dfa9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:08.486142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.486437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.486603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655e0c44b17841e9983d8d6aa2ae123e', 'request_id': 'req-8df79d6d-5bfb-47be-adb9-eb36cc94266f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.486715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.519156 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:08.520884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] MFA Rules not processed for user `1d811dc93ede4dbebc25f91027b6dfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:08.522187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:08.563017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655e0c44b17841e9983d8d6aa2ae123e', 'request_id': 'req-8df79d6d-5bfb-47be-adb9-eb36cc94266f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.584068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655e0c44b17841e9983d8d6aa2ae123e', 'request_id': 'req-8df79d6d-5bfb-47be-adb9-eb36cc94266f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.600090 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 999/2004] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:08.601279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.602642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:08.610839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] The token cache is being invalidate because project 655e0c44b17841e9983d8d6aa2ae123e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:08.611341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.612116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8df79d6d-5bfb-47be-adb9-eb36cc94266f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.617880 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1006/2005] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:08 2022] DELETE /identity/v3/projects/655e0c44b17841e9983d8d6aa2ae123e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:08.622043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.622329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.622711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.648141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] MFA Rules not processed for user `4f1fe6e04e064dfba969b07d4188ab38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:08.649937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:08.706497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df9322-ab0b-42e6-858b-ee6379633ccd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.713233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.713979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.714262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.714589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] PATH_INFO: `/v3/projects/5bca41bdc4e24715892bef686c30bc83` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.715819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bca41bdc4e24715892bef686c30bc83)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.717928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.739326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1007/2006] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:08.740796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:08.742432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:08.759182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70f03b-34e1-47e1-ad0a-afc260fc94ac None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:08.765364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:08.766105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:08.766454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:08.766815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] PATH_INFO: `/v3/users/6584b02690e74f7b8498d63f92705a1e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:08.768218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6584b02690e74f7b8498d63f92705a1e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:08.770481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:08.865285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bca41bdc4e24715892bef686c30bc83', 'request_id': 'req-99880f1b-116e-4567-babf-98e78bc9593c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.871290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bca41bdc4e24715892bef686c30bc83', 'request_id': 'req-99880f1b-116e-4567-babf-98e78bc9593c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:08.986325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bca41bdc4e24715892bef686c30bc83', 'request_id': 'req-99880f1b-116e-4567-babf-98e78bc9593c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.003920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] The token cache is being invalidate because project 5bca41bdc4e24715892bef686c30bc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:09.004520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.005739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.012023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1000/2007] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:08 2022] DELETE /identity/v3/projects/5bca41bdc4e24715892bef686c30bc83 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:09.012023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.012266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.013544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6584b02690e74f7b8498d63f92705a1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.099031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880f1b-116e-4567-babf-98e78bc9593c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.105041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.105708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.105987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.106260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.108142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.143952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6584b02690e74f7b8498d63f92705a1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.145177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6584b02690e74f7b8498d63f92705a1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.169684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6584b02690e74f7b8498d63f92705a1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.173446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.175208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8eca5-c485-41f8-ad73-9f04d4d8164e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.177468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a826acb-b6a6-49ff-8c99-d2d5d8625b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6584b02690e74f7b8498d63f92705a1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:09.184242 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1008/2008] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:08 2022] DELETE /identity/v3/users/6584b02690e74f7b8498d63f92705a1e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:09.185542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.185687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1001/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:09.185815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.186227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.210221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:09.212453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.305704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1009/2010] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:09.315364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.315779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.316593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.351853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:09.353093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.362151 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1002/2011] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:09.366968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.377211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2754-6e96-4b4b-98d4-14017ae502f5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.383052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.383698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.383975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.384297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.384953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:09.385253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.387358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a8c84-78b7-4f92-8d0a-06a888168fd7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.403908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1010/2012] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:09.408401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.420286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7cad-1357-4fb8-a31a-cca2ff35f0ce None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.425649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.426434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.426858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.426965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.427633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.429632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.471281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.472805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.474198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.534552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] MFA Rules not processed for user `056e59c7d4c2475eb66b64e0e24367be`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:09.535904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.571063 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1003/2013] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:09 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:09.575278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.663149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8807a1-ab5b-4235-834e-c2d7ac90d843 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.671292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.677636 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1011/2014] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:09.677832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.677832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.677832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.677832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.677832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.793277 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1004/2015] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:09 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:09.797952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.810122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e755ae0-e15f-4806-833f-d00db6fdbec3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.814839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.815532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.815937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.817016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.817837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.819453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.831076 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1012/2016] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:09.844362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.845502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.847270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:09.859848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdc6b-e74c-4d72-b3bb-2246fd414009 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.865225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849521-d82b-4608-8100-50995d4b212b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.872731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.872930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.873378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.873613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.885171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.885171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] PATH_INFO: `/v3/projects/c648950e1bfa4caf9c19655aaf184953` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.885785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.885785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.885785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.885785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.886253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c648950e1bfa4caf9c19655aaf184953)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.886253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:09.902435 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1005/2017] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:09.906139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:09.922398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df227208-e9ed-4838-bf71-5f418bebddd9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:09.935222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:09.940122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:09.940122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:09.940122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] PATH_INFO: `/v3/projects/7e56eefbd10241678c78a096bf14c846/users/7ac1ff38dcaf4c1bb2005a500697175f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:09.963779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e56eefbd10241678c78a096bf14c846, user_id=7ac1ff38dcaf4c1bb2005a500697175f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:09.967290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921c5f7-af47-42a8-a745-878306a5eca3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.061261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1006/2018] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:09 2022] PUT /identity/v3/projects/7e56eefbd10241678c78a096bf14c846/users/7ac1ff38dcaf4c1bb2005a500697175f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:10.070054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c648950e1bfa4caf9c19655aaf184953', 'request_id': 'req-ef29b103-2389-4e0c-b89d-1d6d856e3b08'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:10.072034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.072231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.072844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.127437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] MFA Rules not processed for user `7ac1ff38dcaf4c1bb2005a500697175f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:10.128753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:10.140898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c648950e1bfa4caf9c19655aaf184953', 'request_id': 'req-ef29b103-2389-4e0c-b89d-1d6d856e3b08'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:10.154484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c648950e1bfa4caf9c19655aaf184953', 'request_id': 'req-ef29b103-2389-4e0c-b89d-1d6d856e3b08'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:10.173601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] The token cache is being invalidate because project c648950e1bfa4caf9c19655aaf184953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:10.173897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:10.174789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef29b103-2389-4e0c-b89d-1d6d856e3b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:10.182127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1013/2019] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:09 2022] DELETE /identity/v3/projects/c648950e1bfa4caf9c19655aaf184953 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:10.184330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc58d4-2955-4cbd-a38f-cab1575cb307 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.184868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc58d4-2955-4cbd-a38f-cab1575cb307 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.185154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc58d4-2955-4cbd-a38f-cab1575cb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.198108 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:10.216036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55cc58d4-2955-4cbd-a38f-cab1575cb307 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:10.217583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55cc58d4-2955-4cbd-a38f-cab1575cb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:10.218156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1007/2020] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:10.223430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.224890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:10.305823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1014/2021] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:10.311890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.312182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.312455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.317418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b85b8-08d2-4cc4-9625-6ebdf06c0ea7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.322587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.323136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.323415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.323685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.324333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.326317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.344874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:10.346180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:10.357180 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1015/2022] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:10.361535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.371426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b476356-0625-4c35-927a-58e9d4f40da2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.379798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.380607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.381060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.381394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.382020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:10.382316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.384022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.400224 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1016/2023] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:10.410971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.421128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212c913-ca1e-4277-a720-133ff39795e8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.426630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.427434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.427866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.428298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.429082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.431300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.437465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1008/2024] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:10.441271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.516984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aebb3f-8c32-4024-afc3-aa7fab37c451 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.524777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.525733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.526161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.526501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.527840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.529947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.560363 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1017/2025] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:10.580671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.626995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1009/2026] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/users => generated 301 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:10.631196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.643280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89a164-5094-4276-87f2-6ac0cb78b3d2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.649045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.649871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.650327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.650953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.651670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a362a-9e44-4cee-8039-60e01e176484 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.652742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.653755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.660770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.669296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.681872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.681872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.681872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.681872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.682558 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1010/2027] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:10.695619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.726185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eae33-851f-426b-bb9c-537db303f6de admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.733458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.734307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.735089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.735368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] PATH_INFO: `/v3/projects/7088cf9d04bb40949660d6d22da9e8a8/users/0b5d5d7aebc242dcaaa02e9e73a2edba/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.752268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7088cf9d04bb40949660d6d22da9e8a8, user_id=0b5d5d7aebc242dcaaa02e9e73a2edba, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.755710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.777541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1018/2028] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:10 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:10.781415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.792219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f697a-8444-4485-bdaf-e2d44ef82d2a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.814972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.815687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.817250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.818233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.818981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.821790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.833510 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1019/2029] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:10.837696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.857115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963f8d-b6cb-492f-a365-1571587d3ea4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:10.862425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:10.863183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:10.863517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:10.863868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:10.865776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:10.868900 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:10.875290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:10.875478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1011/2030] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:10 2022] PUT /identity/v3/projects/7088cf9d04bb40949660d6d22da9e8a8/users/0b5d5d7aebc242dcaaa02e9e73a2edba/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:10.877573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.896139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1020/2031] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:10.906854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:10.941582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1c93b-5f2a-4fd2-9c82-d0a57f9ae8f2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.071315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e9cb-3f2c-40f6-8416-2ef7922add1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.085016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.087728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.088032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.088626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.089564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:11.091383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:11.097313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.097922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.098205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.098487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] PATH_INFO: `/v3/projects/e102f94195e043d1a8b8f73a7c93bc24/users/2aac17a256724dabb7fad6b03f606c41/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.105088 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1012/2032] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:11.109109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:11.117798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e102f94195e043d1a8b8f73a7c93bc24, user_id=2aac17a256724dabb7fad6b03f606c41, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:11.121649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e374cd7-5ec9-40e4-899f-9035b9e4b3d3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:11.136080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4adb2-44e0-4a01-89c4-b467339dfdd8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.142386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.144535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.149665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.149665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] PATH_INFO: `/v3/projects/7088cf9d04bb40949660d6d22da9e8a8/users/0b5d5d7aebc242dcaaa02e9e73a2edba/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.149665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7088cf9d04bb40949660d6d22da9e8a8, user_id=0b5d5d7aebc242dcaaa02e9e73a2edba, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:11.150813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70c8f-e1f8-4b1f-bcca-ab1fc23fc46d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:11.190504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1013/2033] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:11 2022] PUT /identity/v3/projects/7088cf9d04bb40949660d6d22da9e8a8/users/0b5d5d7aebc242dcaaa02e9e73a2edba/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:11.202081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.202432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.202711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.276699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] MFA Rules not processed for user `0b5d5d7aebc242dcaaa02e9e73a2edba`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:11.277929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:11.319865 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1021/2034] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:10 2022] PUT /identity/v3/projects/e102f94195e043d1a8b8f73a7c93bc24/users/2aac17a256724dabb7fad6b03f606c41/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:11.333100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.334509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.334814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.404776 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1014/2035] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:11.408000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] MFA Rules not processed for user `2aac17a256724dabb7fad6b03f606c41`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:11.409273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:11.486584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1022/2036] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:11.491694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:11.579098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:11.582660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:11.627378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ba77-08c1-46c2-8dea-2ef86a9cba31 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.727374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.728234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.728641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.729072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.730141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:11.732509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:11.751231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8a95f-bcd0-4e46-b6f3-3da66621ec46 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.776363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.777020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.777293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:11.777574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:11.882042 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1015/2037] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:11 2022] POST /identity/v3/projects => generated 373 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:11.886050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:11.919612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:11.921826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:11.936471 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1023/2038] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:11.991572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeee0a-3944-43ff-9b32-3438611f131f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:11.998685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:11.998685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:11.998987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.000478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.001111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:12.004955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:12.132209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1016/2039] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:11 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:12.134317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:12.145860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f2795-b87b-4ae7-9119-ded50241755e service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:12.151145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:12.151819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:12.152096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.152367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.153011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:12.154855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:12.169379 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1024/2040] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:12.173173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:12.188661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bee1f0-1ce2-429e-91b6-3542885c6150 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:12.199787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:12.201522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:12.202251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.203104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] PATH_INFO: `/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3/users/cbc8066694c24743bf8e808a329c1c83/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.224777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8398692ff0b493eb4683f5ae1f3a9b3, user_id=cbc8066694c24743bf8e808a329c1c83, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:12.228660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:12.322079 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1017/2041] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:12 2022] PUT /identity/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3/users/cbc8066694c24743bf8e808a329c1c83/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:12.325697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:12.370406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a5679-7288-49d7-afce-948903f47b92 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:12.530067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:12.531101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:12.531536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.531963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.532777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:12.534945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63c2c2-b162-4ce0-87ed-92442f7e86ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:12.596542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1025/2042] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:12.600332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:12.612227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20e26-aa90-4d2f-81bd-c41da2d21ccf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:12.627064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:12.629290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:12.629290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.629290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] PATH_INFO: `/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3/users/cbc8066694c24743bf8e808a329c1c83/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.632054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8398692ff0b493eb4683f5ae1f3a9b3, user_id=cbc8066694c24743bf8e808a329c1c83, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:12.636872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:12.672753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1018/2043] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:12 2022] PUT /identity/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3/users/cbc8066694c24743bf8e808a329c1c83/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:12.684863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470413-fe8b-4432-9613-69e00112abef None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:12.686469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470413-fe8b-4432-9613-69e00112abef None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:12.686469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470413-fe8b-4432-9613-69e00112abef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:12.751314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22470413-fe8b-4432-9613-69e00112abef None None] MFA Rules not processed for user `cbc8066694c24743bf8e808a329c1c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:12.752638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22470413-fe8b-4432-9613-69e00112abef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:12.868995 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:12.896623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1026/2044] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:13.112299 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:13.182743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:13.186412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:13.391404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4039f-210a-425a-a029-9429698a7b28 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:13.401191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:13.402116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:13.402465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:13.404383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:13.433580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:13.437941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1b353-d9ab-469f-aca1-cb7cb8760eea service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:13.469394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1019/2045] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:14.774984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22470413-fe8b-4432-9613-69e00112abef None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:14.820530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22470413-fe8b-4432-9613-69e00112abef None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:14.829200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:14.829885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:14.830151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:14.830420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:14.943144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:14.946947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d7676-8cb4-4d8b-86c8-99765e214d37 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:14.960912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1027/2046] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:15.225940 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:16.220710 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:17.312582 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:17.564688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:17.566566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:17.567258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:17.568947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1020/2047] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:15:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:15:17.575259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6948af-2267-4fb4-a587-ca275dcf1456 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:17.576076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6948af-2267-4fb4-a587-ca275dcf1456 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:17.576076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6948af-2267-4fb4-a587-ca275dcf1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:17.600619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e6948af-2267-4fb4-a587-ca275dcf1456 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:17.602328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e6948af-2267-4fb4-a587-ca275dcf1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:17.613198 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1028/2048] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:17.635320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:17.637146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:17.729866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee804d-d948-4428-a30b-2bbd49b5cc5f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:17.733616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:17.734248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:17.734530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:17.734808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:17.746968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:17.748499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:17.761235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1021/2049] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:17.788957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:17.789247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:17.789558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:17.814133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:17.816763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:17.825035 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1029/2050] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:17.845388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:17.856248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c35e-479c-4c41-a750-1028a7d08f33 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:17.861972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:17.864980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:17.865484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:17.865903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:17.878312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:17.880634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56ccf9-6133-439b-9151-017933a6b431 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:17.891250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1022/2051] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:17.981827 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:18.192917 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:18.553858 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:20.036339 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:20.198334 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:20.880839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:20.970944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398843a3-d2dc-4c1c-a07e-523077d91664 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:20.976276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:20.976909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:20.977187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:20.977490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] PATH_INFO: `/v3/users/2aac17a256724dabb7fad6b03f606c41` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:20.978649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aac17a256724dabb7fad6b03f606c41)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:20.980581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:21.043917 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:21.179677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aac17a256724dabb7fad6b03f606c41'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:21.267182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aac17a256724dabb7fad6b03f606c41'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:21.267942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aac17a256724dabb7fad6b03f606c41'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:21.289178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aac17a256724dabb7fad6b03f606c41'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:21.307932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aac17a256724dabb7fad6b03f606c41'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:21.321416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1030/2052] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:20 2022] DELETE /identity/v3/users/2aac17a256724dabb7fad6b03f606c41 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:21.322940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c69e-47a1-4e68-8c45-0e33b3d9657b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:21.323224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c69e-47a1-4e68-8c45-0e33b3d9657b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:21.323497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50c69e-47a1-4e68-8c45-0e33b3d9657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:21.356453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6d50c69e-47a1-4e68-8c45-0e33b3d9657b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:21.358327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6d50c69e-47a1-4e68-8c45-0e33b3d9657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:21.443790 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1023/2053] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:21.478352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:21.489018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:21.600258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173da61d-0f7e-4d84-93ed-61c4644ddfdc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:21.605645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:21.606714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:21.607185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:21.607667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:21.619897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:21.621516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:21.636307 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1031/2054] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:21.827363 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:21.853098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:21.853440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:21.853883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:21.887824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] MFA Rules not processed for user `2096bbb8aff742b1837931e52ac1c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:21.888997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:21.975106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1024/2055] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:22.201039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:22.202770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:22.219117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa58fe-6af5-4a81-bd11-cb8301f89527 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:22.224542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:22.225224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:22.225559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:22.226068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] PATH_INFO: `/v3/projects/e102f94195e043d1a8b8f73a7c93bc24` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:22.227269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e102f94195e043d1a8b8f73a7c93bc24)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:22.229400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:22.411560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e102f94195e043d1a8b8f73a7c93bc24', 'request_id': 'req-e2734d37-84bc-4302-bd10-fb21d4577739'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.477387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e102f94195e043d1a8b8f73a7c93bc24', 'request_id': 'req-e2734d37-84bc-4302-bd10-fb21d4577739'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.485008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e102f94195e043d1a8b8f73a7c93bc24', 'request_id': 'req-e2734d37-84bc-4302-bd10-fb21d4577739'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.498152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] The token cache is being invalidate because project e102f94195e043d1a8b8f73a7c93bc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:22.498468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.499203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.500724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1032/2056] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:22 2022] DELETE /identity/v3/projects/e102f94195e043d1a8b8f73a7c93bc24 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:22.505720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:22.518385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170265ce-7612-4858-825e-e27a2bc89598 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:22.663834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:22.664631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:22.664919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:22.665201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] PATH_INFO: `/v3/users/cbc8066694c24743bf8e808a329c1c83` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:22.666879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc8066694c24743bf8e808a329c1c83)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:22.681481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:22.737747 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:22.955420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc8066694c24743bf8e808a329c1c83'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.956687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc8066694c24743bf8e808a329c1c83'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.969452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc8066694c24743bf8e808a329c1c83'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:22.970814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc8066694c24743bf8e808a329c1c83'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:23.047761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-729a7f1c-2557-4f58-bd2e-2b554968d75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc8066694c24743bf8e808a329c1c83'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:23.077222 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1025/2057] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:22 2022] DELETE /identity/v3/users/cbc8066694c24743bf8e808a329c1c83 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:24.761004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:24.763682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:24.788690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734d37-84bc-4302-bd10-fb21d4577739 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:24.916043 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:24.941676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:24.942328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:24.942609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:24.942934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] PATH_INFO: `/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:24.944262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8398692ff0b493eb4683f5ae1f3a9b3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:24.946463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:24.983019 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:25.140017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8398692ff0b493eb4683f5ae1f3a9b3', 'request_id': 'req-53e3dd5f-6966-41bf-a110-3d35d0447263'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:25.253165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8398692ff0b493eb4683f5ae1f3a9b3', 'request_id': 'req-53e3dd5f-6966-41bf-a110-3d35d0447263'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:25.266620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8398692ff0b493eb4683f5ae1f3a9b3', 'request_id': 'req-53e3dd5f-6966-41bf-a110-3d35d0447263'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:25.283590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] The token cache is being invalidate because project a8398692ff0b493eb4683f5ae1f3a9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:25.284132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:25.285207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-53e3dd5f-6966-41bf-a110-3d35d0447263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:25.288291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1033/2058] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:24 2022] DELETE /identity/v3/projects/a8398692ff0b493eb4683f5ae1f3a9b3 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:25.294016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.294016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.300480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.329949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:25.333604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:25.403685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1026/2059] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:25.410728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.411090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.411422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.436562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:25.437767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:25.446912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1034/2060] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:25.451087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:25.464654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c810-1607-47e6-b5a4-09c28c9a8e1e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:25.473257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:25.474428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.474938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.475428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.476598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:25.477147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:25.479135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:25.498860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:25.499297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1027/2061] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:25.516774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddad0f-eccb-4a7d-9402-8f6eb2f76ca1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:25.524094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:25.524725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.525060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.525362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.526021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:25.527968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:25.663380 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1035/2062] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:25 2022] POST /identity/v3/projects => generated 409 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:25.667554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:25.692281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997025d8-1b9c-4018-84b7-a7258eef68c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:25.779037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:25.779738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.780312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.780876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.781637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:25.784301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:25.894554 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1028/2063] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:25 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:25.898438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:25.914582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59ca4f-9661-49be-b3d5-0185eb34307c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:25.919785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:25.923824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.924337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.924844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.925786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:25.927611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:25.950091 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1036/2064] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:25.952600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:25.963558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca1ceb-559f-46ec-8dc5-9a36c6275b72 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:25.969865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:25.970994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:25.970994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:25.970994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:25.971668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:25.973825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:25.987036 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1029/2065] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:25.991203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.002453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260053e-7b9d-4fc4-b0ed-1de7ad96806d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.009884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.015930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.015930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.015930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] PATH_INFO: `/v3/projects/862c6709e951451ea9e0ac3ef98346ae/users/4bb418a5d05f47fdaded51ae34243867/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.032896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=862c6709e951451ea9e0ac3ef98346ae, user_id=4bb418a5d05f47fdaded51ae34243867, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.036059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487de0b-6d27-430a-9a2d-4f2043289176 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.104123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.105660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:26.123901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95b87-2a86-4fdb-89f8-b999cfe168a3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.130491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.131261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.136520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.137033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] PATH_INFO: `/v3/users/7ac1ff38dcaf4c1bb2005a500697175f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.140258 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1037/2066] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:25 2022] PUT /identity/v3/projects/862c6709e951451ea9e0ac3ef98346ae/users/4bb418a5d05f47fdaded51ae34243867/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:26.142221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac1ff38dcaf4c1bb2005a500697175f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.144434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.150360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.150877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.151375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.222717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] MFA Rules not processed for user `4bb418a5d05f47fdaded51ae34243867`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:26.224119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:26.330091 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1038/2067] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:26.336233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.400930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437c85-eea7-4094-849a-f54eb844fa59 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.405684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.406304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.406553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.406823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.407458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.409375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.462846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac1ff38dcaf4c1bb2005a500697175f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:26.463488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac1ff38dcaf4c1bb2005a500697175f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:26.470807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac1ff38dcaf4c1bb2005a500697175f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:26.471246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac1ff38dcaf4c1bb2005a500697175f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:26.568923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b86b9725-9805-4c49-a1a4-7991675d409f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac1ff38dcaf4c1bb2005a500697175f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:26.579486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1039/2068] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:26 2022] POST /identity/v3/projects => generated 409 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:26.580579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.582582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:26.592278 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1030/2069] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:26 2022] DELETE /identity/v3/users/7ac1ff38dcaf4c1bb2005a500697175f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:26.595464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.595750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.596023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.629585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:26.630958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:26.670601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae3311-29bc-4f14-aec5-4a0ee4b30de3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.701039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1031/2070] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:26.711237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.712854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:26.734980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.735619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.735885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.736589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.737441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.740784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.776698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c61496-74a8-4324-9341-6b9f496e7319 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.780764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.781382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.781690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.781960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.791962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.793397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.803894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1032/2071] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:26.830037 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1040/2072] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:26 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:26.834002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.844542 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:26.844765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce3ebc-afc5-4f4c-8003-62be83d59209 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.850743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.851447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.851828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.852205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.853039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.854858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:26.869230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1033/2073] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:26.873488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:26.884059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12826fb9-d1f4-436e-b3d0-70f2193d8226 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:26.889218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:26.890341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:26.890619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:26.890897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] PATH_INFO: `/v3/projects/fdf1dd7b072f486490733ca67bac8c7a/users/a217c20de3454be09caed2634dcfe1dd/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:26.893736 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:26.930478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf1dd7b072f486490733ca67bac8c7a, user_id=a217c20de3454be09caed2634dcfe1dd, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:26.936311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.016019 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1041/2074] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:26 2022] PUT /identity/v3/projects/fdf1dd7b072f486490733ca67bac8c7a/users/a217c20de3454be09caed2634dcfe1dd/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:27.020849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:27.030755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d05d5-2bb7-4670-9677-10f599c26268 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:27.095408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:27.095942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.096221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.096495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.097136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:27.100270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.107828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:27.110164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:27.114355 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1034/2075] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:27.117298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:27.127412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ff95c-a501-4dc1-bf25-18d54d97dc33 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:27.133113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:27.140926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.140926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.140926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] PATH_INFO: `/v3/projects/7e56eefbd10241678c78a096bf14c846` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.145453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847bb2f-7d4d-4e96-9516-f9570c19f759 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:27.150860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:27.151290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.151572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.152253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] PATH_INFO: `/v3/projects/fdf1dd7b072f486490733ca67bac8c7a/users/a217c20de3454be09caed2634dcfe1dd/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.154286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf1dd7b072f486490733ca67bac8c7a, user_id=a217c20de3454be09caed2634dcfe1dd, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:27.156862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e56eefbd10241678c78a096bf14c846)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:27.157010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87a36-225b-459a-9fb9-554d2c1a20ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.160571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.189741 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1035/2076] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:27 2022] PUT /identity/v3/projects/fdf1dd7b072f486490733ca67bac8c7a/users/a217c20de3454be09caed2634dcfe1dd/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:27.194119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.195840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.195840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.226671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] MFA Rules not processed for user `a217c20de3454be09caed2634dcfe1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:27.227888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:27.309371 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1036/2077] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:27.349565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e56eefbd10241678c78a096bf14c846', 'request_id': 'req-5308dbb3-bcb6-45e6-8210-02d008ac788f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.474160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e56eefbd10241678c78a096bf14c846', 'request_id': 'req-5308dbb3-bcb6-45e6-8210-02d008ac788f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.479997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e56eefbd10241678c78a096bf14c846', 'request_id': 'req-5308dbb3-bcb6-45e6-8210-02d008ac788f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.491347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] The token cache is being invalidate because project 7e56eefbd10241678c78a096bf14c846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:27.491778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.492541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.494196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1042/2078] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:27 2022] DELETE /identity/v3/projects/7e56eefbd10241678c78a096bf14c846 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:27.498154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:27.577642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:27.577642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:27.605304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b438de-ee8d-4ef2-a9db-db3c604269b4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:27.721382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:27.722355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.722827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308dbb3-bcb6-45e6-8210-02d008ac788f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:27.723059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.723754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] PATH_INFO: `/v3/users/0b5d5d7aebc242dcaaa02e9e73a2edba` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.725599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5d5d7aebc242dcaaa02e9e73a2edba)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:27.728341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.737002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:27.737685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:27.738419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:27.738768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:27.741824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:27.881984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:27.885583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:27.917317 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1043/2079] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:27.989907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5d5d7aebc242dcaaa02e9e73a2edba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:27.990889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5d5d7aebc242dcaaa02e9e73a2edba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.001883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5d5d7aebc242dcaaa02e9e73a2edba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.004317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5d5d7aebc242dcaaa02e9e73a2edba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.063914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:28.080147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22755e-5aa0-4a92-be8e-45c125fa21b1 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:28.095859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:28.096931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:28.098782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:28.099518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:28.114279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:28.141092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5d5d7aebc242dcaaa02e9e73a2edba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.168346 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1037/2080] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:27 2022] DELETE /identity/v3/users/0b5d5d7aebc242dcaaa02e9e73a2edba => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:28.227148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:28.229954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:28.257559 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1044/2081] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:28.433828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:28.436196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:28.538414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b03c63-07a1-48a4-b6c1-bc385397fc72 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:28.544162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:28.545090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:28.545571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:28.546000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] PATH_INFO: `/v3/users/4bb418a5d05f47fdaded51ae34243867` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:28.547570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb418a5d05f47fdaded51ae34243867)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:28.549860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:28.870902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb418a5d05f47fdaded51ae34243867'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.873693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb418a5d05f47fdaded51ae34243867'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.919484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb418a5d05f47fdaded51ae34243867'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:28.920963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb418a5d05f47fdaded51ae34243867'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.049506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4013a1b0-b212-471d-873f-19eca9e3e8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb418a5d05f47fdaded51ae34243867'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.055782 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:29.075082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:29.076899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.082537 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1038/2082] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:28 2022] DELETE /identity/v3/users/4bb418a5d05f47fdaded51ae34243867 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:29.087326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.087326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.087326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.101651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ebe3-cb7b-47f8-9fc1-e81c2d132e57 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:29.123344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:29.125923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.217704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:29.218581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.219029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.219640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] PATH_INFO: `/v3/projects/7088cf9d04bb40949660d6d22da9e8a8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.221881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7088cf9d04bb40949660d6d22da9e8a8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:29.225123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:29.260518 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1039/2083] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:29.274507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:29.275917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.354112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfa88a-e9d4-453e-bb6a-c1cc1935f421 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:29.358552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7088cf9d04bb40949660d6d22da9e8a8', 'request_id': 'req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.435582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:29.436234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.436561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.436789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.477947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7088cf9d04bb40949660d6d22da9e8a8', 'request_id': 'req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.485101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7088cf9d04bb40949660d6d22da9e8a8', 'request_id': 'req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.498335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] The token cache is being invalidate because project 7088cf9d04bb40949660d6d22da9e8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:29.498679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.499526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b94c1151-a685-4c9c-bf15-aa91a6fccc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:29.505633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1045/2084] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:29 2022] DELETE /identity/v3/projects/7088cf9d04bb40949660d6d22da9e8a8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:29.507306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948877be-0dee-4871-ad1d-c8c8fc91723e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.507807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948877be-0dee-4871-ad1d-c8c8fc91723e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.508284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948877be-0dee-4871-ad1d-c8c8fc91723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.541326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-948877be-0dee-4871-ad1d-c8c8fc91723e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:29.542984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-948877be-0dee-4871-ad1d-c8c8fc91723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.544684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:29.546152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:29.554828 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1046/2085] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:29.562784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.569130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.569130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.569573 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1040/2086] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:29.592899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:29.594168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.603441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1047/2087] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:29.606986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:29.608407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:29.631170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607c9d-bd09-4612-9990-ba0e013ceeb3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:29.639050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:29.639050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.639050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.639050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.639462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:29.639462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:29.640693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:29.660577 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1041/2088] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:29.662266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:29.676459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f7b1d-0b2c-47ac-8702-3e62610ade28 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:29.681645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:29.682255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.682540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.682813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.683452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:29.685884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:29.800663 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1048/2089] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:29 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:29.802635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:29.814751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c585c-7881-48d3-a2e8-dcca6479e219 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:29.902064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:29.904837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:29.905726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:29.906213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:29.908401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:29.911690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.036673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1042/2090] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:29 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:30.036895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.057843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decbea6-9fb2-40a4-9d6a-00f3b490964d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.065566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.066903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.067265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.067447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.068289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.069989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.086515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1049/2091] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:30.089308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.101290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce6c9-178d-454a-9f7b-a32f13a976a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.107452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.108106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.108383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.108657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.109522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.115382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.116907 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:30.142452 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1043/2092] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:30.143742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.156174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d064a-6ef2-4937-acb6-d77c21617d7e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.162030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.163010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.163352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.163690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] PATH_INFO: `/v3/projects/76b6f7b705f5428b9a3a3a8c4f86ff48/users/c536d41a93ad4337909fe2e2cb949e03/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.182002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b6f7b705f5428b9a3a3a8c4f86ff48, user_id=c536d41a93ad4337909fe2e2cb949e03, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.185258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e33b29-d417-42de-ac9d-b26ffddb59a6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.232387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.234462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:30.249458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40fd7-66b8-4d82-a855-c8377dc4ffce admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.255078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.255733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.256151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.256602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] PATH_INFO: `/v3/projects/862c6709e951451ea9e0ac3ef98346ae` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.262154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=862c6709e951451ea9e0ac3ef98346ae)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.266121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.267218 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1050/2093] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:30 2022] PUT /identity/v3/projects/76b6f7b705f5428b9a3a3a8c4f86ff48/users/c536d41a93ad4337909fe2e2cb949e03/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:30.278036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.278614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.279035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.325775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:30.327030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:30.416598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1051/2094] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:30.416765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862c6709e951451ea9e0ac3ef98346ae', 'request_id': 'req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:30.421237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.424584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862c6709e951451ea9e0ac3ef98346ae', 'request_id': 'req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:30.522530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1df10-cade-4a7b-92f7-d7db80558d02 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.574897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862c6709e951451ea9e0ac3ef98346ae', 'request_id': 'req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:30.601305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] The token cache is being invalidate because project 862c6709e951451ea9e0ac3ef98346ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:30.601891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:30.604756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:30.607294 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1044/2095] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:30 2022] DELETE /identity/v3/projects/862c6709e951451ea9e0ac3ef98346ae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:30.611510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.615436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:30.644900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.645563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.645842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.646113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.649653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.654016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.732324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5f9eb-63b9-4c6d-9ec3-09108f4bb6eb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.737013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.737719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.738198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.738445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] PATH_INFO: `/v3/users/a217c20de3454be09caed2634dcfe1dd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.739623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a217c20de3454be09caed2634dcfe1dd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.741608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:30.848206 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1052/2096] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:30 2022] POST /identity/v3/projects => generated 381 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:30.852137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:30.854040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:30.924257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3363-ee44-4158-8972-f1b2776d9fde admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:30.929306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:30.929954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:30.930239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:30.930505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:30.931131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:30.933605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:31.037711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a217c20de3454be09caed2634dcfe1dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:31.038378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a217c20de3454be09caed2634dcfe1dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:31.047547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a217c20de3454be09caed2634dcfe1dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:31.048660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a217c20de3454be09caed2634dcfe1dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:31.056487 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1053/2097] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:30 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:31.060640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:31.062422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:31.075242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b2399-ca89-43cd-a667-79e70281d5a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:31.080675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:31.081313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.081617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.082455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.083107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:31.084698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:31.096102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1054/2098] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:31.100056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:31.110014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bc9c-ce15-46e6-a244-3ffb1e368384 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:31.114808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:31.115458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.115732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.116000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] PATH_INFO: `/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c/users/e1bac27011fc4bce9e391ad7915048b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.131658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5048aae9b0e493da6cf3bb93ed29b3c, user_id=e1bac27011fc4bce9e391ad7915048b2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:31.134547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:31.164084 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:31.209660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a217c20de3454be09caed2634dcfe1dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:31.230838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1045/2099] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:30 2022] DELETE /identity/v3/users/a217c20de3454be09caed2634dcfe1dd => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:31.259026 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1055/2100] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:31 2022] PUT /identity/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c/users/e1bac27011fc4bce9e391ad7915048b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:31.265792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:31.373888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f408-5721-4a21-b2b4-0f5faa963dda admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:31.440172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:31.442091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.442091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.442292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.442847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:31.444473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a90041-4b25-4bc4-9374-73be816215a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:31.459313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1046/2101] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:31.460558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:31.471726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fe468-80df-4be9-9274-aca1b831dab6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:31.477897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:31.478736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.479015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.480990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] PATH_INFO: `/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c/users/e1bac27011fc4bce9e391ad7915048b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.482561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5048aae9b0e493da6cf3bb93ed29b3c, user_id=e1bac27011fc4bce9e391ad7915048b2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:31.486683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ee7ed-b414-492a-8a7e-f845169853e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:31.512373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1056/2102] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:31 2022] PUT /identity/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c/users/e1bac27011fc4bce9e391ad7915048b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:31.513178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.513619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.514676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.549151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] MFA Rules not processed for user `e1bac27011fc4bce9e391ad7915048b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:31.551181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:31.656103 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1047/2103] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:31.666692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:31.667035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:31.667241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:31.689298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:31.693188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:31.757927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1057/2104] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:32.062222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:32.063788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:32.125034 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:32.170866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7df5c-862a-4dcb-8704-cdd42b65efe3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:32.178926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:32.179731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.180324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.180515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.182509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:32.193550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:32.195192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95bc9-bcee-4654-abb0-995bd3b6d274 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:32.204504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1048/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:32.237730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:32.239396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:32.349604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c4c8-412b-4f54-ad2a-28446e148a2b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:32.354342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:32.355269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.355620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.356097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] PATH_INFO: `/v3/projects/fdf1dd7b072f486490733ca67bac8c7a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.358142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf1dd7b072f486490733ca67bac8c7a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:32.364055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:32.364055 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:32.536398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf1dd7b072f486490733ca67bac8c7a', 'request_id': 'req-eb77f120-ffa2-449b-9658-032582b3a29f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:32.607416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf1dd7b072f486490733ca67bac8c7a', 'request_id': 'req-eb77f120-ffa2-449b-9658-032582b3a29f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:32.615969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf1dd7b072f486490733ca67bac8c7a', 'request_id': 'req-eb77f120-ffa2-449b-9658-032582b3a29f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:32.629692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] The token cache is being invalidate because project fdf1dd7b072f486490733ca67bac8c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:32.630031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:32.630650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb77f120-ffa2-449b-9658-032582b3a29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:32.632179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1058/2106] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:32 2022] DELETE /identity/v3/projects/fdf1dd7b072f486490733ca67bac8c7a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:32.638190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.639304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.639911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.664522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:32.667577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:32.743312 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1049/2107] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:32.755512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.755775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.756134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.793378 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:32.798743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:32.801318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:32.820645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1059/2108] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:32.824814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:32.838445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf41c6f-67cc-49c4-8699-841936272b37 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:32.849612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:32.850327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.850628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.850869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.851592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:32.851901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:32.853643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:32.871098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1050/2109] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:32.875331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:32.886844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238f81-a479-41da-b9d4-d5a396a8d4de None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:32.892430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:32.893041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:32.893325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:32.893619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:32.894369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:32.896345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:33.057217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:33.060012 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1060/2110] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:32 2022] POST /identity/v3/projects => generated 395 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:33.077966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2487f4d-d2c4-4d11-ba58-cf583ee49286 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:33.124776 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:33.181986 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:33.298896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:33.298896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:33.299636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:33.300062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:33.307303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:33.325927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:33.495457 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1051/2111] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:33 2022] POST /identity/v3/users => generated 298 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:33.499675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:33.514891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01b1d-1b7a-45ac-a311-90172e39a1c1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:33.538502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:33.540561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:33.540561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:33.540561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:33.540561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:33.545228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:33.586958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:33.597189 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1061/2112] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:33.606718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18354cdd-f993-436f-af6e-e26e8c2882b4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:33.629750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:33.630399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:33.630682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:33.630958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:33.634867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:33.636408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2082-19fd-4b03-8c8f-b90fb5e85542 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:33.683829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:33.694862 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1052/2113] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:33.697101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497130b1-3d85-40a5-897c-4f523857be22 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:33.718576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:33.719259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:33.719542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:33.719820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] PATH_INFO: `/v3/projects/370f76c07f40457a9be4fd8c6a2c7c00/users/d8eca31b72d34edd8781854560874264/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:33.762607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=370f76c07f40457a9be4fd8c6a2c7c00, user_id=d8eca31b72d34edd8781854560874264, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:33.768540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:33.864407 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1062/2114] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:33 2022] PUT /identity/v3/projects/370f76c07f40457a9be4fd8c6a2c7c00/users/d8eca31b72d34edd8781854560874264/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:33.876097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372968-e65a-4039-818b-92a2522413cd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:33.876388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372968-e65a-4039-818b-92a2522413cd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:33.876667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372968-e65a-4039-818b-92a2522413cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:34.024193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14372968-e65a-4039-818b-92a2522413cd None None] MFA Rules not processed for user `d8eca31b72d34edd8781854560874264`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:34.032004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14372968-e65a-4039-818b-92a2522413cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:34.194169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1053/2115] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:34.199016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:34.362033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0000a6-1ee2-4739-afc2-dd2d191a3d98 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:34.368158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:34.369147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:34.369528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:34.369868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:34.370717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:34.373191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:34.512053 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1063/2116] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:34 2022] POST /identity/v3/projects => generated 393 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:34.516233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372968-e65a-4039-818b-92a2522413cd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:34.562494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372968-e65a-4039-818b-92a2522413cd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:34.700032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:34.700699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:34.700948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:34.701420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:34.702276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:34.704412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:34.836177 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1054/2117] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:34 2022] POST /identity/v3/users => generated 303 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:34.839813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:34.852083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e26a93-0868-49d1-a8b2-c66c8777ea01 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:34.871540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:34.872178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:34.872461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:34.872747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:34.873421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:34.875035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:34.904397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1064/2118] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:34.908350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:34.935424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792458c-a9a7-425b-a493-e0ca95064496 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:34.944787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:34.945506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:34.945788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:34.946066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] PATH_INFO: `/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a/users/a1c3a065c61441b4a88f94bb1b5c630c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:34.966061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c3a78e2f9a4424845fff2ce301bd4a, user_id=a1c3a065c61441b4a88f94bb1b5c630c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:34.968721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:35.079979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1055/2119] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:34 2022] PUT /identity/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a/users/a1c3a065c61441b4a88f94bb1b5c630c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:35.081204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:35.092183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d3d15-b8bc-4159-b341-67cc2e14c6e6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:35.108205 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:35.156281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:35.156889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.157161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.157650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.158313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:35.159937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c070920-801b-4f0b-be2d-2416da84980c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:35.173515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1065/2120] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:35.176027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:35.188133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53bcf2-8c92-4c68-8a1d-c886440dc637 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:35.194897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:35.195398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.196080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.196643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] PATH_INFO: `/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a/users/a1c3a065c61441b4a88f94bb1b5c630c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.198620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c3a78e2f9a4424845fff2ce301bd4a, user_id=a1c3a065c61441b4a88f94bb1b5c630c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:35.201327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:35.212347 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1056/2121] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:35 2022] PUT /identity/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a/users/a1c3a065c61441b4a88f94bb1b5c630c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:35.222739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.223025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.223387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.255875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] MFA Rules not processed for user `a1c3a065c61441b4a88f94bb1b5c630c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:35.257636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:35.308533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:35.310175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:35.335419 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:35.371564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1066/2122] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:35.383215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:35.386533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:35.447721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837541d-4d6f-41af-849d-136eb8be1d22 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:35.454475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:35.455093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.455375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.456317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.468075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:35.472023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6733-f2e8-423d-afcd-3567809b7231 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:35.479535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:35.480206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.480488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.480758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.493600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:35.495223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:35.510951 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1067/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:35.565620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:35.567864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792cec5-80d3-43e3-a41f-97e32e8b4ddf service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:35.580547 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1057/2124] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:35.681936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:35.750347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc04b-8382-401f-a000-e303f27c41e9 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:35.755559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:35.756264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:35.756739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:35.757022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] PATH_INFO: `/v3/users/d8eca31b72d34edd8781854560874264` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:35.758371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8eca31b72d34edd8781854560874264)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:35.761227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:36.039229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8eca31b72d34edd8781854560874264'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:36.110533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8eca31b72d34edd8781854560874264'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:36.111206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8eca31b72d34edd8781854560874264'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:36.125183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8eca31b72d34edd8781854560874264'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:36.133199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8eca31b72d34edd8781854560874264'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:36.139429 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1068/2125] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:35 2022] DELETE /identity/v3/users/d8eca31b72d34edd8781854560874264 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:36.143981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:36.145013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:36.152248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:36.186508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:36.187963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:36.278392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1058/2126] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:36.286183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:36.287809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:36.358424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0009b09-9ef4-46d8-b019-ce3c94a39ef4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:36.362167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:36.363101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:36.363376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:36.363644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:36.373292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:36.374998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:36.385987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1069/2127] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:36.823307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:36.825057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:36.844744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf1b69-0ca0-4432-9e2c-10489a8f7612 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:36.852019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:36.852896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:36.853128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:36.853515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] PATH_INFO: `/v3/projects/370f76c07f40457a9be4fd8c6a2c7c00` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:36.854915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=370f76c07f40457a9be4fd8c6a2c7c00)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:36.857413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:37.018593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '370f76c07f40457a9be4fd8c6a2c7c00', 'request_id': 'req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.024979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '370f76c07f40457a9be4fd8c6a2c7c00', 'request_id': 'req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.116733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '370f76c07f40457a9be4fd8c6a2c7c00', 'request_id': 'req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.131156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] The token cache is being invalidate because project 370f76c07f40457a9be4fd8c6a2c7c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:37.131490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.132143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa9bec57-8b5d-417b-abaa-3ab7ec236f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.138172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:37.138680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1059/2128] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:36 2022] DELETE /identity/v3/projects/370f76c07f40457a9be4fd8c6a2c7c00 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:37.150980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5daa3a-2a5c-4aeb-8947-c53761529442 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:37.257080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:37.257766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:37.258047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:37.258320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] PATH_INFO: `/v3/users/a1c3a065c61441b4a88f94bb1b5c630c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:37.259586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c3a065c61441b4a88f94bb1b5c630c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:37.262364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:37.478124 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:37.493410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c3a065c61441b4a88f94bb1b5c630c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.562219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c3a065c61441b4a88f94bb1b5c630c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.564173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6e42-7de1-441d-8ff8-ac5ffedb04a7 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:37.564643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6e42-7de1-441d-8ff8-ac5ffedb04a7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:37.564738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6e42-7de1-441d-8ff8-ac5ffedb04a7 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:37.566725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1060/2129] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:15:37.567077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c3a065c61441b4a88f94bb1b5c630c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.572140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:37.572417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:37.572696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:37.583013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c3a065c61441b4a88f94bb1b5c630c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.590121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c3a065c61441b4a88f94bb1b5c630c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:37.593289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:37.594584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:37.596072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1070/2130] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:37 2022] DELETE /identity/v3/users/a1c3a065c61441b4a88f94bb1b5c630c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:37.664434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1061/2131] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:37.675991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:37.677789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:37.737041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b04c-f4d3-447d-aadf-ad0ad95ef8f9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:37.741248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:37.741878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:37.742158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:37.742432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:37.753141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:37.754629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0260c52-f230-4272-b69e-da365bc8f948 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:37.765820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1071/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:38.130420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:38.132301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:38.234384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc72da-055d-4715-8e91-8bd66a5429f8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:38.239903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:38.240639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:38.240991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:38.241284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] PATH_INFO: `/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:38.242583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c3a78e2f9a4424845fff2ce301bd4a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:38.246331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:38.468600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c3a78e2f9a4424845fff2ce301bd4a', 'request_id': 'req-604df996-15f8-47a1-95e8-e5d5b18b0fcb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:38.493975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c3a78e2f9a4424845fff2ce301bd4a', 'request_id': 'req-604df996-15f8-47a1-95e8-e5d5b18b0fcb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:38.517740 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:38.616974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c3a78e2f9a4424845fff2ce301bd4a', 'request_id': 'req-604df996-15f8-47a1-95e8-e5d5b18b0fcb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:38.646583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] The token cache is being invalidate because project 61c3a78e2f9a4424845fff2ce301bd4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:38.646968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:38.647699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-604df996-15f8-47a1-95e8-e5d5b18b0fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:38.649276 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1062/2133] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:38 2022] DELETE /identity/v3/projects/61c3a78e2f9a4424845fff2ce301bd4a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:38.654597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:38.655120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:38.655215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:38.683186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:38.697547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:38.757601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1072/2134] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:38.765324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:38.765632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:38.765910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:38.787067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:38.788285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:38.796475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1063/2135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:38.800772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:38.811578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4465-ccdc-43b0-958f-19070a029fbe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:38.816755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:38.817382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:38.817661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:38.818070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:38.818742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:38.819037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:38.820644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:38.837014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1073/2136] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:38.838302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:38.847899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14358776-62a7-4483-a86a-d79a93dfee39 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:38.852886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:38.853761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:38.854045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:38.854324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:38.854978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:38.857024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:38.945053 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1064/2137] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:38 2022] POST /identity/v3/projects => generated 395 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:38.948622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:38.959162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233230c-5809-4c5c-aade-458ab9958dda admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.019039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.019672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.019948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.020213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.020856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.022903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.117847 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1074/2138] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:38 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:39.121858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.133264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bde62-6da8-4237-9f66-8062597e59bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.138058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.138809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.139093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.139677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.140362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.142075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.157085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1065/2139] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:39.158329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.169603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d28b74-1a5b-43b8-9b84-d1362b7c37ed admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.174425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.175022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.175299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.176078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.176715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.178336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ad3fb-95c2-4603-a9c8-1c15c8e20242 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.189792 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1075/2140] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:39.194693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.205010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6559bc-4d7b-488e-bb44-2a0bbb665b5c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.209815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.210477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.210758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.211038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] PATH_INFO: `/v3/projects/c653b9bf1e064528b2ffe8c9b57fa48d/users/9e6512cfbbbf412cbc4c40b80669b637/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.227564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c653b9bf1e064528b2ffe8c9b57fa48d, user_id=9e6512cfbbbf412cbc4c40b80669b637, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.230260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.325958 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1066/2141] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:39 2022] PUT /identity/v3/projects/c653b9bf1e064528b2ffe8c9b57fa48d/users/9e6512cfbbbf412cbc4c40b80669b637/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:39.337373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.338102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.338102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.383156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] MFA Rules not processed for user `9e6512cfbbbf412cbc4c40b80669b637`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:39.384369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:39.454425 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1076/2142] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:39.459092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.574881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c7e96-db2a-4342-8479-34eefb2c9262 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.580928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.582084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.583971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.583971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.583971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.587630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.697883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1067/2143] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:39 2022] POST /identity/v3/projects => generated 395 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:39.704525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.719464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949add27-b9ce-406c-9e52-b5c1ff3f189f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.798431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.799048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.799455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.799736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.800415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.802454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.879162 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:39.952892 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1077/2144] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:39 2022] POST /identity/v3/users => generated 304 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:39.957751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:39.969137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc45e0-d6fd-419b-8547-920e68bc0461 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:39.974708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:39.975356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:39.975634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:39.975905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:39.976561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:39.978278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4098f-6483-46a6-896e-a3d24023aea7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:39.991156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1068/2145] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:39.998949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:40.000822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.001104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.001404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.010987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7c918-1d30-4ab4-b9e9-a805be75e2ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:40.016135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:40.016891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.017241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.017645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] PATH_INFO: `/v3/projects/b706ee7f68734f6f981f76b490b719e1/users/cc3fb2fd50514064993b0acf4101cd1a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.023520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] MFA Rules not processed for user `c7334417689847d18bc4c1b27d173a23`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:40.024976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:40.036343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b706ee7f68734f6f981f76b490b719e1, user_id=cc3fb2fd50514064993b0acf4101cd1a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:40.039060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:40.093071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1069/2146] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:40.134173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1078/2147] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:39 2022] PUT /identity/v3/projects/b706ee7f68734f6f981f76b490b719e1/users/cc3fb2fd50514064993b0acf4101cd1a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:40.147052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:40.158197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e3ce2-7ba5-4cfc-85a4-aec3ca142eae None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:40.236490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:40.236490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.236490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.236490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.236954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:40.237324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4d33-b4cf-420a-a905-556824a31098 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:40.248156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1070/2148] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:40.252150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:40.264009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b2c0f-b0b3-4bcf-ad41-c676e1a336f3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:40.270958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:40.271692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.272045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.272389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] PATH_INFO: `/v3/projects/b706ee7f68734f6f981f76b490b719e1/users/cc3fb2fd50514064993b0acf4101cd1a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.274401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b706ee7f68734f6f981f76b490b719e1, user_id=cc3fb2fd50514064993b0acf4101cd1a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:40.277305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133414b-19d6-4c2f-b26f-680a610ee46e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:40.297414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1079/2149] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:40 2022] PUT /identity/v3/projects/b706ee7f68734f6f981f76b490b719e1/users/cc3fb2fd50514064993b0acf4101cd1a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:40.303823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.305009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.305009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.352519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] MFA Rules not processed for user `cc3fb2fd50514064993b0acf4101cd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:40.353945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:40.432643 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1071/2150] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:40.445272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.445603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.445877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.482767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] MFA Rules not processed for user `9e6512cfbbbf412cbc4c40b80669b637`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:40.484007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:40.548112 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:40.562696 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1080/2151] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:40.589046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:40.591502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:40.707411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2d76-a4d6-404a-9fdc-fc1591cd63b7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:40.713444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:40.714049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:40.714330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:40.714601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:40.724814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:40.726044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa0285-64fb-425c-958f-e4421747ea8f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:40.735918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1072/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:41.114031 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:41.749141 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:43.153572 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:43.682376 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:45.305394 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:45.380367 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:46.768289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:46.769965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:46.838660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec82a0-e384-463a-b91e-87df1a85d36a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:46.843509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:46.844169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:46.844448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:46.844718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] PATH_INFO: `/v3/users/51ccc0bfdee94961aa198e3abf0d85cc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:46.846454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ccc0bfdee94961aa198e3abf0d85cc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:46.848695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:47.097004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ccc0bfdee94961aa198e3abf0d85cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:47.173673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ccc0bfdee94961aa198e3abf0d85cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:47.174812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ccc0bfdee94961aa198e3abf0d85cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:47.188793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ccc0bfdee94961aa198e3abf0d85cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:47.196653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ccc0bfdee94961aa198e3abf0d85cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:47.206115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1081/2153] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:46 2022] DELETE /identity/v3/users/51ccc0bfdee94961aa198e3abf0d85cc => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:47.210752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:47.211281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:47.211281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:47.232191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:47.233422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:47.302077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1073/2154] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:47.334928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:47.336118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:47.341472 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:47.445422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036eaf-d0e9-4c13-b38f-f9bc6799e023 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:47.455602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:47.457123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:47.457445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:47.457720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:47.476278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:47.478387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:47.491811 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1082/2155] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:48.164541 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:48.239274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:48.242567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:48.257239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5b838-d10c-45e9-b328-c94fce7d5726 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:48.264368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:48.265423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:48.266777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:48.267669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] PATH_INFO: `/v3/projects/3ee1e04c04bc40568e43eb98df39e7e6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:48.269938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1e04c04bc40568e43eb98df39e7e6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:48.272188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:48.455167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1e04c04bc40568e43eb98df39e7e6', 'request_id': 'req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:48.468080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1e04c04bc40568e43eb98df39e7e6', 'request_id': 'req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:48.535544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1e04c04bc40568e43eb98df39e7e6', 'request_id': 'req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:48.551432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] The token cache is being invalidate because project 3ee1e04c04bc40568e43eb98df39e7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:48.552081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:48.552839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:48.554620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1074/2156] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:48 2022] DELETE /identity/v3/projects/3ee1e04c04bc40568e43eb98df39e7e6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:48.558784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:48.570164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514a62e-fc73-4602-b8c9-1bcca224668a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:48.660637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:48.661562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:48.661988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:48.662405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] PATH_INFO: `/v3/users/e5cba98608e84304913424e7704c7227` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:48.664695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5cba98608e84304913424e7704c7227)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:48.667041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:48.924031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5cba98608e84304913424e7704c7227'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.014614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5cba98608e84304913424e7704c7227'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.015250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5cba98608e84304913424e7704c7227'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.039983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5cba98608e84304913424e7704c7227'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.052404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-efda9dd4-6354-41b3-be3f-c8e9e7023127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5cba98608e84304913424e7704c7227'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.059262 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1083/2157] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:48 2022] DELETE /identity/v3/users/e5cba98608e84304913424e7704c7227 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:49.279369 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:49.536404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:49.537999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:49.556171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd78e1e-94f4-4ca3-b502-fd2060a7cca2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:49.651301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:49.652082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:49.652597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:49.653139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] PATH_INFO: `/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:49.654599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc4e7dc475b4830af3bbc7a7ba767ed)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:49.656641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:49.808765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc4e7dc475b4830af3bbc7a7ba767ed', 'request_id': 'req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.826464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc4e7dc475b4830af3bbc7a7ba767ed', 'request_id': 'req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.912755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc4e7dc475b4830af3bbc7a7ba767ed', 'request_id': 'req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.930066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] The token cache is being invalidate because project 7bc4e7dc475b4830af3bbc7a7ba767ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:49.930629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.931802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3571a83-7bbc-4cd1-b7d4-6460e5fca8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:49.934385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1075/2158] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:49 2022] DELETE /identity/v3/projects/7bc4e7dc475b4830af3bbc7a7ba767ed => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:49.940443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:49.941866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:49.947938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:49.978292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:49.980317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:50.062365 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1084/2159] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:50.073513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.075534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.076394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.106237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:50.110178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:50.170613 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1076/2160] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:50.174587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.188231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1de402-55fd-4030-9705-8c43f06973ae None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.196193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.196978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.197566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.198068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.198941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:50.200335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.205015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.227353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1085/2161] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:15:50.230765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.250574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d791d-2df2-4c68-b8c4-c68f7998f708 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.257906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.258801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.259267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.259787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.260607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.269098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.387713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.388927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1077/2162] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:50 2022] POST /identity/v3/projects => generated 395 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:50.402399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0db8d-3cea-443b-b525-b63267aae781 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.480985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.482370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.482718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.483058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.484242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.487073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.575409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.577218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:50.593430 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1086/2163] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:50 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:50.594843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.600089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee68f8-3dc8-42cb-b17a-26312f997350 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.617845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.618000 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:50.618087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.618260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.618546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] PATH_INFO: `/v3/users/c9e2d5caf6c64b5eb508c47bbbc13892` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.621924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e2d5caf6c64b5eb508c47bbbc13892)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.624229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.628634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5488a-86a0-4382-b524-91a2f0f7551d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.649478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.651459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.667414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.667979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.668862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.670894 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:50.671113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.684851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1087/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:50.698506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.709167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde68d-ddd9-4c90-b35d-26edd50a21b4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.719395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.721195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.721537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.721815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.723317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.725735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.747555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1088/2165] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:50.748621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:50.785533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c523-03a7-452d-aaf7-9b9fcdc4edc0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:50.791510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:50.792606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.793042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.797242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] PATH_INFO: `/v3/projects/8119c8826f3b448b97c68624dc1deab3/users/9ddfb96c41d8427c9e3691dac10c2129/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:50.864825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8119c8826f3b448b97c68624dc1deab3, user_id=9ddfb96c41d8427c9e3691dac10c2129, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:50.869217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e2d5caf6c64b5eb508c47bbbc13892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:50.869852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fec232-2369-49ba-ac75-f6f5a2289372 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:50.870496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e2d5caf6c64b5eb508c47bbbc13892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:50.881903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e2d5caf6c64b5eb508c47bbbc13892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:50.884977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e2d5caf6c64b5eb508c47bbbc13892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:50.975779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f07dd3d3-432e-437f-b58e-38f17566546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e2d5caf6c64b5eb508c47bbbc13892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:50.982731 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1089/2166] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:50 2022] PUT /identity/v3/projects/8119c8826f3b448b97c68624dc1deab3/users/9ddfb96c41d8427c9e3691dac10c2129/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:50.994188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:50.994582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:50.994859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.007230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1078/2167] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:50 2022] DELETE /identity/v3/users/c9e2d5caf6c64b5eb508c47bbbc13892 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:51.011529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.012030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.012482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.034332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:51.036102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:51.049043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] MFA Rules not processed for user `9ddfb96c41d8427c9e3691dac10c2129`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:51.050572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:51.103520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1079/2168] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:51.110661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.115134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:51.154517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1090/2169] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:51.155876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.161537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:51.183979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d6249-9813-4a9e-b57b-c862b82fbe76 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.198991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.199739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.199933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.200323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.201170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.205437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.238946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf44b5d-bfdb-4350-abb0-937621c1e51e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.244852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.248746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.248746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.248746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.258419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.260019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.272833 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1080/2170] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:51.308106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1091/2171] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:51 2022] POST /identity/v3/projects => generated 395 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:51.312699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.325499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5940b-2382-401e-b682-edb343533429 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.386263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.386863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.387136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.387402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.388019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.390006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.513258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1081/2172] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:51 2022] POST /identity/v3/users => generated 304 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:51.521436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.532290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd473fd-55c4-4dd1-8eb8-36c2a3e00795 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.536932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.537596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.537877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.538150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.538883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.545203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.558446 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1092/2173] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:51.562343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.579222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801a86a-9dc2-4f5c-8d76-ecdd6fc20049 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.585069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.585770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.586049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.586325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] PATH_INFO: `/v3/projects/75d0398135b946aba85659670dfff2eb/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.604578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0398135b946aba85659670dfff2eb, user_id=5e67ce6a3ec44bed8ce8d0e8cb4b04db, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.607251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.695105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1082/2174] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:51 2022] PUT /identity/v3/projects/75d0398135b946aba85659670dfff2eb/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:51.698942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.709529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14ec9-ee92-42fa-9b9c-db891c7e5c39 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.747448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.749295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:51.783180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.784385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.784730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.785313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.790530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.790530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.801184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1093/2175] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:51.805943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:51.819992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f982-b061-4688-952a-dca9ae05fb50 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.825634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.826297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.826574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.826842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] PATH_INFO: `/v3/projects/75d0398135b946aba85659670dfff2eb/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.828975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0398135b946aba85659670dfff2eb, user_id=5e67ce6a3ec44bed8ce8d0e8cb4b04db, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.832752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37972fab-bc7f-4e0e-9559-a2d7e571f532 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.833930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7202c5-014c-48ea-bc91-84acc61470ad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:51.839228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:51.839867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.840150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.840428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] PATH_INFO: `/v3/projects/c345b7715cca426599dce98b8906ef8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.841614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c345b7715cca426599dce98b8906ef8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:51.843527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:51.847042 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1094/2176] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:51 2022] PUT /identity/v3/projects/75d0398135b946aba85659670dfff2eb/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:51.924830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:51.926086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:51.926357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:51.955990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] MFA Rules not processed for user `5e67ce6a3ec44bed8ce8d0e8cb4b04db`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:51.957295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.023883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c345b7715cca426599dce98b8906ef8e', 'request_id': 'req-824e849f-8cb3-48ee-a201-e12da46c4e15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.029877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c345b7715cca426599dce98b8906ef8e', 'request_id': 'req-824e849f-8cb3-48ee-a201-e12da46c4e15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.039309 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:52.040457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1095/2177] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:52.057720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:52.059341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.106999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c345b7715cca426599dce98b8906ef8e', 'request_id': 'req-824e849f-8cb3-48ee-a201-e12da46c4e15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.132035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] The token cache is being invalidate because project c345b7715cca426599dce98b8906ef8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:52.132395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.134074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.136806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1083/2178] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:51 2022] DELETE /identity/v3/projects/c345b7715cca426599dce98b8906ef8e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:52.139876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:52.143125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.159561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ef2e1-0ffe-4383-97c5-fce7ba0ec9d1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:52.246292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e849f-8cb3-48ee-a201-e12da46c4e15 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:52.252056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:52.253051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:52.253792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:52.254173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:52.254883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] PATH_INFO: `/v3/users/d7e4d8a849c94a829cbf0c23b1a20555` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:52.255237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:52.255665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:52.256584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e4d8a849c94a829cbf0c23b1a20555)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:52.257017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:52.260256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.260922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:52.377979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:52.379625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:52.390393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1096/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:52.490049 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:52.507287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e4d8a849c94a829cbf0c23b1a20555'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.508108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e4d8a849c94a829cbf0c23b1a20555'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.518563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e4d8a849c94a829cbf0c23b1a20555'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.519296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e4d8a849c94a829cbf0c23b1a20555'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.609640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e4d8a849c94a829cbf0c23b1a20555'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:52.640138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1084/2180] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:52 2022] DELETE /identity/v3/users/d7e4d8a849c94a829cbf0c23b1a20555 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:52.717921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:52.719361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.735309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959a1a4-c3fa-4af7-a389-478a1a42e676 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:52.848114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:52.850514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:52.850514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:52.850514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:52.851689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:52.953523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:52.956395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581803e-d3e4-4dd2-a39c-a18dc69fe2a3 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:52.981664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1097/2181] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:52.995953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:52.998062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:53.126693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea20b-0971-4f91-be5f-36ce9e4dbabc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:53.133622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:53.134454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:53.134837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:53.135241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] PATH_INFO: `/v3/users/9ddfb96c41d8427c9e3691dac10c2129` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:53.137398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddfb96c41d8427c9e3691dac10c2129)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:53.140030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:53.388300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddfb96c41d8427c9e3691dac10c2129'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.389049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddfb96c41d8427c9e3691dac10c2129'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.406467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddfb96c41d8427c9e3691dac10c2129'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.407222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddfb96c41d8427c9e3691dac10c2129'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.501420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddfb96c41d8427c9e3691dac10c2129'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.521551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1085/2182] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:52 2022] DELETE /identity/v3/users/9ddfb96c41d8427c9e3691dac10c2129 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:53.526269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:53.526824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:53.526824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:53.546515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:53.547810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:53.587262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:53.590217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:53.621696 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1098/2183] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:53.628853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:53.630611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:53.671502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5e44-026d-455d-a9a0-b3d3ace76d70 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:53.677143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:53.678088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:53.678636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:53.679136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] PATH_INFO: `/v3/projects/d50c0edb547944728cce0f12105fa7bb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:53.680659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50c0edb547944728cce0f12105fa7bb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:53.682864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:53.697881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fd238-bacb-4701-a7dd-4537cbf755d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:53.701622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:53.702247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:53.702527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:53.702799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:53.713816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:53.715259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b8a52-776f-42fa-a521-cf0799698699 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:53.726061 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1099/2184] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:53.806335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50c0edb547944728cce0f12105fa7bb', 'request_id': 'req-1233fcc5-6866-45cd-9284-16798cd0d937'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.812718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50c0edb547944728cce0f12105fa7bb', 'request_id': 'req-1233fcc5-6866-45cd-9284-16798cd0d937'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.952664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50c0edb547944728cce0f12105fa7bb', 'request_id': 'req-1233fcc5-6866-45cd-9284-16798cd0d937'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.965114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] The token cache is being invalidate because project d50c0edb547944728cce0f12105fa7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:53.965438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.966149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1233fcc5-6866-45cd-9284-16798cd0d937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:53.967626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1086/2185] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:53 2022] DELETE /identity/v3/projects/d50c0edb547944728cce0f12105fa7bb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:53.973949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:53.974233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:53.974535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:53.995715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:53.997122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:54.065585 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:54.075913 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1100/2186] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:54.079283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:54.080009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:54.080413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:54.104766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:54.106083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:54.116006 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1087/2187] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:54.120535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:54.132632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c2d5-1fd5-4721-9e81-3584db415d62 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:54.137906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:54.139133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:54.139421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:54.139691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:54.140539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:54.140842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:54.142635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:54.166630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1101/2188] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:15:54.170992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:54.184613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95d386-9688-46f0-8f20-6520ce23f927 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:54.190677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:54.191397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:54.191681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:54.191954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:54.192750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:54.194986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:54.357546 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1088/2189] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:54 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:54.363162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:54.389606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:54.403121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:54.411994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41444d38-8d94-475c-8cd1-9b2b19697db1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:54.526436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdbea4-afa8-4e64-a015-316e9af93b79 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:54.537792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:54.540845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:54.541184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:54.542058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] PATH_INFO: `/v3/projects/8119c8826f3b448b97c68624dc1deab3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:54.544050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8119c8826f3b448b97c68624dc1deab3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:54.550424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:54.558071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:54.558679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:54.558956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:54.559222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:54.560333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:54.562461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:54.610452 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:55.046612 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1102/2190] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:54 2022] POST /identity/v3/users => generated 289 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:55.047907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.058746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac22ec-b025-4249-8012-d186e0e3d62b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:55.064129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:55.064642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.064943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.065219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.065952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:55.067814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:55.084323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1103/2191] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:55.085321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.092830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8119c8826f3b448b97c68624dc1deab3', 'request_id': 'req-2d00e95a-0658-4339-a04f-11195480c3cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.096216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060756bb-dc45-4c90-8173-6b60c2e5e63c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:55.100352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8119c8826f3b448b97c68624dc1deab3', 'request_id': 'req-2d00e95a-0658-4339-a04f-11195480c3cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.170820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:55.171474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.171749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.172017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.172663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:55.174429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:55.186230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1104/2192] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:55.190166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.201181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203404-926b-4b59-9245-cdc460451f9f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:55.206278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:55.207441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.207441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.207709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] PATH_INFO: `/v3/projects/b90a3225f0bb4bb6a90847078c27720d/users/f33a2fe009b74c1285df84f614f38866/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.224549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90a3225f0bb4bb6a90847078c27720d, user_id=f33a2fe009b74c1285df84f614f38866, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:55.227283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122e18c-c254-48b0-977d-654b9436ca4f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:55.302128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8119c8826f3b448b97c68624dc1deab3', 'request_id': 'req-2d00e95a-0658-4339-a04f-11195480c3cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.314926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] The token cache is being invalidate because project 8119c8826f3b448b97c68624dc1deab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:55.315217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.315864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.317405 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1089/2193] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:54 2022] DELETE /identity/v3/projects/8119c8826f3b448b97c68624dc1deab3 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:55.321366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.322749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:55.336200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00e95a-0658-4339-a04f-11195480c3cc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:55.341069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:55.341823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.342198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.342568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] PATH_INFO: `/v3/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.343807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e67ce6a3ec44bed8ce8d0e8cb4b04db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:55.345879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:55.387320 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1105/2194] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:55 2022] PUT /identity/v3/projects/b90a3225f0bb4bb6a90847078c27720d/users/f33a2fe009b74c1285df84f614f38866/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:55.398442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.399023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.399331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.452351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] MFA Rules not processed for user `f33a2fe009b74c1285df84f614f38866`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:55.455090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:55.605404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e67ce6a3ec44bed8ce8d0e8cb4b04db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.608757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e67ce6a3ec44bed8ce8d0e8cb4b04db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.617236 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1106/2195] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:55.618456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e67ce6a3ec44bed8ce8d0e8cb4b04db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.619404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e67ce6a3ec44bed8ce8d0e8cb4b04db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.622005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.624358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:55.702617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352841d-d0cc-46f0-9ab9-633a675657a5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:55.707816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:55.708417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:55.708694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:55.708961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:55.709635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:55.711677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:55.713034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e67ce6a3ec44bed8ce8d0e8cb4b04db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:55.746446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1090/2196] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:15:55 2022] DELETE /identity/v3/users/5e67ce6a3ec44bed8ce8d0e8cb4b04db => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:55.808042 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1107/2197] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:55 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:55.812582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:55.815867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:55.965505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5c61-b521-4c01-890d-ca495a9a8eee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.035429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.035765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.036003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.036238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.037658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.039924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.168781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1091/2198] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:55 2022] POST /identity/v3/users => generated 295 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:56.170564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.181547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28222-8e91-4fd7-b268-dfd879693760 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.187978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.189250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.189250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.189250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.194446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.194446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.204218 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1108/2199] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:56.208466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.221167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bde69-57c3-419b-adb0-867012710fd3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.228886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.230168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.231002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.231398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] PATH_INFO: `/v3/projects/c10bd75c265f49afb096a2b57616b71e/users/6c16b1b22abf4792b39630ed7caeaaf0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.253089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10bd75c265f49afb096a2b57616b71e, user_id=6c16b1b22abf4792b39630ed7caeaaf0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.257212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.380035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.384288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.384430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1092/2200] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:56 2022] PUT /identity/v3/projects/c10bd75c265f49afb096a2b57616b71e/users/6c16b1b22abf4792b39630ed7caeaaf0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:56.401781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc0fc-6137-4ef7-ae82-6f94ba007c52 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.408092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.478671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.479693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.480176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.480655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] PATH_INFO: `/v3/projects/75d0398135b946aba85659670dfff2eb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.482770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d0398135b946aba85659670dfff2eb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.484866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.501297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd8e0e-37ab-476b-967c-161aaaa87292 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.501573 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:56.506266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.506796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.507066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.507333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.508241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.509966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.520840 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1093/2201] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:56.524941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.536590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4e9e-35a7-46aa-a8a5-3f70a17c86e1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.539187 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:56.543494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.544267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.544621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.545005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] PATH_INFO: `/v3/projects/c10bd75c265f49afb096a2b57616b71e/users/6c16b1b22abf4792b39630ed7caeaaf0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.547765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c10bd75c265f49afb096a2b57616b71e, user_id=6c16b1b22abf4792b39630ed7caeaaf0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.550543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8babd19-af3d-46de-b560-197db70960dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.562196 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1094/2202] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:56 2022] PUT /identity/v3/projects/c10bd75c265f49afb096a2b57616b71e/users/6c16b1b22abf4792b39630ed7caeaaf0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:56.583890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f225c2-1e61-4f43-a12f-e366f5a85b9d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.583890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f225c2-1e61-4f43-a12f-e366f5a85b9d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.583890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f225c2-1e61-4f43-a12f-e366f5a85b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.609698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-45f225c2-1e61-4f43-a12f-e366f5a85b9d None None] MFA Rules not processed for user `6c16b1b22abf4792b39630ed7caeaaf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:56.610725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-45f225c2-1e61-4f43-a12f-e366f5a85b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.633624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d0398135b946aba85659670dfff2eb', 'request_id': 'req-5db306ca-79bc-48e7-8eae-26be80cfde34'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:56.696257 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1095/2203] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:56.698109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.698522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.698898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.719039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] MFA Rules not processed for user `f33a2fe009b74c1285df84f614f38866`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:56.720236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.724149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d0398135b946aba85659670dfff2eb', 'request_id': 'req-5db306ca-79bc-48e7-8eae-26be80cfde34'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:56.731101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d0398135b946aba85659670dfff2eb', 'request_id': 'req-5db306ca-79bc-48e7-8eae-26be80cfde34'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:56.742996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] The token cache is being invalidate because project 75d0398135b946aba85659670dfff2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:15:56.743283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:56.744134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5db306ca-79bc-48e7-8eae-26be80cfde34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:15:56.749398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1109/2204] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:15:56 2022] DELETE /identity/v3/projects/75d0398135b946aba85659670dfff2eb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:56.750993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1924-17f1-4c42-9166-3bf8ca23f4cf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.755604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1924-17f1-4c42-9166-3bf8ca23f4cf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.755604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1924-17f1-4c42-9166-3bf8ca23f4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.771488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d2db1924-17f1-4c42-9166-3bf8ca23f4cf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:56.772793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2db1924-17f1-4c42-9166-3bf8ca23f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.787008 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1096/2205] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:56.797316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.798809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.851127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1110/2206] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:56.858628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.867300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.867300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.902230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:56.902230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.903328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07822161-134f-4d48-b673-8a04e51bbde8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.908220 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1111/2207] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:15:56.909177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.909845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.910680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.911118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.912976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:56.913108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.922634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c483861-2224-49f1-856d-fb3ebaf8f698 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.923962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.925675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.927554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.928181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.928457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.928722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.929428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:15:56.929730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.931303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:56.935759 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1097/2208] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:15:56.943877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1112/2209] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:15:56.948585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:56.960096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9b053-24bb-4caf-b63b-7423625c271d service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:56.965272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:56.966415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:56.966415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:56.966631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:56.967326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:56.969495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.090263 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:57.094760 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1098/2210] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:56 2022] POST /identity/v3/projects => generated 401 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:15:57.100427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.114184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66145fd4-0328-4401-97d4-cb85ffdb4628 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:57.203001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:57.203827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.204410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.204979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.205814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:57.209602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.328433 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1113/2211] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:57 2022] POST /identity/v3/users => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:57.329096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.344190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c415d-9919-4dd8-a938-b7e760b23c4a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:57.350873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:57.351556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.351927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.352604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.353324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:57.355247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.368819 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1099/2212] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:15:57.371928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.384872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4663ade-706c-4dc1-a8a8-2716a66facd1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:57.391078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:57.392061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.392507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.392938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.393804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:57.396804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.409520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1114/2213] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:57.413643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.428771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fa2b2-defe-4f69-bcbd-5972fdb0b2af admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:57.434165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:57.435650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.435650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.435650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] PATH_INFO: `/v3/projects/604c20224e5a4ab3b6acc7285d2eb69d/users/a39e5b4caf174e059b5a6b63cdf2f5d7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.453871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604c20224e5a4ab3b6acc7285d2eb69d, user_id=a39e5b4caf174e059b5a6b63cdf2f5d7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:57.456457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937df0-f0b2-41d1-8c55-6c18d1a9d067 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.544727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.593653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1100/2214] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:57 2022] PUT /identity/v3/projects/604c20224e5a4ab3b6acc7285d2eb69d/users/a39e5b4caf174e059b5a6b63cdf2f5d7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:15:57.593653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4729-dd5f-4c7f-b5d6-fc2ccf81633c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.593653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4729-dd5f-4c7f-b5d6-fc2ccf81633c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.593653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4729-dd5f-4c7f-b5d6-fc2ccf81633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.624258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fefa4729-dd5f-4c7f-b5d6-fc2ccf81633c None None] MFA Rules not processed for user `f33a2fe009b74c1285df84f614f38866`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:57.625493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fefa4729-dd5f-4c7f-b5d6-fc2ccf81633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:57.673205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a254c-d5ab-4509-81df-c562b5fe3da4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:57.720887 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1101/2215] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:57.728057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.731775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.732042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.796189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] MFA Rules not processed for user `a39e5b4caf174e059b5a6b63cdf2f5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:57.797899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:57.819477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:57.820215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:57.820570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:57.820912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:57.823169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:57.886912 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:57.908680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1102/2216] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:57.912914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:57.922675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:57.924493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:57.937876 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1115/2217] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:58.045638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e37f-e36b-4570-8174-4c42b8107ffd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.051986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.052640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.052927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.053192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.053992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.056124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.182786 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1103/2218] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:15:57 2022] POST /identity/v3/projects => generated 403 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:58.183630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:58.198173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c6a58-9666-4fd5-98ac-237ab3166430 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.281380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.282093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.282371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.282712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.283490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.286052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.377114 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1116/2219] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:15:58 2022] POST /identity/v3/users => generated 308 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:15:58.383078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:58.399253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2889-cb6e-434a-847e-08d04e325092 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.405181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.405181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.405509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.405847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.406558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.408568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.433067 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1104/2220] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:58.433215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:58.450958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524cb9-dadb-494d-b73d-62ee6ca3da01 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.471733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.473887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.474192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.474470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] PATH_INFO: `/v3/projects/809924b4f9694e9c937d5220397454e5/users/8a03d244579c4ed9b4d0a10079edd840/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.508149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809924b4f9694e9c937d5220397454e5, user_id=8a03d244579c4ed9b4d0a10079edd840, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.514509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.621946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1117/2221] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:58 2022] PUT /identity/v3/projects/809924b4f9694e9c937d5220397454e5/users/8a03d244579c4ed9b4d0a10079edd840/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:58.625614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:58.637174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2f3b-e08b-442e-8e9e-527cf8f2e57c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.717791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.717791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.717791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.717791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.718153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.718153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f21a6-466f-4eae-93f2-2352698ec328 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.718903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1105/2222] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:15:58.723513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:58.740487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214969c4-3d70-4753-8f17-0a867a985ac6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:58.756464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:58.757660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.772385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.772385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] PATH_INFO: `/v3/projects/809924b4f9694e9c937d5220397454e5/users/8a03d244579c4ed9b4d0a10079edd840/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.772385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809924b4f9694e9c937d5220397454e5, user_id=8a03d244579c4ed9b4d0a10079edd840, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:58.772385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2740b8-de52-4c8a-9e58-9278753e8021 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:58.775720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1118/2223] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:15:58 2022] PUT /identity/v3/projects/809924b4f9694e9c937d5220397454e5/users/8a03d244579c4ed9b4d0a10079edd840/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:15:58.787623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.787999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.788191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.817630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] MFA Rules not processed for user `8a03d244579c4ed9b4d0a10079edd840`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:58.818845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:58.925932 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1106/2224] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:58.926840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:58.926840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:58.926840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:58.954513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:15:58.956291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:59.025449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1119/2225] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:15:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:15:59.190154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:15:59.191839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:15:59.277947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691618b-07b5-4b9f-90f6-a57bfb22b0ec None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:15:59.285915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:15:59.286626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:15:59.286976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:15:59.287318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:15:59.299847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:15:59.300850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:15:59.313145 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1107/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:15:59.437845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:15:59.540766 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:01.506467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:01.520642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af658b51-3484-4ebe-8f48-242d34bed041 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:01.526266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:01.526923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:01.527290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:01.527622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:01.593280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:01.598931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a1a74-f5d5-44da-8aab-265492ecb92f service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:01.606457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1120/2227] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:01.641105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:01.709847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badc13f-6457-4efe-90ed-c685519f8319 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:01.714589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:01.715285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:01.715706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:01.715981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] PATH_INFO: `/v3/users/a39e5b4caf174e059b5a6b63cdf2f5d7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:01.717105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39e5b4caf174e059b5a6b63cdf2f5d7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:01.719082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:01.974290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39e5b4caf174e059b5a6b63cdf2f5d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:01.974290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39e5b4caf174e059b5a6b63cdf2f5d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:01.980893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39e5b4caf174e059b5a6b63cdf2f5d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:01.981802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39e5b4caf174e059b5a6b63cdf2f5d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:02.061668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39e5b4caf174e059b5a6b63cdf2f5d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:02.087330 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1108/2228] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:01 2022] DELETE /identity/v3/users/a39e5b4caf174e059b5a6b63cdf2f5d7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:16:02.094512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:02.099690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:02.099690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:02.123955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:02.125448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:02.204042 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1121/2229] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:02.224878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:02.228180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:02.310448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef5b0-a564-446e-9640-9e477760fe3f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:02.337919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:02.337919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:02.337919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:02.337919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:02.381221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:02.382345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60bedc-29c5-4c55-b9c4-51225442daec service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:02.398549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1109/2230] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:16:03.267655 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:03.313093 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:03.640339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:03.641759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:03.655446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a6df-9604-4211-8069-52b9d2311a6d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:03.662594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:03.663489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:03.664033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:03.664366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] PATH_INFO: `/v3/projects/604c20224e5a4ab3b6acc7285d2eb69d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:03.667429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] RBAC: Authorizing `identity:delete_project(project_id=604c20224e5a4ab3b6acc7285d2eb69d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:03.672979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:03.837361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604c20224e5a4ab3b6acc7285d2eb69d', 'request_id': 'req-9776c194-35ef-4f4a-8093-8a7c5a46454a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:03.919047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604c20224e5a4ab3b6acc7285d2eb69d', 'request_id': 'req-9776c194-35ef-4f4a-8093-8a7c5a46454a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:03.927434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604c20224e5a4ab3b6acc7285d2eb69d', 'request_id': 'req-9776c194-35ef-4f4a-8093-8a7c5a46454a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:03.944433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] The token cache is being invalidate because project 604c20224e5a4ab3b6acc7285d2eb69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:03.944731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:03.947049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:03.962729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:03.968635 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1122/2231] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:03 2022] DELETE /identity/v3/projects/604c20224e5a4ab3b6acc7285d2eb69d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:16:03.968775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:03.968775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:03.971559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:03.974859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:03.989174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] MFA Rules not processed for user `2096bbb8aff742b1837931e52ac1c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:03.990992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:04.138708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1110/2232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:04.165861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776c194-35ef-4f4a-8093-8a7c5a46454a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:04.174609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:04.175264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:04.175549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:04.175902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] PATH_INFO: `/v3/users/8a03d244579c4ed9b4d0a10079edd840` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:04.177266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a03d244579c4ed9b4d0a10079edd840)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:04.192106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:04.227836 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:04.447626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a03d244579c4ed9b4d0a10079edd840'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:04.610501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a03d244579c4ed9b4d0a10079edd840'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:04.611463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a03d244579c4ed9b4d0a10079edd840'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:04.635396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a03d244579c4ed9b4d0a10079edd840'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:04.649782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-89e1c7d0-b2a6-4cb8-8eaf-7d142e584ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a03d244579c4ed9b4d0a10079edd840'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:04.659590 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1123/2233] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:03 2022] DELETE /identity/v3/users/8a03d244579c4ed9b4d0a10079edd840 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:16:05.781308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:05.804192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77257b0-fb40-4322-98ec-0de4601da4b5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:05.889023 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:05.894060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:05.897839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:05.897839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:05.897839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] PATH_INFO: `/v3/projects/809924b4f9694e9c937d5220397454e5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:05.897839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=809924b4f9694e9c937d5220397454e5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:05.899881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:06.085727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809924b4f9694e9c937d5220397454e5', 'request_id': 'req-feac101c-94ed-4260-8389-52ecfa5f7fad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:06.093258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809924b4f9694e9c937d5220397454e5', 'request_id': 'req-feac101c-94ed-4260-8389-52ecfa5f7fad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:06.171096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809924b4f9694e9c937d5220397454e5', 'request_id': 'req-feac101c-94ed-4260-8389-52ecfa5f7fad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:06.206800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] The token cache is being invalidate because project 809924b4f9694e9c937d5220397454e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:06.208176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:06.210209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-feac101c-94ed-4260-8389-52ecfa5f7fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:06.214562 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1111/2234] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:05 2022] DELETE /identity/v3/projects/809924b4f9694e9c937d5220397454e5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:06.219434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60804068-d992-4d7a-812a-3631c142a8de None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.219716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60804068-d992-4d7a-812a-3631c142a8de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.219988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60804068-d992-4d7a-812a-3631c142a8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.246812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-60804068-d992-4d7a-812a-3631c142a8de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:06.248014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-60804068-d992-4d7a-812a-3631c142a8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:06.321640 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1124/2235] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:06.329801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.330604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.334509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.356274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:06.358036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:06.388956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1112/2236] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:06.391058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60804068-d992-4d7a-812a-3631c142a8de None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:06.403907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60804068-d992-4d7a-812a-3631c142a8de None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:06.410976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:06.412117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.412665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.413188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.414863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:16:06.415610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:06.418926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:06.438462 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1125/2237] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:16:06.443554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:06.455340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075946c-f136-4b20-9ce6-f3a65b4b7fb2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:06.473583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:06.474371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.474651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.474933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.475569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:06.477549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:06.663598 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1113/2238] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:16:06 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:06.665519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:06.680671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9090ac-4449-4ff9-8bf1-2ed6b354bfd9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:06.810895 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:06.819397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:06.819397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.819397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.819397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.819733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:06.819733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:06.943352 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1126/2239] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:16:06 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:06.948029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:06.959680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1ffda-8287-4877-b56b-8b928bc18444 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:06.964577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:06.965190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:06.965525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:06.965797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:06.966442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:06.968111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:06.979686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1114/2240] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:06.986936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:07.006824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dda7-e4e1-43ba-a39a-23d8ad3e251d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:07.012106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:07.013481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:07.013831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:07.014244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:07.014973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:07.017540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d6258-3f0e-4e14-8ac8-4549ce41da15 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:07.033031 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1127/2241] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:07.037807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:07.053321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e525dc-d204-4fd3-93ef-7d8cac2c7dc3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:07.058507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:07.059140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:07.065806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:07.065806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] PATH_INFO: `/v3/projects/d4681ed2d06840f995b37e550323d6ad/users/ec7269dc6d56440ca8691179f7275aeb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:07.080911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4681ed2d06840f995b37e550323d6ad, user_id=ec7269dc6d56440ca8691179f7275aeb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:07.084962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:07.193349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1115/2242] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:07 2022] PUT /identity/v3/projects/d4681ed2d06840f995b37e550323d6ad/users/ec7269dc6d56440ca8691179f7275aeb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:07.199045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:07.199242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:07.199511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:07.219830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:07.221062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:07.281713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1128/2243] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:07.292415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:07.295141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:07.353257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fa1ed-3f0b-46df-aa14-7dd5e7a36fdc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:07.356953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:07.357585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:07.357865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:07.358136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:07.367847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:07.369312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42f589-09ac-4f75-afdb-c580b357e80d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:07.378695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1116/2244] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:08.062258 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:08.362234 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:08.788479 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:09.195839 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:09.793096 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:10.500519 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:10.707739 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:11.273350 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:12.719612 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:12.797932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:12.800630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:12.827282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9aaa27-8407-45cc-9b6e-9c2a3d5dbd70 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:12.834746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:12.836232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:12.836688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:12.837270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] PATH_INFO: `/v3/users/9e6512cfbbbf412cbc4c40b80669b637` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:12.838753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6512cfbbbf412cbc4c40b80669b637)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:12.840890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:13.045251 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:13.098579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6512cfbbbf412cbc4c40b80669b637'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:13.176524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6512cfbbbf412cbc4c40b80669b637'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:13.179506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6512cfbbbf412cbc4c40b80669b637'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:13.204734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6512cfbbbf412cbc4c40b80669b637'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:13.221085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6512cfbbbf412cbc4c40b80669b637'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:13.241979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1129/2245] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:12 2022] DELETE /identity/v3/users/9e6512cfbbbf412cbc4c40b80669b637 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:13.246691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:13.246810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:13.247039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:13.280842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:13.283304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:13.407847 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1117/2246] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:13.476194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:13.478279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:13.633044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca470a7b-f208-40f9-99b5-d07bee1d75c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:13.638132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:13.639938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:13.640304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:13.640708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:13.655012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:13.656790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:13.669898 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1130/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:14.217287 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:14.660851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:14.662559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:14.678096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69101a-3f25-41a4-8042-568b6e2a1634 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:14.683951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:14.684933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:14.685649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:14.686122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] PATH_INFO: `/v3/projects/c653b9bf1e064528b2ffe8c9b57fa48d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:14.687523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c653b9bf1e064528b2ffe8c9b57fa48d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:14.689892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:14.819867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'request_id': 'req-d25aea4c-2572-46c5-8eb8-8cae7685358e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:14.827555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'request_id': 'req-d25aea4c-2572-46c5-8eb8-8cae7685358e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:14.839748 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:14.925002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c653b9bf1e064528b2ffe8c9b57fa48d', 'request_id': 'req-d25aea4c-2572-46c5-8eb8-8cae7685358e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:14.940132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] The token cache is being invalidate because project c653b9bf1e064528b2ffe8c9b57fa48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:14.940721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:14.942204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:14.946900 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1118/2248] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:14 2022] DELETE /identity/v3/projects/c653b9bf1e064528b2ffe8c9b57fa48d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:14.953497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:14.965439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cd6e4-b3b0-42f5-b5df-85e884ded40a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:15.006920 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:15.045292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:15.045893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:15.046173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:15.046523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] PATH_INFO: `/v3/users/cc3fb2fd50514064993b0acf4101cd1a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:15.047683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3fb2fd50514064993b0acf4101cd1a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:15.049654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:15.239222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3fb2fd50514064993b0acf4101cd1a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:15.330495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3fb2fd50514064993b0acf4101cd1a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:15.331132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3fb2fd50514064993b0acf4101cd1a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:15.352492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3fb2fd50514064993b0acf4101cd1a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:15.370403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52a05807-94d2-4802-b69f-e30e0e28e0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3fb2fd50514064993b0acf4101cd1a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:15.386541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1131/2249] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:14 2022] DELETE /identity/v3/users/cc3fb2fd50514064993b0acf4101cd1a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:15.496823 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:17.046994 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:17.340797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:17.342297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:17.369282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aea4c-2572-46c5-8eb8-8cae7685358e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:17.505602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:17.506460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:17.512709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:17.512709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] PATH_INFO: `/v3/projects/b706ee7f68734f6f981f76b490b719e1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:17.512709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b706ee7f68734f6f981f76b490b719e1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:17.512709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:17.662226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b706ee7f68734f6f981f76b490b719e1', 'request_id': 'req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:17.681640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b706ee7f68734f6f981f76b490b719e1', 'request_id': 'req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:17.759804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b706ee7f68734f6f981f76b490b719e1', 'request_id': 'req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:17.779725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] The token cache is being invalidate because project b706ee7f68734f6f981f76b490b719e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:17.780648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:17.782234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-342987f0-c1b3-4cf0-b8a1-f6bc371cadf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:17.791089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:17.791687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:17.791687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:17.792483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1119/2250] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:17 2022] DELETE /identity/v3/projects/b706ee7f68734f6f981f76b490b719e1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:17.830507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:17.832774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:18.020450 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1132/2251] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:18.025086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.025434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.025719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.053261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:18.063585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:18.092651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1120/2252] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:16:18.093755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.109992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86a96d-43df-4f4f-bcba-9bd4d51dcd9f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.113275 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:18.133576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.134547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.135016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.135475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.136339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:16:18.138839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.143053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.187459 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1133/2253] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:16:18.191169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.204211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cec28-1759-4c61-8e2a-bc7e1e37fc8e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.231203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.231829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.232106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.232377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.247983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.252385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.398595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1121/2254] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:16:18 2022] POST /identity/v3/projects => generated 397 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:18.399008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.418359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0cfdd-1d76-4141-9d78-c7d2d161a5b2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.567238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.568154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.568594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.569023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.570102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.572280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.706095 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1134/2255] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:16:18 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:18.709956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.731807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb39436-b217-4bfa-9611-f78c113fa0ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.738942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.739885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.740351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.741436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.742463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.744525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.759533 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1122/2256] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:18.766736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.780938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5e301-cfa7-461b-8ae4-011ac19863b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.787469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.788066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.788353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.788625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.789283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.790989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5746e-eca3-4133-9c66-eafdd375962f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.808703 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1135/2257] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:18.816487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:18.843922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ca5b-f04b-4c18-8bca-5ab32f997fd6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:18.850234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:18.850915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.851277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.851624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] PATH_INFO: `/v3/projects/10e2bdadb00745888a171041c5714bd9/users/71f11109f32d4013aed5ab9320d8295b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:18.885936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e2bdadb00745888a171041c5714bd9, user_id=71f11109f32d4013aed5ab9320d8295b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:18.889722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:18.977616 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1123/2258] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:18 2022] PUT /identity/v3/projects/10e2bdadb00745888a171041c5714bd9/users/71f11109f32d4013aed5ab9320d8295b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:18.982900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d63eb-4365-4ec3-a3ab-e5b6eead06d7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:18.983401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d63eb-4365-4ec3-a3ab-e5b6eead06d7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:18.983833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d63eb-4365-4ec3-a3ab-e5b6eead06d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:19.057431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6c1d63eb-4365-4ec3-a3ab-e5b6eead06d7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:19.062270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c1d63eb-4365-4ec3-a3ab-e5b6eead06d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:19.210763 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1136/2259] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:19.230541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:19.235551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:19.360418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35701-32ba-40ea-be80-d4b2fe4329b3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:19.374972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:19.375613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:19.375892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:19.376489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:19.411622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:19.414017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:19.433550 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1124/2260] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:19.782407 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:19.983596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:19.984155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:19.984155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:20.062376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] MFA Rules not processed for user `ec7269dc6d56440ca8691179f7275aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:20.065210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:20.283648 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1137/2261] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:20.284839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:20.286919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:20.309155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9100dd9-e0fc-4261-a468-e9e9fc8a35fd service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:20.320467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:20.321496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:20.321984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:20.322491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:20.323353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:20.326123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:20.431141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1125/2262] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:16:20 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:20.436910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:20.459599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277ec88-9d52-4272-a1de-b0c9d197bd21 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:20.580587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:20.581212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:20.584561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:20.584876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:20.585604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:20.587765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:20.725972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1138/2263] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:16:20 2022] POST /identity/v3/users => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:20.726963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:20.742872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352146eb-7a2f-4e20-953f-3db84424047d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:20.754463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:20.759883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:20.759883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:20.759883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:20.761017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:20.762853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:20.776980 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:20.793481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1126/2264] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:20.799451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:20.811779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb271-a159-4d0a-ac30-23ff8da8d6a4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:20.830849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:20.832202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:20.832569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:20.832851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] PATH_INFO: `/v3/projects/2556fe0c4670451aade5425cf399f4d0/users/5b99e0cac1eb48818c5b58a0c9cd8d63/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:20.855257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2556fe0c4670451aade5425cf399f4d0, user_id=5b99e0cac1eb48818c5b58a0c9cd8d63, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:20.860990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:21.003728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:21.004102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1139/2265] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:20 2022] PUT /identity/v3/projects/2556fe0c4670451aade5425cf399f4d0/users/5b99e0cac1eb48818c5b58a0c9cd8d63/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:21.016679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce77127-2d5b-4914-9a98-a1d087c91717 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:21.094623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:21.095235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:21.095518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:21.095793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:21.096438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:21.098666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c83df-6f0d-4102-ba74-a0501a50ec66 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:21.122265 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1127/2266] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:16:21.126377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:21.148206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81387bb-75c5-4ce5-bd6f-67e9dc160039 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:21.163128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:21.163927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:21.164871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:21.164871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] PATH_INFO: `/v3/projects/2556fe0c4670451aade5425cf399f4d0/users/5b99e0cac1eb48818c5b58a0c9cd8d63/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:21.167899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2556fe0c4670451aade5425cf399f4d0, user_id=5b99e0cac1eb48818c5b58a0c9cd8d63, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:21.176788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:21.206918 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1140/2267] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:21 2022] PUT /identity/v3/projects/2556fe0c4670451aade5425cf399f4d0/users/5b99e0cac1eb48818c5b58a0c9cd8d63/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:21.953964 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:22.096728 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:23.898333 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:24.181904 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:24.590326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61364-af29-4baf-9d17-a8f284f408d9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:24.592006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61364-af29-4baf-9d17-a8f284f408d9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:24.592526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd61364-af29-4baf-9d17-a8f284f408d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:24.624293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5fd61364-af29-4baf-9d17-a8f284f408d9 None None] MFA Rules not processed for user `f33a2fe009b74c1285df84f614f38866`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:24.633964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5fd61364-af29-4baf-9d17-a8f284f408d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:24.817729 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1128/2268] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:25.484769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:25.484769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:25.622025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db94d76-4b13-4055-9739-99a0dd3774d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:25.631269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:25.632174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:25.632813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:25.633291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:25.635427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:25.658009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:25.660823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3aa38-cb09-494f-9770-154314abdf9b service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:25.687168 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1141/2269] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:26.416728 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:26.702454 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:28.531659 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:28.920281 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:30.119848 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:30.496354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99bff3-24f7-420b-b560-2f267ced3e04 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:30.496826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99bff3-24f7-420b-b560-2f267ced3e04 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:30.496915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99bff3-24f7-420b-b560-2f267ced3e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:30.550520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f99bff3-24f7-420b-b560-2f267ced3e04 None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:30.554321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f99bff3-24f7-420b-b560-2f267ced3e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:30.702729 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1129/2270] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:30.747280 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:30.977101 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:31.193133 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:32.325822 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:32.486376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a744e6-26da-4b90-8938-7112f5a6ba21 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:32.486376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a744e6-26da-4b90-8938-7112f5a6ba21 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:32.486376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a744e6-26da-4b90-8938-7112f5a6ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:32.507921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-09a744e6-26da-4b90-8938-7112f5a6ba21 None None] MFA Rules not processed for user `4f1fe6e04e064dfba969b07d4188ab38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:32.509482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-09a744e6-26da-4b90-8938-7112f5a6ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:32.565597 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:32.633481 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1142/2271] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:33.046936 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:33.262760 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:33.842185 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:34.174569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:34.174822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:34.175094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:34.258611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] MFA Rules not processed for user `71f11109f32d4013aed5ab9320d8295b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:34.260389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:34.456557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1130/2272] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:34.553794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae096ee-279e-49fa-8b87-1c40a9012680 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:34.553794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae096ee-279e-49fa-8b87-1c40a9012680 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:34.553794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae096ee-279e-49fa-8b87-1c40a9012680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:34.575441 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:34.599532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9ae096ee-279e-49fa-8b87-1c40a9012680 None None] MFA Rules not processed for user `71f11109f32d4013aed5ab9320d8295b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:34.601034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ae096ee-279e-49fa-8b87-1c40a9012680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:34.623543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1143/2273] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:34.634561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:34.636128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:34.887301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ea77d-76f9-4f65-91b1-6561ddbecd1d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:34.917925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:34.919913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:34.920296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:34.920750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:34.941534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:34.944113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0ed90-a620-4c4b-81b7-eee4eca82bad service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:34.965914 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1131/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:35.087184 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:35.643114 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:36.307962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0385df-c3fb-402a-a4ae-59b7663c59f7 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:36.308490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0385df-c3fb-402a-a4ae-59b7663c59f7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:36.308960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0385df-c3fb-402a-a4ae-59b7663c59f7 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:36.310596 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1144/2275] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:16:36.350369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c156a-a0c3-4741-a91d-5cd8713b11b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:36.351274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c156a-a0c3-4741-a91d-5cd8713b11b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:36.351748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c156a-a0c3-4741-a91d-5cd8713b11b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:36.397477 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:36.450080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0385df-c3fb-402a-a4ae-59b7663c59f7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:36.473576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0385df-c3fb-402a-a4ae-59b7663c59f7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:36.477439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c67c156a-a0c3-4741-a91d-5cd8713b11b9 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:36.479109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c67c156a-a0c3-4741-a91d-5cd8713b11b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:36.479608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:36.483236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:36.483792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:36.484473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:36.486732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:36.504842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:36.507621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:36.520590 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1132/2276] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:36.521809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:36.522079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:36.522354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:36.540826 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1145/2277] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:16:36.601013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] MFA Rules not processed for user `5b99e0cac1eb48818c5b58a0c9cd8d63`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:36.602278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:36.616613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:36.618823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:36.639293 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:36.656618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251d7f4-ebf1-4d9d-8b17-7353a5d9751f service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:36.715471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:36.716524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:36.717616 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1133/2278] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:36.717791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:36.717999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:36.757705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:36.764782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f38eca-3237-4a38-a665-b5593c2d912d service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:36.789647 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1146/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:16:37.435198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:37.458431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8be68-dd55-45d3-87b0-1db512fc9067 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:37.468030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa4141-ee46-4981-820d-746753503134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:37.468940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4141-ee46-4981-820d-746753503134 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:37.469443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4141-ee46-4981-820d-746753503134 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:37.469891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa4141-ee46-4981-820d-746753503134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:37.701258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4141-ee46-4981-820d-746753503134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:37.711962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa4141-ee46-4981-820d-746753503134 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:37.744913 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1134/2280] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:38.726035 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:39.292610 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:41.336672 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:41.731642 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:42.604445 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:43.507214 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:44.828987 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:45.086987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0506-d180-4ce7-9e5c-6fba872577a2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:45.087645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0506-d180-4ce7-9e5c-6fba872577a2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:45.088153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0506-d180-4ce7-9e5c-6fba872577a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:45.158303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-076a0506-d180-4ce7-9e5c-6fba872577a2 None None] MFA Rules not processed for user `ec7269dc6d56440ca8691179f7275aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:45.161798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-076a0506-d180-4ce7-9e5c-6fba872577a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:45.174494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1147/2281] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:45.475261 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:49.541985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e048c14-4429-4faa-9d70-66abbb7302d1 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:49.541985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e048c14-4429-4faa-9d70-66abbb7302d1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:49.541985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e048c14-4429-4faa-9d70-66abbb7302d1 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:49.543060 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1135/2282] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:16:49.636071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:49.636647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:49.636647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:49.694597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:49.696066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:49.713732 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1148/2283] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:16:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:49.747052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e048c14-4429-4faa-9d70-66abbb7302d1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:49.785168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e048c14-4429-4faa-9d70-66abbb7302d1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:49.800542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:49.802001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:49.802473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:49.803080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:49.816890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:49.822246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:49.850504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1136/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:49.921360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:49.922992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:50.068810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cedd1b-2dac-4194-b6de-8a932f2b9475 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:50.091903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:50.092678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:50.093623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:50.095530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] PATH_INFO: `/v3/users/056e59c7d4c2475eb66b64e0e24367be` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:50.101204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056e59c7d4c2475eb66b64e0e24367be)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:50.107911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:50.352354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056e59c7d4c2475eb66b64e0e24367be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:50.439900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056e59c7d4c2475eb66b64e0e24367be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:50.440513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056e59c7d4c2475eb66b64e0e24367be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:50.454632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056e59c7d4c2475eb66b64e0e24367be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:50.463463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056e59c7d4c2475eb66b64e0e24367be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:50.469946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1149/2285] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:49 2022] DELETE /identity/v3/users/056e59c7d4c2475eb66b64e0e24367be => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:50.756046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:50.783616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d285fc-436f-47ac-a92b-40f760521902 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:50.884211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:50.884926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:50.885226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:50.885518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] PATH_INFO: `/v3/projects/8e6f42c16eeb4e97b65cebf891105008` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:50.886743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6f42c16eeb4e97b65cebf891105008)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:50.888718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:50.902138 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:51.024167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6f42c16eeb4e97b65cebf891105008', 'request_id': 'req-f9e9870d-86de-40c7-b12c-66c549f9d649'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.038111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6f42c16eeb4e97b65cebf891105008', 'request_id': 'req-f9e9870d-86de-40c7-b12c-66c549f9d649'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.097904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6f42c16eeb4e97b65cebf891105008', 'request_id': 'req-f9e9870d-86de-40c7-b12c-66c549f9d649'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.106152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:51.107763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:51.122623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] The token cache is being invalidate because project 8e6f42c16eeb4e97b65cebf891105008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:51.124601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.125538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.130506 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1137/2286] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:50 2022] DELETE /identity/v3/projects/8e6f42c16eeb4e97b65cebf891105008 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:51.134045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:51.136806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:51.249858 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:51.254999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9870d-86de-40c7-b12c-66c549f9d649 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:51.260574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189adf39-1454-49ff-89f9-c47cc6623c79 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:51.261443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:51.262092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:51.262574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:51.263024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] PATH_INFO: `/v3/users/1ff2e0be0f334ff4acb88d338e278d2b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:51.264686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff2e0be0f334ff4acb88d338e278d2b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:51.267216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:51.400056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:51.402185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:51.402849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:51.404139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:51.408630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:51.477289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff2e0be0f334ff4acb88d338e278d2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.479206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff2e0be0f334ff4acb88d338e278d2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.491405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff2e0be0f334ff4acb88d338e278d2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.493989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff2e0be0f334ff4acb88d338e278d2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.552985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:51.555173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:51.567977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1150/2287] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:51.575062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7e8bcf0-15e1-47d3-ac17-74206d5546ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff2e0be0f334ff4acb88d338e278d2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:51.662729 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1138/2288] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:16:51 2022] DELETE /identity/v3/users/1ff2e0be0f334ff4acb88d338e278d2b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:52.106676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:52.126034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bf429-14f5-475b-a893-da4056cc2cf9 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:52.269559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:52.270963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:52.271427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:52.271857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] PATH_INFO: `/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:52.274218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b74fc3bb2cd47f98eda0ecf030102d0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:52.276152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:52.448509 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:52.462636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b74fc3bb2cd47f98eda0ecf030102d0', 'request_id': 'req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:52.571335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b74fc3bb2cd47f98eda0ecf030102d0', 'request_id': 'req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:52.580241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b74fc3bb2cd47f98eda0ecf030102d0', 'request_id': 'req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:52.593805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] The token cache is being invalidate because project 0b74fc3bb2cd47f98eda0ecf030102d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:16:52.594275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:52.595330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d619e4ff-ba2a-4f36-9e51-519d90db4cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:16:52.599178 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1151/2289] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:16:52 2022] DELETE /identity/v3/projects/0b74fc3bb2cd47f98eda0ecf030102d0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:52.603961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:52.604468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:52.604656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:52.628069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:52.629537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:52.641468 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:52.716543 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1139/2290] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:52.724888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:52.726246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:52.726823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:52.751192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:52.752737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:52.762809 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1152/2291] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:52.767729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:52.781867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ae2bd-44cc-4d1b-a1da-a95c30d43d48 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:52.788609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:52.790456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:52.790613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:52.790855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:52.791537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:16:52.792695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:52.794493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:52.815154 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1140/2292] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:16:52.816363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:52.832007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01af6f3-075c-4c3e-a0d9-6bee130a8ee3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:52.841551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:52.842007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:52.842007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:52.842159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:52.842742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:52.845238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:52.985692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1153/2293] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:16:52 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:52.989885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:53.007602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286292d-ad0c-41c9-9c55-acd5688efd93 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:53.200897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:53.202415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:53.202868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:53.203319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:53.204244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:53.208818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:53.349785 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1141/2294] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:16:52 2022] POST /identity/v3/users => generated 295 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:16:53.354982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:53.371900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c0bc2-fb1f-4054-8c47-36bd19ada15c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:53.392733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:53.393397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:53.394224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:53.394488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:53.398530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:53.400631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:53.428994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1154/2295] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:53.433717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:53.454400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c4c7-fe2f-40a2-9c69-acfe3069f5b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:53.463721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:53.463721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:53.463721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:53.463721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:53.464469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:53.465801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f2df4-018c-431b-bcee-45561bd19911 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:53.486898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1142/2296] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:16:53.493043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:53.511684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852ba0-f79c-4334-bd7c-dca8c1fe3cd8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:53.526615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:53.530955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:53.533279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:53.534174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] PATH_INFO: `/v3/projects/feea74354a0b4753a363fc5d4f6d4f13/users/7d87ef57cf344734b662bd792022c4b7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:53.587245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=feea74354a0b4753a363fc5d4f6d4f13, user_id=7d87ef57cf344734b662bd792022c4b7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:53.590261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:53.689164 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1155/2297] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:53 2022] PUT /identity/v3/projects/feea74354a0b4753a363fc5d4f6d4f13/users/7d87ef57cf344734b662bd792022c4b7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:53.705785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:53.706694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:53.707136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:53.765413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] MFA Rules not processed for user `7d87ef57cf344734b662bd792022c4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:53.767172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:53.984520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1143/2298] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:53.991898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.119170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02871a23-48f6-4436-9d49-277b7a79e97f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.124828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.125495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.125777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.126052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.127468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.130349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:54.294423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1156/2299] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:16:53 2022] POST /identity/v3/projects => generated 389 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:54.298844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.310471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32249c-77d3-4c59-93f0-ba3f65afe14c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.321762 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:54.408271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.411020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.411612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.412114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.413596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.417880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:54.567277 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1144/2300] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:16:54 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:16:54.571092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.590531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131dff68-b9d8-4366-9505-b64f96dd670a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.607142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.607142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.607142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.607142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.607572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.607572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:54.619419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.619854 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1157/2301] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:54.633041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c175-3104-4dc4-a56e-fd108ce5b4fe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.647653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.648348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.648628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.648917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] PATH_INFO: `/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4/users/a9a4fcf39f794a9da355b7fc91fb794d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.684857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd96bedb8de40f8aead7aa7aaf993e4, user_id=a9a4fcf39f794a9da355b7fc91fb794d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.688461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:54.782508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1145/2302] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:54 2022] PUT /identity/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4/users/a9a4fcf39f794a9da355b7fc91fb794d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:54.786542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.799124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78317e0d-6ede-43f6-8e80-7e232dcc92e1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.876589 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:16:54.929157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.930079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.930359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.930629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.931283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.932962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8f9a0-224f-4f6d-8ba1-9b9e33f9a69d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:54.947698 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1158/2303] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:16:54.952374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:54.967160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c9c07-05d5-48ab-a51c-4612a8058812 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:54.974484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:54.975525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:54.975998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:54.976469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] PATH_INFO: `/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4/users/a9a4fcf39f794a9da355b7fc91fb794d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:54.982619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd96bedb8de40f8aead7aa7aaf993e4, user_id=a9a4fcf39f794a9da355b7fc91fb794d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:54.986501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7727750-e995-4f37-8d66-60d08da26448 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:55.015500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1146/2304] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:16:54 2022] PUT /identity/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4/users/a9a4fcf39f794a9da355b7fc91fb794d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:16:55.027864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:55.028376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:55.028823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:55.091426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] MFA Rules not processed for user `a9a4fcf39f794a9da355b7fc91fb794d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:55.092656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:55.271690 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1159/2305] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:55.283238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02568a3-868d-427c-8081-15d54af7680c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:55.283839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02568a3-868d-427c-8081-15d54af7680c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:55.289245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02568a3-868d-427c-8081-15d54af7680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:55.325805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e02568a3-868d-427c-8081-15d54af7680c None None] MFA Rules not processed for user `7d87ef57cf344734b662bd792022c4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:55.327030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e02568a3-868d-427c-8081-15d54af7680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:55.440451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1147/2306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:55.534339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:55.536662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:55.654817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c82c-1230-4af7-8d90-de16b101a399 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:55.664839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:55.665678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:55.666112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:55.666700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:55.684244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:55.686652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464143-3535-44d5-a224-5a4bc64950be service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:55.699285 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1160/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:16:58.917924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:58.917924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:58.917924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:58.918728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1148/2308] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 30 01:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:16:58.924930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43408-9166-4082-ae5a-128f1d7747d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:58.925574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43408-9166-4082-ae5a-128f1d7747d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:58.925681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e43408-9166-4082-ae5a-128f1d7747d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:58.948245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b3e43408-9166-4082-ae5a-128f1d7747d6 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:16:58.949592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3e43408-9166-4082-ae5a-128f1d7747d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:58.960313 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1161/2309] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 01:16:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:16:58.971523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:16:58.974467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:16:59.035361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe57e0-a959-4105-aff5-c84056c71be3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:16:59.039575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:16:59.040185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:16:59.040468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:16:59.040921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:16:59.052631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:16:59.054114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690420-6480-4dea-af88-2b266999f91d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:16:59.066894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1149/2310] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:17:03.175312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:03.177012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:03.177486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:03.198469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:17:03.200049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:17:03.241826 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.281365 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1162/2311] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:17:03.637235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55d427-66b8-4bd7-9e82-0402176f147b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:03.638192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55d427-66b8-4bd7-9e82-0402176f147b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:03.638479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55d427-66b8-4bd7-9e82-0402176f147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:03.664969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cb55d427-66b8-4bd7-9e82-0402176f147b None None] MFA Rules not processed for user `71f11109f32d4013aed5ab9320d8295b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:17:03.666652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cb55d427-66b8-4bd7-9e82-0402176f147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:17:03.672386 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:03.746639 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1150/2312] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:17:13.813733 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:14.257284 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=20 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:16.877952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:17:16.896257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee21d2-03da-4020-bbee-1458cb7a038c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:17:16.908799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:17:16.909855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:16.910210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:16.910558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:16.922490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:17:16.924574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c39fd-901c-4079-9488-834c88dcc097 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:17:16.939029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1163/2313] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:17:22.708673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3831-6dfa-4ae7-beb5-e8f087eba29d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:22.709607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3831-6dfa-4ae7-beb5-e8f087eba29d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:22.710086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e3831-6dfa-4ae7-beb5-e8f087eba29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:22.774847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-124e3831-6dfa-4ae7-beb5-e8f087eba29d None None] MFA Rules not processed for user `7d87ef57cf344734b662bd792022c4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:17:22.779312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-124e3831-6dfa-4ae7-beb5-e8f087eba29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:17:22.815135 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1151/2314] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:17:24.303409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:24.304015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:24.304015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:24.324564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:17:24.329704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:17:24.337516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1164/2315] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:17:32.756224 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:34.319169 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:17:50.595316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd6af-528f-448b-9873-b38ac92ae9cb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:17:50.596077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd6af-528f-448b-9873-b38ac92ae9cb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:17:50.600194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd6af-528f-448b-9873-b38ac92ae9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:17:50.662269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-399fd6af-528f-448b-9873-b38ac92ae9cb None None] MFA Rules not processed for user `c536d41a93ad4337909fe2e2cb949e03`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:17:50.664450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-399fd6af-528f-448b-9873-b38ac92ae9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:17:50.678175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1152/2316] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:00.655547 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:01.394776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:01.538177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298750d-7016-4429-a296-7cf59b8674c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:01.544138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:01.545322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:01.546022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:01.546557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] PATH_INFO: `/v3/users/7d87ef57cf344734b662bd792022c4b7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:01.550267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d87ef57cf344734b662bd792022c4b7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:01.553113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:01.848604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974a936-abf2-4ded-8419-0a0b08be81cb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:01.849609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974a936-abf2-4ded-8419-0a0b08be81cb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:01.850603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974a936-abf2-4ded-8419-0a0b08be81cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:01.868709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d87ef57cf344734b662bd792022c4b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:01.880407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8974a936-abf2-4ded-8419-0a0b08be81cb None None] MFA Rules not processed for user `c7334417689847d18bc4c1b27d173a23`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:01.882256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8974a936-abf2-4ded-8419-0a0b08be81cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:02.035449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d87ef57cf344734b662bd792022c4b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:02.035449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d87ef57cf344734b662bd792022c4b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:02.077548 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1153/2317] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:18:02.078964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d87ef57cf344734b662bd792022c4b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:02.095506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d87ef57cf344734b662bd792022c4b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:02.104400 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1165/2318] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:01 2022] DELETE /identity/v3/users/7d87ef57cf344734b662bd792022c4b7 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:02.109401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:02.110321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:02.110826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:02.155960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:02.159564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:02.332223 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1154/2319] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:02.373069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:02.375136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:02.534706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085214f4-1d02-4103-b7e1-ad54204886d7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:02.546054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:02.547019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:02.547986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:02.549815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:02.576605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:02.579703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:02.605676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1166/2320] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:03.283425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:03.285851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:03.320947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeba20-14b1-4fc3-aa76-8c8887b2c558 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:03.336568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:03.342910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:03.342910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:03.342910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] PATH_INFO: `/v3/projects/feea74354a0b4753a363fc5d4f6d4f13` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:03.342910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feea74354a0b4753a363fc5d4f6d4f13)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:03.346917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:03.535655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feea74354a0b4753a363fc5d4f6d4f13', 'request_id': 'req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:03.543366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feea74354a0b4753a363fc5d4f6d4f13', 'request_id': 'req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:03.619670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feea74354a0b4753a363fc5d4f6d4f13', 'request_id': 'req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:03.636197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] The token cache is being invalidate because project feea74354a0b4753a363fc5d4f6d4f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:03.639304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:03.640037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:03.642125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1155/2321] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:03 2022] DELETE /identity/v3/projects/feea74354a0b4753a363fc5d4f6d4f13 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:03.646070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:03.662707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6169b-b1d3-44d6-b865-d0087e9a492b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:03.691111 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:03.747258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:03.747956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:03.748316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:03.748622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] PATH_INFO: `/v3/users/a9a4fcf39f794a9da355b7fc91fb794d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:03.752031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a4fcf39f794a9da355b7fc91fb794d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:03.755107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:04.034059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a4fcf39f794a9da355b7fc91fb794d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:04.118747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a4fcf39f794a9da355b7fc91fb794d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:04.120153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a4fcf39f794a9da355b7fc91fb794d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:04.149161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a4fcf39f794a9da355b7fc91fb794d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:04.166991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9501b0-67b4-4d36-b58a-ac31726faa8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a4fcf39f794a9da355b7fc91fb794d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:04.209771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1167/2322] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:03 2022] DELETE /identity/v3/users/a9a4fcf39f794a9da355b7fc91fb794d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:05.206366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:05.208234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:05.248333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ccc9-90a2-4ac5-8247-8e2ca6d96b31 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:05.310826 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:05.433012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:05.438557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:05.438557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:05.438557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] PATH_INFO: `/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:05.438557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd96bedb8de40f8aead7aa7aaf993e4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:05.452330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:05.690334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd96bedb8de40f8aead7aa7aaf993e4', 'request_id': 'req-54005594-9a31-40e0-ae07-579986b7f00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:05.700235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd96bedb8de40f8aead7aa7aaf993e4', 'request_id': 'req-54005594-9a31-40e0-ae07-579986b7f00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:05.767169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd96bedb8de40f8aead7aa7aaf993e4', 'request_id': 'req-54005594-9a31-40e0-ae07-579986b7f00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:05.795956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] The token cache is being invalidate because project 2bd96bedb8de40f8aead7aa7aaf993e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:05.796256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:05.796930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54005594-9a31-40e0-ae07-579986b7f00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:05.799990 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1156/2323] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:05 2022] DELETE /identity/v3/projects/2bd96bedb8de40f8aead7aa7aaf993e4 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:05.810375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:05.811644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:05.812090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:05.843894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:05.864142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:06.052389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1168/2324] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:06.060879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:06.061193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:06.061499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:06.092342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:06.094066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:06.133154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:06.134927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1157/2325] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:06.154647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a30da-08f5-4031-aabe-6d5c12a28f07 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:06.166163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:06.168872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:06.168872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:06.168872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:06.168872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:06.168872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:06.174242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:06.204405 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1169/2326] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:18:06.209243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:06.216126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce997772-98b8-44f1-b01e-94a7cb046f1e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:06.236464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:06.236464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:06.236464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:06.236464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:06.236773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:06.237727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:06.243866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:06.245837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:06.270389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919abc03-3283-4169-b63d-7767093748ed admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:06.282869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:06.283520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:06.287832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:06.287832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] PATH_INFO: `/v3/users/71f11109f32d4013aed5ab9320d8295b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:06.287832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f11109f32d4013aed5ab9320d8295b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:06.287832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:06.329007 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:06.342184 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1158/2327] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:06 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:06.346279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:06.450627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062d578-b1ef-4e24-82bd-254ab9c1574d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:06.468211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f11109f32d4013aed5ab9320d8295b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:06.473871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:06.476805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:06.476805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:06.476805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:06.476805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:06.478603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:06.602129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f11109f32d4013aed5ab9320d8295b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:06.602850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f11109f32d4013aed5ab9320d8295b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:06.632560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f11109f32d4013aed5ab9320d8295b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:06.643521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f11109f32d4013aed5ab9320d8295b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:06.652428 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1170/2328] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:06 2022] DELETE /identity/v3/users/71f11109f32d4013aed5ab9320d8295b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:18:07.048077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1159/2329] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:06 2022] POST /identity/v3/users => generated 288 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:07.052439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.058795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.137103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.139162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.158898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beb504-40e4-44b8-95c4-ff852ad9a691 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.199255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd135d3-dc61-4bd0-b029-f27a10c518a8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.219042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.223871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.224452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.224771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.225050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.225731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.227334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.232788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.232788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.232788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] PATH_INFO: `/v3/projects/10e2bdadb00745888a171041c5714bd9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.234800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e2bdadb00745888a171041c5714bd9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.236999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.259476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1171/2330] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:07.261408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.269524 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:07.277058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091460b1-7e16-4439-b9ee-8308ebe4ef06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.283561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.284240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.284757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.285243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.295274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.295274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.298222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1172/2331] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:07.302001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.314311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20ec1-d1fb-4b2b-8d74-472c853e260e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.322868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.323548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.323828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.324096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] PATH_INFO: `/v3/projects/723592d445b2430b8c5c3bc8564d55b4/users/21b3a5a3b9374d9a9a17afabebd5ff71/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.351810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723592d445b2430b8c5c3bc8564d55b4, user_id=21b3a5a3b9374d9a9a17afabebd5ff71, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.352975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da6974-62ca-470e-a76b-795fd6cf73c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.416113 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1173/2332] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:07 2022] PUT /identity/v3/projects/723592d445b2430b8c5c3bc8564d55b4/users/21b3a5a3b9374d9a9a17afabebd5ff71/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:07.419442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164c73-ee75-477f-b96b-f11fa345ff42 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.420248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164c73-ee75-477f-b96b-f11fa345ff42 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.420753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164c73-ee75-477f-b96b-f11fa345ff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.430700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e2bdadb00745888a171041c5714bd9', 'request_id': 'req-fea53806-a608-45e2-b108-1b11c681d0c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:07.441083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e2bdadb00745888a171041c5714bd9', 'request_id': 'req-fea53806-a608-45e2-b108-1b11c681d0c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:07.466353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-94164c73-ee75-477f-b96b-f11fa345ff42 None None] MFA Rules not processed for user `4f1fe6e04e064dfba969b07d4188ab38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:07.466353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94164c73-ee75-477f-b96b-f11fa345ff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.541894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e2bdadb00745888a171041c5714bd9', 'request_id': 'req-fea53806-a608-45e2-b108-1b11c681d0c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:07.561971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] The token cache is being invalidate because project 10e2bdadb00745888a171041c5714bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:07.561971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:07.561971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fea53806-a608-45e2-b108-1b11c681d0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:07.561971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1160/2333] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:07 2022] DELETE /identity/v3/projects/10e2bdadb00745888a171041c5714bd9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:07.561971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.562394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.562394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.571649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1174/2334] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:07.573928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ba54-8183-41b3-bb97-9437622f83c5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.574272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ba54-8183-41b3-bb97-9437622f83c5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.574611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3ba54-8183-41b3-bb97-9437622f83c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.598198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] MFA Rules not processed for user `21b3a5a3b9374d9a9a17afabebd5ff71`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:07.599608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.617307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-70a3ba54-8183-41b3-bb97-9437622f83c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:07.618948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70a3ba54-8183-41b3-bb97-9437622f83c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.721863 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1161/2335] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:07.726868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.728623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.744498 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1175/2336] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:07.754268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.755560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.759029 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:07.765530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.808003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:07.810107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:07.822598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1176/2337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:07.825147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ce615-e106-4ab4-b287-c23fed562989 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.826939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.832513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.839648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37643881-81aa-4f8c-956f-8134f88427c9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.844060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.848196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.848196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.848196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.850167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.855658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.857842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.858314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.859716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.861110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:07.861685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.864057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.881857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1177/2338] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:18:07.884659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:07.899382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fad5-4d45-481f-a0ca-b1c067bda22e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:07.904338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:07.905529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:07.905529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:07.905834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:07.906551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:07.914724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:07.967915 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1162/2339] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:07.968980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.047323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1178/2340] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:08.051874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.070741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8c89f-3a03-4005-b906-6f66675e4902 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.214106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.215229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.215683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.216107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.217166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.223007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.243231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fd242-d090-4770-b6bb-da83f82410de admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.249984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.252015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.252483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.252933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.254481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.259867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.318131 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1163/2341] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:07 2022] POST /identity/v3/users => generated 294 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:08.326174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.334539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e4611-ee2c-45cf-b027-f871d96ffceb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.362888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.363519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.363836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.364117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.364778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.366459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.379651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1164/2342] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:08.383531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.396046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b65c4d-b7b2-413c-9cb7-fbd5fcdfecd1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.402537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.403646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.404160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.405166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] PATH_INFO: `/v3/projects/4179ab3f007f43708b81bb5a706480ae/users/a8e7dd1809cb4a18a75ee790a77092cb/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.421969 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1179/2343] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:08 2022] POST /identity/v3/users => generated 301 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:08.425959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.428385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179ab3f007f43708b81bb5a706480ae, user_id=a8e7dd1809cb4a18a75ee790a77092cb, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.431518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.442278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768f347-e3b9-4d23-ac89-322b3cedd943 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.450120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.459438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.459438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.459438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.459438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.459438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.479681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1180/2344] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:18:08.484914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.515209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1165/2345] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:08 2022] PUT /identity/v3/projects/4179ab3f007f43708b81bb5a706480ae/users/a8e7dd1809cb4a18a75ee790a77092cb/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:08.516373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.516975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96bc68-b95d-4cdf-9102-de08dadba661 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.627638 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:08.636463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bc69d-829f-4400-a7d7-bd1165a3130a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.643882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.644685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.645006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.645242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.646074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.648613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.663246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1166/2346] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:08.667046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.673807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.678287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.678287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.678287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.678972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.681359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.683034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2f2b-b408-480f-9e28-a893810549ae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.696398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1181/2347] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:08.701200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:08.705368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.708726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.708726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.712454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] PATH_INFO: `/v3/projects/4179ab3f007f43708b81bb5a706480ae/users/a8e7dd1809cb4a18a75ee790a77092cb/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.717944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4179ab3f007f43708b81bb5a706480ae, user_id=a8e7dd1809cb4a18a75ee790a77092cb, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.727528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e7fa-17f4-431e-b22a-32bf7612f11f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.736888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297297a2-137c-4f15-bd27-d8dee55b497c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:08.758741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:08.758741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.758741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.759087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] PATH_INFO: `/v3/projects/e70c0e4e43f849f393ca200c3d838e23/users/e9f264c3e1ff43e7926ee1200a9c4d09/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.761495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1167/2348] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:08 2022] PUT /identity/v3/projects/4179ab3f007f43708b81bb5a706480ae/users/a8e7dd1809cb4a18a75ee790a77092cb/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:08.773040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.774210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.774667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.785652 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:08.836914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70c0e4e43f849f393ca200c3d838e23, user_id=e9f264c3e1ff43e7926ee1200a9c4d09, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:08.839847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f26ac-2e18-48ea-9763-7d55252dd362 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:08.859551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] MFA Rules not processed for user `a8e7dd1809cb4a18a75ee790a77092cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:08.860935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:08.929087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1182/2349] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:08 2022] PUT /identity/v3/projects/e70c0e4e43f849f393ca200c3d838e23/users/e9f264c3e1ff43e7926ee1200a9c4d09/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:08.934531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:08.934820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:08.935097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:08.961278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:08.966897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:09.009801 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1168/2350] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:18:09.021936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:09.024065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:09.073062 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1183/2351] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:09.086752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:09.088836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:09.166781 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.216201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63072-b1e3-49ab-864a-0cecf40565c8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:09.228863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:09.229564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:09.229864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:09.230124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:09.252656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:09.257236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:09.278243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173014b0-96e9-481d-af52-e8cf0a6d57ac None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:09.283528 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1184/2352] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:18:09.378078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:09.379122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:09.380162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:09.380491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:09.420410 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.465861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:09.467476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:09.504689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1169/2353] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:09.620613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:09.637964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344953ae-a9e1-4417-977c-b1d9ae949ba8 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:09.641805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:09.642429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:09.642713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:09.642987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:09.748357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:09.751827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653380d5-9cec-4d79-8007-4b70ec074b45 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:09.756428 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:09.764059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1185/2354] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:10.661633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:10.676007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a58fbc-6781-4856-85c1-e894b8c93f0d service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:10.683204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:10.683945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:10.684459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:10.684802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] PATH_INFO: `/v3/users/21b3a5a3b9374d9a9a17afabebd5ff71` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:10.686081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b3a5a3b9374d9a9a17afabebd5ff71)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:10.688202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:10.984465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b3a5a3b9374d9a9a17afabebd5ff71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:10.988792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b3a5a3b9374d9a9a17afabebd5ff71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:11.014058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b3a5a3b9374d9a9a17afabebd5ff71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:11.015791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b3a5a3b9374d9a9a17afabebd5ff71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:11.122166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b3a5a3b9374d9a9a17afabebd5ff71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:11.156366 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1170/2355] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:10 2022] DELETE /identity/v3/users/21b3a5a3b9374d9a9a17afabebd5ff71 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:11.160923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:11.161963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:11.162487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:11.219120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:11.221631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:11.391082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1186/2356] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:11.423013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:11.425067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:11.579147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f50ae8-e1df-44df-9d2d-fa747c8b79ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:11.602576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:11.605055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:11.605359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:11.606551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:11.629898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:11.633798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:11.661186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1171/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:12.715122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:12.715122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:12.728797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f3468-45f7-48bd-8eb6-6eff685cdc41 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:12.737827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:12.737827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:12.737827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:12.737827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] PATH_INFO: `/v3/projects/723592d445b2430b8c5c3bc8564d55b4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:12.739076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=723592d445b2430b8c5c3bc8564d55b4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:12.741801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:12.925063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723592d445b2430b8c5c3bc8564d55b4', 'request_id': 'req-941e3868-91b2-40c1-8fcb-834cd03e70bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.085970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723592d445b2430b8c5c3bc8564d55b4', 'request_id': 'req-941e3868-91b2-40c1-8fcb-834cd03e70bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.095927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723592d445b2430b8c5c3bc8564d55b4', 'request_id': 'req-941e3868-91b2-40c1-8fcb-834cd03e70bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.122591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] The token cache is being invalidate because project 723592d445b2430b8c5c3bc8564d55b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:13.123389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.126768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.131773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1187/2358] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:12 2022] DELETE /identity/v3/projects/723592d445b2430b8c5c3bc8564d55b4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:13.136922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:13.163345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd803c-69d7-4d66-a608-c335d5b64d27 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:13.273467 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:13.312028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:13.313732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:13.314195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:13.315026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] PATH_INFO: `/v3/users/a8e7dd1809cb4a18a75ee790a77092cb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:13.316771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e7dd1809cb4a18a75ee790a77092cb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:13.321278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:13.561517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e7dd1809cb4a18a75ee790a77092cb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.562253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e7dd1809cb4a18a75ee790a77092cb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.576048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e7dd1809cb4a18a75ee790a77092cb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.576804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e7dd1809cb4a18a75ee790a77092cb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.645034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-671c6607-7998-4edb-88c4-f3dacc77c7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e7dd1809cb4a18a75ee790a77092cb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:13.686545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1172/2359] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:13 2022] DELETE /identity/v3/users/a8e7dd1809cb4a18a75ee790a77092cb => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:14.807704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:14.809649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:14.843953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3868-91b2-40c1-8fcb-834cd03e70bd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:15.022894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:15.023609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:15.026990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:15.026990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] PATH_INFO: `/v3/projects/4179ab3f007f43708b81bb5a706480ae` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:15.026990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4179ab3f007f43708b81bb5a706480ae)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:15.028205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:15.104670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:15.214122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4179ab3f007f43708b81bb5a706480ae', 'request_id': 'req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:15.281888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4179ab3f007f43708b81bb5a706480ae', 'request_id': 'req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:15.296308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4179ab3f007f43708b81bb5a706480ae', 'request_id': 'req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:15.322281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] The token cache is being invalidate because project 4179ab3f007f43708b81bb5a706480ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:15.322737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:15.325378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b36e43b3-0c34-4cd4-9af9-55fc5fb80062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:15.328482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1188/2360] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:14 2022] DELETE /identity/v3/projects/4179ab3f007f43708b81bb5a706480ae => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:15.333113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:15.333699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:15.333699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:15.404387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:15.407996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:15.648010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1173/2361] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:15.655994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:15.656405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:15.656779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:15.717312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:15.721203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:15.748275 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1189/2362] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:15.749836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:15.767543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dda68-4573-4790-8ae3-b91ee234853e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:15.784517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:15.789236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:15.789236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:15.789236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:15.789236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:15.789236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:15.793064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:15.839026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1174/2363] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:18:15.841359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:15.864437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bea3-1b91-4f8d-ad41-e32489a02a5a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:15.882337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:15.886906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:15.886906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:15.886906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:15.886906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:15.893172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:16.061007 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1190/2364] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:15 2022] POST /identity/v3/projects => generated 397 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:16.065711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:16.080779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393370fa-4802-43db-84f0-6e364c6a52f3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:16.192327 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:16.236282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:16.236998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:16.237536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:16.237877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:16.238587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:16.240797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:16.356592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1175/2365] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:16 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:16.360478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:16.383770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3d5-1183-4649-8f29-f2bfcce17ff3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:16.392030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:16.392789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:16.393141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:16.393757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:16.394605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:16.396354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:16.447784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:16.465676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1191/2366] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:16.467859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e434a8f-12de-41b0-85af-361e3360adcd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:16.483947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:16.484888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:16.485423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:16.485964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:16.486823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:16.488759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308c1f3-392a-45f6-821a-0fc18f3eab2d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:16.502827 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1176/2367] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:16.508039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:16.520572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ff78c-8471-4ddd-9fff-ed3e62015404 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:16.534760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:16.536131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:16.536654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:16.537294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] PATH_INFO: `/v3/projects/21528130be244950b9cbbe640dfd3cf4/users/74770187af4e41469fc13f21d61b0550/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:16.578384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21528130be244950b9cbbe640dfd3cf4, user_id=74770187af4e41469fc13f21d61b0550, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:16.582726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:16.661433 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1192/2368] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:16 2022] PUT /identity/v3/projects/21528130be244950b9cbbe640dfd3cf4/users/74770187af4e41469fc13f21d61b0550/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:16.674725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:16.675022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:16.675758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:16.733482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] MFA Rules not processed for user `74770187af4e41469fc13f21d61b0550`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:16.735165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:16.882644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1177/2369] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:16.887389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:17.008131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452f156-d2b8-4572-8287-cf20ac732560 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:17.023045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:17.023995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:17.024584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:17.025509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:17.026352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:17.031162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:17.152283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1193/2370] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:16 2022] POST /identity/v3/projects => generated 397 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:17.157506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:17.188767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5d1b5-8ee9-4da0-a5ce-fa79a4f7b056 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:17.442716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:17.443419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:17.446547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:17.446864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:17.454067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:17.460532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:17.629233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1178/2371] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:17 2022] POST /identity/v3/users => generated 305 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:17.630681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:17.663793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd7d0d-c149-412b-9771-d1ad44059f6d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:17.690429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:17.691359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:17.692538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:17.692975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:17.695339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:17.705746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:17.789438 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1194/2372] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:17.796422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:17.814553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac9e05-1ccb-47a1-a621-09ab52584223 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:17.830818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:17.831823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:17.832197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:17.832817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] PATH_INFO: `/v3/projects/308e073236624c65ad478dde9450994f/users/76435443ffaa464cbcf8de651606ce35/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:17.890079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308e073236624c65ad478dde9450994f, user_id=76435443ffaa464cbcf8de651606ce35, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:17.898580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:18.023671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:18.042802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1179/2373] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:17 2022] PUT /identity/v3/projects/308e073236624c65ad478dde9450994f/users/76435443ffaa464cbcf8de651606ce35/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:18.062717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d42a83-3b51-420a-a52e-33e6db0bf158 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:18.122339 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:18.345296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:18.345296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:18.345296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:18.349030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:18.350459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:18.360891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8caf-9dfd-42ab-b0e6-926a8bceb111 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:18.391635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:18.399558 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1195/2374] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:18.406810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c3a4-9819-49df-9c2f-29d1a1e64ff3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:18.418569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:18.419640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:18.420119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:18.420594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] PATH_INFO: `/v3/projects/308e073236624c65ad478dde9450994f/users/76435443ffaa464cbcf8de651606ce35/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:18.424616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] RBAC: Authorizing `identity:create_grant(project_id=308e073236624c65ad478dde9450994f, user_id=76435443ffaa464cbcf8de651606ce35, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:18.431247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:18.452278 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:18.465835 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1180/2375] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:18 2022] PUT /identity/v3/projects/308e073236624c65ad478dde9450994f/users/76435443ffaa464cbcf8de651606ce35/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:18.475517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5414fb-1f7a-4e67-a645-a73ce7e1000b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:18.476526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5414fb-1f7a-4e67-a645-a73ce7e1000b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:18.476526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5414fb-1f7a-4e67-a645-a73ce7e1000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:18.516690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3f5414fb-1f7a-4e67-a645-a73ce7e1000b None None] MFA Rules not processed for user `76435443ffaa464cbcf8de651606ce35`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:18.517961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f5414fb-1f7a-4e67-a645-a73ce7e1000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:18.699592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1196/2376] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:19.718155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:19.721845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:19.998509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbd7b-86c2-4e20-a77a-aca298a9781c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:20.026476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:20.028803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:20.029319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:20.029745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:20.070547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:20.071055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:20.071055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:20.175558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:20.179021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:20.191365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] MFA Rules not processed for user `e9f264c3e1ff43e7926ee1200a9c4d09`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:20.193708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:20.197131 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1181/2377] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:20.381030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1197/2378] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:20.819420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:20.821378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:20.848601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668f10-2fa4-4e69-8a64-c5d2f8096592 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:20.879602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:20.880313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:20.880591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:20.880867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:20.902773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:20.905130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:20.936674 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1182/2379] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:22.315497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:22.333874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102dc8d-844d-4b61-90e1-85cc2f50440a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:22.356958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:22.358065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:22.358530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:22.358954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:22.377558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:22.379182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db364d5-7edf-46d3-9b17-888a121d6e41 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:22.391101 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1198/2380] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:18:23.937811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:24.079702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4b81-1235-4e3d-b20a-a4243e6d77de service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:24.079702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:24.079702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:24.079702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:24.080360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] PATH_INFO: `/v3/users/74770187af4e41469fc13f21d61b0550` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:24.080360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74770187af4e41469fc13f21d61b0550)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:24.080360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:24.591625 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:24.718897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74770187af4e41469fc13f21d61b0550'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:24.720405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74770187af4e41469fc13f21d61b0550'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:24.734453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74770187af4e41469fc13f21d61b0550'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:24.737420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74770187af4e41469fc13f21d61b0550'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:24.821714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74770187af4e41469fc13f21d61b0550'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:24.849233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1183/2381] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:23 2022] DELETE /identity/v3/users/74770187af4e41469fc13f21d61b0550 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:24.854332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:24.855312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:24.855981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:24.909201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:24.909201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:24.939497 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:25.030327 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1199/2382] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:25.043962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:25.046874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:25.143500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef820-0c33-4540-b312-a927fc1a70c6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:25.149058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:25.149838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:25.150548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:25.151049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:25.169126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:25.173464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:25.204711 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1184/2383] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:26.460650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:26.460650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:26.486509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77831994-ebcd-4eee-99e6-01726ba8c348 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:26.498066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:26.498710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:26.499161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:26.499456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] PATH_INFO: `/v3/projects/21528130be244950b9cbbe640dfd3cf4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:26.500633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21528130be244950b9cbbe640dfd3cf4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:26.504960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:26.744330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21528130be244950b9cbbe640dfd3cf4', 'request_id': 'req-6e710ed5-12c2-4771-8af1-4626da490291'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:26.881596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21528130be244950b9cbbe640dfd3cf4', 'request_id': 'req-6e710ed5-12c2-4771-8af1-4626da490291'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:26.898015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21528130be244950b9cbbe640dfd3cf4', 'request_id': 'req-6e710ed5-12c2-4771-8af1-4626da490291'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:26.938415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] The token cache is being invalidate because project 21528130be244950b9cbbe640dfd3cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:26.938717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:26.940518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:26.945944 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1200/2384] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:26 2022] DELETE /identity/v3/projects/21528130be244950b9cbbe640dfd3cf4 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:26.950737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:26.996791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62d02-fb10-4b37-afbe-237d6db56014 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:27.115589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:27.116675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:27.117041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:27.117503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] PATH_INFO: `/v3/users/76435443ffaa464cbcf8de651606ce35` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:27.119069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=76435443ffaa464cbcf8de651606ce35)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:27.123371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:27.416023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76435443ffaa464cbcf8de651606ce35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:27.417576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76435443ffaa464cbcf8de651606ce35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:27.426646 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:27.440894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76435443ffaa464cbcf8de651606ce35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:27.448652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76435443ffaa464cbcf8de651606ce35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:27.551426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76435443ffaa464cbcf8de651606ce35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:27.578864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1185/2385] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:26 2022] DELETE /identity/v3/users/76435443ffaa464cbcf8de651606ce35 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:28.531429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:28.531429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:28.557752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e710ed5-12c2-4771-8af1-4626da490291 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:28.599151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:28.602223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:28.701436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:28.702556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:28.710233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:28.710233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] PATH_INFO: `/v3/projects/308e073236624c65ad478dde9450994f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:28.711346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308e073236624c65ad478dde9450994f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:28.715828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:28.866736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747fd-67d5-4307-ad78-fbebba9675ee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:28.892983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:28.899893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:28.900440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:28.901071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:28.911633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:28.967728 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:28.974164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308e073236624c65ad478dde9450994f', 'request_id': 'req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:29.049087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308e073236624c65ad478dde9450994f', 'request_id': 'req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:29.059481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:29.064329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308e073236624c65ad478dde9450994f', 'request_id': 'req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:29.070588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f0be9-9535-4077-ba1b-24686a5f7407 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:29.091562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] The token cache is being invalidate because project 308e073236624c65ad478dde9450994f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:29.092330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:29.094601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1e04a52c-d426-47bc-8ff0-699ae6c5aef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:29.098849 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1201/2386] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:28 2022] DELETE /identity/v3/projects/308e073236624c65ad478dde9450994f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:29.105807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.106631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.106631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.127762 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1186/2387] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:18:29.173865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:29.175288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:29.319605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1202/2388] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:18:29.324769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.325059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.325378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.371852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:29.379388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:29.388870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1187/2389] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:29.390080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:29.408037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9806ee-17c5-421f-9301-497bc53e7b17 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:29.424737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:29.424737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.424737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.424737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.425275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:29.425275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:29.425275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:29.448806 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1203/2390] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:18:29.452788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:29.464885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c450865-fea7-4e6e-8c75-8132c8fff9c0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:29.482232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:29.483222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.483442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.483722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.484367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:29.490191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:29.666922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:29.678894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1188/2391] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:29 2022] POST /identity/v3/projects => generated 405 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:29.680313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36a27c-d790-40fe-968c-1f06ba1c00c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:29.799864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:29.800502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.800889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.801166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.802352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:29.805372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:29.943507 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1204/2392] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:29 2022] POST /identity/v3/users => generated 303 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:29.949198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:29.976687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb31d03-a1b3-4fda-bc53-26d57880ea5a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:29.990553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:29.991344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:29.991650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:29.991993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:29.992595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:29.995160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:30.017438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1189/2393] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:30.018981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:30.033536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334c1ed-eb5c-4405-ae18-2ef1e1e3a908 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:30.054730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:30.055414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:30.055675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:30.055947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:30.056618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:30.058862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b4007-cb87-47ce-b924-8895607188db admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:30.081801 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1205/2394] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:18:30.086383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:30.097018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd53314-b1ba-4be3-a106-d6a340d1181c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:30.113289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:30.117776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:30.117776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:30.117776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] PATH_INFO: `/v3/projects/b3431d70803b488094810a5defb63faa/users/7cf383913f454705857bbcaff2430415/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:30.144590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3431d70803b488094810a5defb63faa, user_id=7cf383913f454705857bbcaff2430415, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:30.148581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:30.152630 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:30.256779 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1190/2395] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:30 2022] PUT /identity/v3/projects/b3431d70803b488094810a5defb63faa/users/7cf383913f454705857bbcaff2430415/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:30.257831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:30.262171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:30.262171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:30.308152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:30.309855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:30.436524 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:30.502563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1206/2396] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:18:30.516422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:30.518641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:30.600957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701799-18c3-4436-8999-42c5d41f6cb4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:30.605215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:30.606027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:30.606497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:30.606947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:30.620184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:30.622341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:30.636916 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1191/2397] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:30.748677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:30.751414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:30.769564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593e37d-e74b-45e1-84af-036458e0ab3d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:30.777446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:30.778328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:30.783760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:30.783760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] PATH_INFO: `/v3/users/e9f264c3e1ff43e7926ee1200a9c4d09` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:30.783760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f264c3e1ff43e7926ee1200a9c4d09)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:30.783760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:31.069474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f264c3e1ff43e7926ee1200a9c4d09'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.156773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f264c3e1ff43e7926ee1200a9c4d09'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.157630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f264c3e1ff43e7926ee1200a9c4d09'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.175912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f264c3e1ff43e7926ee1200a9c4d09'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.185481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a174b4e3-3391-4ffe-a2ba-c4e8611def14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f264c3e1ff43e7926ee1200a9c4d09'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.192738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1207/2398] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:30 2022] DELETE /identity/v3/users/e9f264c3e1ff43e7926ee1200a9c4d09 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:31.497220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:31.524928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abca3-32dd-426e-a0c8-8ee57aabec71 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:31.696650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:31.703485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:31.703786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:31.704073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] PATH_INFO: `/v3/projects/e70c0e4e43f849f393ca200c3d838e23` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:31.714659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70c0e4e43f849f393ca200c3d838e23)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:31.717308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:31.924546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70c0e4e43f849f393ca200c3d838e23', 'request_id': 'req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:31.942929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70c0e4e43f849f393ca200c3d838e23', 'request_id': 'req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:32.059855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70c0e4e43f849f393ca200c3d838e23', 'request_id': 'req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:32.083827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] The token cache is being invalidate because project e70c0e4e43f849f393ca200c3d838e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:32.084123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:32.086694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1afdb49d-1b5c-49a6-8f3e-607bcf8e7b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:32.090168 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1192/2399] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:31 2022] DELETE /identity/v3/projects/e70c0e4e43f849f393ca200c3d838e23 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:32.095446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.097200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.097990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.133161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:32.135392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:32.315658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1208/2400] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:32.316983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.317273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.317573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.359704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:32.362012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:32.381663 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1193/2401] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:32.382999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:32.395486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34681d-70ef-41f4-80f2-43780e6be4a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:32.400648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:32.401617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.402092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.402525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.403349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:32.403823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:32.405616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:32.421847 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1209/2402] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:18:32.426127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:32.437652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbaede-4ef1-4fd1-9baf-79cdea3c1c43 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:32.444972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:32.446107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.446759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.447200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.448004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:32.450125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:32.563600 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:32.573839 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1194/2403] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:32 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:32.577984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:32.592779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cf7d6-34be-49c2-9301-fe933f52ada5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:32.672353 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:32.713246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:32.714227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.714663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.715102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.716046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:32.718369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:32.887943 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1210/2404] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:32 2022] POST /identity/v3/users => generated 300 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:32.902589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:32.918656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226442-b7c9-4a4a-9e69-359824866da0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:32.925146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:32.927114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:32.927424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:32.927698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:32.928426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:32.930175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:32.967186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1195/2405] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:32.971325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:32.987981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade82c0-1d66-4d8a-9198-f1db7422ba76 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:33.002545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:33.003189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:33.003474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:33.003751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:33.004411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:33.006180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127428c-df16-4539-b22b-ebd0f0795620 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:33.032785 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1211/2406] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:33.041097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:33.063012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b223-2161-45e8-9499-4b211cdc6b4c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:33.075980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:33.076529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:33.077131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:33.077467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] PATH_INFO: `/v3/projects/8c2cd7e4b04741e3bb1cb9852612db57/users/c114d44d0a314c75902da53fca797f62/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:33.110636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2cd7e4b04741e3bb1cb9852612db57, user_id=c114d44d0a314c75902da53fca797f62, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:33.117007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:33.244803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1196/2407] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:33 2022] PUT /identity/v3/projects/8c2cd7e4b04741e3bb1cb9852612db57/users/c114d44d0a314c75902da53fca797f62/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:33.250111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:33.251061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:33.251529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:33.280770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:33.283406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:33.367607 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1212/2408] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:33.379281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:33.383367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:33.467894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316f21-6e91-49bd-9297-7fd1a8ee380d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:33.474496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:33.475598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:33.476159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:33.476442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:33.510129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:33.511580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:33.541153 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1197/2409] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:35.882627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:35.898599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ce078-b6e6-4e38-9721-ed1522d20c78 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:35.911037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:35.911853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:35.913448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:35.914337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:35.922186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:36.076833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:36.080814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb408ae-3e9a-4590-9e28-c2982fa4cd8f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:36.099371 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1213/2410] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:39.640243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:39.654770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771098-89a2-48b4-95f9-a04b7027cd7b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:39.665813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:39.666958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:39.667490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:39.668070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:39.671304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:39.690943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:39.694573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:39.715851 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1198/2411] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:40.150608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6cb9f-65e6-458b-a12d-1e3cd9d4ee7e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:40.156538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6cb9f-65e6-458b-a12d-1e3cd9d4ee7e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:40.156538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6cb9f-65e6-458b-a12d-1e3cd9d4ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:40.210765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-11f6cb9f-65e6-458b-a12d-1e3cd9d4ee7e None None] MFA Rules not processed for user `ec7269dc6d56440ca8691179f7275aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:40.214045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-11f6cb9f-65e6-458b-a12d-1e3cd9d4ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:40.285578 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:40.356539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1214/2412] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:40.477687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:40.479994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:40.706767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc22e76-62ef-4e28-8684-90727b5e8ab4 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:40.723324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:40.724215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:40.724652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:40.725812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:40.730871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:40.760588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:40.761629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:40.797426 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1199/2413] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:41.499573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:41.500984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:41.502306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:41.571816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] MFA Rules not processed for user `7cf383913f454705857bbcaff2430415`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:41.575039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:41.699461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1215/2414] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:41.703745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:41.705272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:41.721382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be220b4-42fc-4162-b4c4-cfa8124e6bf7 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:41.728047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:41.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:41.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:41.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:41.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:41.733103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:41.912215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1200/2415] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:41 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:41.912315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:41.930170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f1da-67ef-4ade-8507-557274d4cd3a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:42.068022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:42.068673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:42.069562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:42.069831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:42.070499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:42.072440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:42.208349 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1216/2416] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:41 2022] POST /identity/v3/users => generated 309 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:42.212965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:42.238811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271c07-2983-41a3-86f2-434a2a1a9e9a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:42.273442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:42.274079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:42.274356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:42.274627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:42.275282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:42.282376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:42.344129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1201/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:42.348414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:42.365798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c6d19-495b-4ec0-8af4-d95fc37f53ee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:42.407265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:42.407966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:42.408252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:42.408532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] PATH_INFO: `/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0/users/f74afecc02d54f7c8646b45bd11c739a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:42.460029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=601c87637cdc4ccaa16a6b2cd00d91b0, user_id=f74afecc02d54f7c8646b45bd11c739a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:42.477532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:42.656879 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1217/2418] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:42 2022] PUT /identity/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0/users/f74afecc02d54f7c8646b45bd11c739a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:42.659185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:42.684134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2c78-962b-4e7f-9ce6-97c83bc9c92b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:42.704340 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:42.883541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:42.885001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:42.885899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:42.886430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:42.887299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:42.889143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:42.907240 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1202/2419] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:42.911215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:42.925142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e79e4-ddc1-463e-814e-179975069a8b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:42.937103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:42.937808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:42.938324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:42.938768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] PATH_INFO: `/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0/users/f74afecc02d54f7c8646b45bd11c739a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:42.947317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=601c87637cdc4ccaa16a6b2cd00d91b0, user_id=f74afecc02d54f7c8646b45bd11c739a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:42.950967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dc37-8db4-416f-8424-407ef65af882 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:42.985083 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1218/2420] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:42 2022] PUT /identity/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0/users/f74afecc02d54f7c8646b45bd11c739a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:45.338438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:45.531446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e75e2-9523-407e-9c9f-d7034f90da03 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:45.887442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:45.889137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:45.889479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:45.895585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:45.901730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:45.944834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:45.946346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:45.979919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1203/2421] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:47.330886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915c5d-07cb-4bd6-8eec-8be8d12903ab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:47.333979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915c5d-07cb-4bd6-8eec-8be8d12903ab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:47.334191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21915c5d-07cb-4bd6-8eec-8be8d12903ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:47.431286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21915c5d-07cb-4bd6-8eec-8be8d12903ab None None] MFA Rules not processed for user `c114d44d0a314c75902da53fca797f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:47.433060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21915c5d-07cb-4bd6-8eec-8be8d12903ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:47.488287 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:47.516092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:47.517723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:47.643378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1219/2422] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:47.644964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:47.645250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:47.645585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:47.697292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] MFA Rules not processed for user `c114d44d0a314c75902da53fca797f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:47.699390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:47.712901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1220/2423] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:47.729764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7accfec-bc91-4d09-aa1d-2958319d76be service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:47.737854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:47.740709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:47.740848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:47.741460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:47.741733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:47.742008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] PATH_INFO: `/v3/users/f33a2fe009b74c1285df84f614f38866` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:47.743682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33a2fe009b74c1285df84f614f38866)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:47.745883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:47.763316 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:47.949423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f2c7f-89a9-4d21-9c71-e109c00d89c3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:47.971917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:47.972424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:47.972578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:47.972844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:47.991645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:47.995386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea06de-e7f3-4177-a41b-cf6b4b11dff2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:48.024304 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1221/2424] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:18:48.062845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33a2fe009b74c1285df84f614f38866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:48.070129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33a2fe009b74c1285df84f614f38866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:48.086146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33a2fe009b74c1285df84f614f38866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:48.091957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33a2fe009b74c1285df84f614f38866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:48.182527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33a2fe009b74c1285df84f614f38866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:48.221043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1204/2425] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:47 2022] DELETE /identity/v3/users/f33a2fe009b74c1285df84f614f38866 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:18:48.226343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:48.226869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:48.227300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:48.259291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:48.261134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:48.372282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1222/2426] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:48.382988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:48.384662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:48.502831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d507b38-f00e-455f-858d-93e93f03a04c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:48.508866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:48.510048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:48.510485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:48.510930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:48.523158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:48.525857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:48.542194 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1205/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:49.112004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:49.113799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:49.134687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b365d-0374-4c8e-9b3a-aca2e4eefc56 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:49.142929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:49.143616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:49.143866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:49.144310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] PATH_INFO: `/v3/projects/b90a3225f0bb4bb6a90847078c27720d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:49.148509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90a3225f0bb4bb6a90847078c27720d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:49.150778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:49.367745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90a3225f0bb4bb6a90847078c27720d', 'request_id': 'req-e0444e79-1b06-4c6f-912a-46784660d596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:49.454916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90a3225f0bb4bb6a90847078c27720d', 'request_id': 'req-e0444e79-1b06-4c6f-912a-46784660d596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:49.461990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90a3225f0bb4bb6a90847078c27720d', 'request_id': 'req-e0444e79-1b06-4c6f-912a-46784660d596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:49.500268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] The token cache is being invalidate because project b90a3225f0bb4bb6a90847078c27720d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:49.500268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:49.502127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:49.504496 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1223/2428] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:49 2022] DELETE /identity/v3/projects/b90a3225f0bb4bb6a90847078c27720d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:49.509218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:49.524334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0e417-8ad0-4939-b201-1019b886bc9b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:49.649073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:49.716310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:49.717925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:49.719353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:49.721391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] PATH_INFO: `/v3/users/6c16b1b22abf4792b39630ed7caeaaf0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:49.723911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c16b1b22abf4792b39630ed7caeaaf0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:49.728545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:49.887273 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:50.080087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c16b1b22abf4792b39630ed7caeaaf0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:50.081697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c16b1b22abf4792b39630ed7caeaaf0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:50.098671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c16b1b22abf4792b39630ed7caeaaf0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:50.099637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c16b1b22abf4792b39630ed7caeaaf0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:50.198271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-153bb20c-c816-4517-9541-476afa88c721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c16b1b22abf4792b39630ed7caeaaf0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:50.280307 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1206/2429] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:49 2022] DELETE /identity/v3/users/6c16b1b22abf4792b39630ed7caeaaf0 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:50.966325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:50.968566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:50.992244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444e79-1b06-4c6f-912a-46784660d596 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:51.181237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:51.182014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:51.182302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:51.184034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] PATH_INFO: `/v3/projects/c10bd75c265f49afb096a2b57616b71e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:51.187431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c10bd75c265f49afb096a2b57616b71e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:51.192019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:51.389756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c10bd75c265f49afb096a2b57616b71e', 'request_id': 'req-bb106659-7acb-4a1b-8eeb-e10ee245f62f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:51.482778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c10bd75c265f49afb096a2b57616b71e', 'request_id': 'req-bb106659-7acb-4a1b-8eeb-e10ee245f62f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:51.491566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c10bd75c265f49afb096a2b57616b71e', 'request_id': 'req-bb106659-7acb-4a1b-8eeb-e10ee245f62f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:51.514953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] The token cache is being invalidate because project c10bd75c265f49afb096a2b57616b71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:51.515333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:51.517780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb106659-7acb-4a1b-8eeb-e10ee245f62f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:51.522726 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1224/2430] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:50 2022] DELETE /identity/v3/projects/c10bd75c265f49afb096a2b57616b71e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:51.528639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:51.529175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:51.529175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:51.566171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:51.567747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:51.768636 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1207/2431] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:51.776902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:51.777810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:51.778245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:51.805373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:51.807419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:51.823255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:51.838054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d7de4-af94-41dd-aaf7-a0d3322617c0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:51.838226 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1225/2432] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:51.848281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:51.850773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:51.851062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:51.851340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:51.852468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:18:51.852787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:51.859470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:51.903145 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1208/2433] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:18:51.907399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:51.949888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0149a-7108-4afd-9289-1d40dc1084b4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:51.984720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:51.985378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:51.985646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:51.985922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:51.986575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:51.988601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:52.159756 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1226/2434] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:51 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:52.160571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:52.187979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7065b6-a728-4a63-b79e-14ff1c72644f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:52.399518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:52.400132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:52.400416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:52.400684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:52.401374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:52.411028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:52.592903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1209/2435] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:52 2022] POST /identity/v3/users => generated 297 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:18:52.597231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:52.616054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec2cac-028e-4df6-a36a-a76d50bb7036 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:52.652206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:52.652862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:52.653146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:52.653502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:52.654177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:52.657051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:52.702361 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1227/2436] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:52.706227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:52.724049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4fde2-0973-4bc5-ad99-535a24616011 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:52.736923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:52.737977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:52.738424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:52.739493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:52.740379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:52.742757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783332bd-cf26-4090-bf50-c9c0ef3d73fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:52.808535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1210/2437] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:52.811800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:52.846049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06e1c7-f274-49f8-b820-b7bdbae1d25f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:52.865263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:52.866286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:52.868294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:52.872131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] PATH_INFO: `/v3/projects/dff8a9cb1f7041289dc376b8a8bc91f5/users/8a0d0ccd0c0c4e2da7e4fc61663b1a38/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:52.934930 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:52.950021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff8a9cb1f7041289dc376b8a8bc91f5, user_id=8a0d0ccd0c0c4e2da7e4fc61663b1a38, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:52.953504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:53.093416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1228/2438] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:52 2022] PUT /identity/v3/projects/dff8a9cb1f7041289dc376b8a8bc91f5/users/8a0d0ccd0c0c4e2da7e4fc61663b1a38/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:53.100778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:53.101069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:53.101462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:53.139112 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:53.151225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] MFA Rules not processed for user `8a0d0ccd0c0c4e2da7e4fc61663b1a38`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:53.153267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:53.402960 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1211/2439] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:53.403825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:53.501932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9c0fe-9e1b-4cd9-b668-573822fe4185 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:53.508805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:53.511145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:53.511641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:53.512080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:53.512931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:53.516540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:53.700966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:53.713825 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1229/2440] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:18:53 2022] POST /identity/v3/projects => generated 393 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:53.723179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7cc0-64c5-44eb-b5f7-a0f84bc6ea50 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:53.905140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:53.905877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:53.906761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:53.907044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:53.912035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:53.922068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:54.067411 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1212/2441] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:18:53 2022] POST /identity/v3/users => generated 303 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:18:54.072840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:54.100150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30648737-6182-40fb-a279-44f6193db72b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:54.126521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:54.127738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:54.128281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:54.131684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:54.132649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:54.136663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:54.171207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1230/2442] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:54.179961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:54.200721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1d638-e23d-4e4b-8e1c-dd5f3c69ec5d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:54.215985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:54.217392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:54.217647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:54.217927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] PATH_INFO: `/v3/projects/f4c1bf45655b4f7da8641e218bc44a23/users/536f4e656ac94fef9322565e37cbb558/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:54.271514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c1bf45655b4f7da8641e218bc44a23, user_id=536f4e656ac94fef9322565e37cbb558, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:54.281882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:54.378945 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1213/2443] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:54 2022] PUT /identity/v3/projects/f4c1bf45655b4f7da8641e218bc44a23/users/536f4e656ac94fef9322565e37cbb558/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:54.379822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:54.406035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6331eb-cc8d-487a-9b38-22affe5b1855 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:54.580211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:54.581189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:54.581652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:54.582088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:54.583291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:54.588034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf50df-b957-4d16-b567-cc0d9e5209ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:54.607201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1231/2444] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:18:54.608017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:54.633959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6760f-869d-461c-bc2e-d9fa720689cb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:54.659521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:54.660531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:54.660969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:54.661444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] PATH_INFO: `/v3/projects/f4c1bf45655b4f7da8641e218bc44a23/users/536f4e656ac94fef9322565e37cbb558/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:54.665897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c1bf45655b4f7da8641e218bc44a23, user_id=536f4e656ac94fef9322565e37cbb558, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:54.668879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:54.707899 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1214/2445] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:18:54 2022] PUT /identity/v3/projects/f4c1bf45655b4f7da8641e218bc44a23/users/536f4e656ac94fef9322565e37cbb558/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:18:54.723418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:54.723418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:54.723418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:54.800027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] MFA Rules not processed for user `536f4e656ac94fef9322565e37cbb558`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:54.807465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:54.982347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1232/2446] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:55.032437 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:55.399926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:55.401995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:55.510394 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:55.587614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9848-5926-46f1-b4ec-7864b8b91cc4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:55.595698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:55.596761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:55.597050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:55.598282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:55.608209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:55.610356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:55.627193 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1215/2447] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:55.973284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:55.990705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d786d7-8283-40c2-9922-c6386a18b0a9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:56.023953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:56.024907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:56.025131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:56.025441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:56.031044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:56.067831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:56.069744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0b73d-c8f7-4e8a-b6a5-38eeeaca89c6 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:56.096344 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1233/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:56.712640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:56.730394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74b30-1ca7-47c5-a594-64acced15d5a service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:56.743083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:56.744329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:56.744770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:56.745763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:56.827090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ed51-dc27-4336-adc7-82cae4bd4e7f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:56.827376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ed51-dc27-4336-adc7-82cae4bd4e7f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:56.827654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265ed51-dc27-4336-adc7-82cae4bd4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:56.875462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9265ed51-dc27-4336-adc7-82cae4bd4e7f None None] MFA Rules not processed for user `f74afecc02d54f7c8646b45bd11c739a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:56.877240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9265ed51-dc27-4336-adc7-82cae4bd4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:56.884966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:56.887346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:56.898406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1216/2449] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:56.925538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:56.992032 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1234/2450] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:57.025931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9d0a-53e3-43a5-96d1-0b477847ed19 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:57.039474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:57.040547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:57.041068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:57.041699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] PATH_INFO: `/v3/users/8a0d0ccd0c0c4e2da7e4fc61663b1a38` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:57.042976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0d0ccd0c0c4e2da7e4fc61663b1a38)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:57.045083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:57.319058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0d0ccd0c0c4e2da7e4fc61663b1a38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:57.320532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0d0ccd0c0c4e2da7e4fc61663b1a38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:57.334698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0d0ccd0c0c4e2da7e4fc61663b1a38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:57.335590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0d0ccd0c0c4e2da7e4fc61663b1a38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:57.426452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0d0ccd0c0c4e2da7e4fc61663b1a38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:57.457650 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:57.474289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1217/2451] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:56 2022] DELETE /identity/v3/users/8a0d0ccd0c0c4e2da7e4fc61663b1a38 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:18:57.479373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:57.479937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:57.480285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:57.506081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:18:57.507331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:57.704909 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1235/2452] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:18:57.871790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:57.873573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:57.962601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69a334-7368-47eb-bed6-fde524141d19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:57.971190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:57.972102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:57.972582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:57.973082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:58.001919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:58.004338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:58.018825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1218/2453] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:18:59.344046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:59.346326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:18:59.378567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c3501-5735-4007-8be9-fb5d03a1b12a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:18:59.403420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:18:59.405276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:18:59.405859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:18:59.406372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] PATH_INFO: `/v3/projects/dff8a9cb1f7041289dc376b8a8bc91f5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:18:59.412004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff8a9cb1f7041289dc376b8a8bc91f5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:18:59.417662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:18:59.647076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff8a9cb1f7041289dc376b8a8bc91f5', 'request_id': 'req-0dad40ec-4b32-449a-a51c-e3954e9d79bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:59.651089 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:18:59.724189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff8a9cb1f7041289dc376b8a8bc91f5', 'request_id': 'req-0dad40ec-4b32-449a-a51c-e3954e9d79bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:59.739909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff8a9cb1f7041289dc376b8a8bc91f5', 'request_id': 'req-0dad40ec-4b32-449a-a51c-e3954e9d79bd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:59.808224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] The token cache is being invalidate because project dff8a9cb1f7041289dc376b8a8bc91f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:18:59.812220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:59.816328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:18:59.830185 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1236/2454] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:18:59 2022] DELETE /identity/v3/projects/dff8a9cb1f7041289dc376b8a8bc91f5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:18:59.835496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:18:59.853521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2d8e-eb62-43bb-a0fe-53620e27c60a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:00.079089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:00.081051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:00.082248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:00.083086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] PATH_INFO: `/v3/users/536f4e656ac94fef9322565e37cbb558` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:00.087136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=536f4e656ac94fef9322565e37cbb558)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:00.091914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:00.353480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536f4e656ac94fef9322565e37cbb558'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:00.355406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536f4e656ac94fef9322565e37cbb558'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:00.385590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536f4e656ac94fef9322565e37cbb558'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:00.387013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536f4e656ac94fef9322565e37cbb558'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:00.517855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a7171a5-dcbe-47cb-8c04-f099fd082dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536f4e656ac94fef9322565e37cbb558'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:00.568952 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1219/2455] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:18:59 2022] DELETE /identity/v3/users/536f4e656ac94fef9322565e37cbb558 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:03.657631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:03.658085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:03.688525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad40ec-4b32-449a-a51c-e3954e9d79bd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:03.827570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:03.841088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:03.841088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:03.841088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] PATH_INFO: `/v3/projects/f4c1bf45655b4f7da8641e218bc44a23` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:03.841088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c1bf45655b4f7da8641e218bc44a23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:03.851055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:04.051774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c1bf45655b4f7da8641e218bc44a23', 'request_id': 'req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:04.130468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c1bf45655b4f7da8641e218bc44a23', 'request_id': 'req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:04.143169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c1bf45655b4f7da8641e218bc44a23', 'request_id': 'req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:04.216336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] The token cache is being invalidate because project f4c1bf45655b4f7da8641e218bc44a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:04.216651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:04.219866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-04ed05e9-6213-446c-9b0b-1a4a9a82a1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:04.232277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1237/2456] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:03 2022] DELETE /identity/v3/projects/f4c1bf45655b4f7da8641e218bc44a23 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:04.239717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:04.240199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:04.240726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:04.315523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:04.323937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:04.374239 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:04.546023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1220/2457] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:04.547524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:04.547812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:04.548095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:04.608216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:04.615336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:04.643416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1238/2458] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:04.643799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:04.660357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e825c-b159-4383-b3ca-9fe6003b91b5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:04.672636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:04.673278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:04.673583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:04.673860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:04.674529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:04.674838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:04.688047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:04.728006 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1221/2459] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:19:04.732913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:04.752695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbda2a-b2d2-4f65-9671-950b3d5fa3f6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:04.762493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:04.764097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:04.765442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:04.775778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:04.777582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:04.783070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:04.911638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1239/2460] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:04 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:04.916231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:04.932381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35e4b8-dd51-4e95-9fa6-a7c0158d97b4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.084272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.085593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.086010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.086408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.087182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:05.089598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:05.194129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1222/2461] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:04 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:05.198016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:05.216055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec56b7-aabd-420b-8071-3c95416e2fa6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.224586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.226437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.227395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.228372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.230212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:05.232337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:05.255501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1240/2462] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:05.259453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:05.270467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c1593-36d7-4180-b504-56e8dcd8894f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.290455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.291820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.292417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.292877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.295791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:05.297465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bdccd-0c17-4652-ac66-2b8653a2093b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:05.327606 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1223/2463] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:05.328567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:05.354335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b0313-2c04-46a2-9be5-33fd65b9625c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.367410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.369686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.370009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.370291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] PATH_INFO: `/v3/projects/8c95e97cd7e4461682b9028abb568dce/users/33691c943ec040ddb04b6648b6e945ab/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.412192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c95e97cd7e4461682b9028abb568dce, user_id=33691c943ec040ddb04b6648b6e945ab, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:05.420049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:05.518209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1241/2464] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:05 2022] PUT /identity/v3/projects/8c95e97cd7e4461682b9028abb568dce/users/33691c943ec040ddb04b6648b6e945ab/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:05.527412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.527750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.528039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.574608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:05.576581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:05.695332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1224/2465] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:05.722201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:05.727861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:05.751954 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:05.767624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:05.770161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:05.861128 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:05.932154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b4750-bf70-46ea-815e-62bb889957d9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.942596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1a002-0aed-442c-8eb7-d51f61eec9d2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:05.945649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.948026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.948362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.948667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.952277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:05.953199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:05.954547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:05.954980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:05.968183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:05.994554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:05.996027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37dcc3-a153-4058-bd1c-d6920483cd0d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:06.025366 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1242/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:06.111754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:06.113257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:06.127656 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1225/2467] 10.222.0.13 () {60 vars in 1396 bytes} [Sun Oct 30 01:19:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:19:08.056930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:08.059875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:08.059875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:08.089558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] MFA Rules not processed for user `2096bbb8aff742b1837931e52ac1c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:08.094357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:08.226504 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1243/2468] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:12.802864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:12.821599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618828c-73d9-4714-9cd4-daccdedda309 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:12.855540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:12.860335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:12.868841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:12.870189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:12.891010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:12.939913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:12.943000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb0319-bd3b-4bb3-a020-e647a5df9c2f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:12.967971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1226/2469] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:15.277713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:15.279506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:15.314153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722d0e9-8962-4a8b-ac11-2fd3bdfce83b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:15.330234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:15.332007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:15.332477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:15.332903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] PATH_INFO: `/v3/users/c536d41a93ad4337909fe2e2cb949e03` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:15.337429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c536d41a93ad4337909fe2e2cb949e03)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:15.344418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:15.634435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c536d41a93ad4337909fe2e2cb949e03'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:15.723990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c536d41a93ad4337909fe2e2cb949e03'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:15.724677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c536d41a93ad4337909fe2e2cb949e03'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:15.747997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c536d41a93ad4337909fe2e2cb949e03'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:15.766775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c536d41a93ad4337909fe2e2cb949e03'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:15.790041 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1244/2470] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:15 2022] DELETE /identity/v3/users/c536d41a93ad4337909fe2e2cb949e03 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:15.791540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:15.792024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:15.792108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:15.835898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:15.846681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:16.010091 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1227/2471] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:16.023131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:16.024576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:16.064312 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:16.162320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918ef8-d3fe-4ad0-ab2f-135785112b7b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:16.174008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:16.174892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:16.175404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:16.179275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:16.222551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:16.224182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:16.266710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1245/2472] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:16.924763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:16.926881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:16.950203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa107981-059f-483a-ba93-1122c9cbde43 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:16.962645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:16.963865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:16.964319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:16.964755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] PATH_INFO: `/v3/projects/76b6f7b705f5428b9a3a3a8c4f86ff48` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:16.966795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b6f7b705f5428b9a3a3a8c4f86ff48)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:16.990426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:17.242690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'request_id': 'req-12bf9557-fa52-43a4-ad8b-503664e46274'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.252656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'request_id': 'req-12bf9557-fa52-43a4-ad8b-503664e46274'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.257358 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:17.369490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b6f7b705f5428b9a3a3a8c4f86ff48', 'request_id': 'req-12bf9557-fa52-43a4-ad8b-503664e46274'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.391613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] The token cache is being invalidate because project 76b6f7b705f5428b9a3a3a8c4f86ff48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:17.391906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.392781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.395093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1228/2473] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:16 2022] DELETE /identity/v3/projects/76b6f7b705f5428b9a3a3a8c4f86ff48 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:17.399150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:17.411059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e1f8-1a1e-4c92-9217-faa74787b827 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:17.560418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:17.560418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:17.560418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:17.560418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] PATH_INFO: `/v3/users/e1bac27011fc4bce9e391ad7915048b2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:17.560967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bac27011fc4bce9e391ad7915048b2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:17.560967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:17.741650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bac27011fc4bce9e391ad7915048b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.803397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bac27011fc4bce9e391ad7915048b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.804955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bac27011fc4bce9e391ad7915048b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.854286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bac27011fc4bce9e391ad7915048b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.877270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c0da09e-e6d6-4094-aa3b-ea7adbeede7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bac27011fc4bce9e391ad7915048b2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:17.906834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1246/2474] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:17 2022] DELETE /identity/v3/users/e1bac27011fc4bce9e391ad7915048b2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:18.748466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:18.750778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:18.783397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf9557-fa52-43a4-ad8b-503664e46274 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:19.093041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:19.099586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:19.099586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:19.099586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] PATH_INFO: `/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:19.101262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5048aae9b0e493da6cf3bb93ed29b3c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:19.113522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:19.432796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5048aae9b0e493da6cf3bb93ed29b3c', 'request_id': 'req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:19.459849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5048aae9b0e493da6cf3bb93ed29b3c', 'request_id': 'req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:19.575976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5048aae9b0e493da6cf3bb93ed29b3c', 'request_id': 'req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:19.598189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] The token cache is being invalidate because project f5048aae9b0e493da6cf3bb93ed29b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:19.600233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:19.602330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a4b089c-6c51-4af3-8638-50d8ef11f4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:19.613676 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1229/2475] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:18 2022] DELETE /identity/v3/projects/f5048aae9b0e493da6cf3bb93ed29b3c => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:19.618850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:19.619879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:19.626980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:19.684852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:19.695572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:19.921733 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:19.975592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1247/2476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:19.984081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:19.985664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:19.985664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.048468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:20.049754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:20.091117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.092586 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1230/2477] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:20.122997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5ea2-668b-4b88-97cf-1d5a92df34d2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.142523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.151180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.153732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.154259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.155418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:20.156562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.163320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:20.219017 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1248/2478] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:19:20.223111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.239412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74e1c-8aef-4ab3-9139-bee0c38ccc0d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.258478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.259440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.259904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.260338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.261223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.266081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:20.398592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1231/2479] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:20 2022] POST /identity/v3/projects => generated 393 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:19:20.403928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.429695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab68e10-1504-466f-89d7-ac2aea581e06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.620407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.621791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.622096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.623667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.624363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.627687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:20.668210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.670354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:20.712208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2ff6-0194-4909-8639-dd9143c3730e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.733039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.734220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.734460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.734801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] PATH_INFO: `/v3/users/7cf383913f454705857bbcaff2430415` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.741711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf383913f454705857bbcaff2430415)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.741711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:20.774872 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1249/2480] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:20 2022] POST /identity/v3/users => generated 297 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:20.775946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.827221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fcfa4-5a6a-498a-8572-013d77cc694c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.856212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.860373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.860373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.860373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.865725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.879049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:20.919711 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1250/2481] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:20.920758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:20.961204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85274ef1-852c-482f-a0e6-909d0f334d06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:20.973017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:20.978639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:20.979300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:20.979789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:20.980672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:20.982747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:21.013797 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1251/2482] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:21.017870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:21.054789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c830-5fee-4106-aea5-90821ab23e73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:21.067022 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:21.079108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:21.080564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf383913f454705857bbcaff2430415'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:21.085287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf383913f454705857bbcaff2430415'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:21.087529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:21.088372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:21.088473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] PATH_INFO: `/v3/projects/8c9fa6465cb74679921935af37294eca/users/d815becbdc9d40e8b0ab90e97488018a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:21.115279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf383913f454705857bbcaff2430415'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:21.124594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf383913f454705857bbcaff2430415'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:21.135645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9fa6465cb74679921935af37294eca, user_id=d815becbdc9d40e8b0ab90e97488018a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:21.138374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e073057-5a17-4eb8-bd6a-b2ab61992071 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:21.190924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fb057a6-a7e1-4012-ba95-066d7fc166ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf383913f454705857bbcaff2430415'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:21.216302 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1252/2483] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:21 2022] PUT /identity/v3/projects/8c9fa6465cb74679921935af37294eca/users/d815becbdc9d40e8b0ab90e97488018a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:21.227949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:21.228666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:21.229112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:21.260891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1232/2484] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:20 2022] DELETE /identity/v3/users/7cf383913f454705857bbcaff2430415 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:21.321310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] MFA Rules not processed for user `d815becbdc9d40e8b0ab90e97488018a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:21.329214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:21.464398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aea24-3e64-48bd-b20e-5c5eec2c3ad1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:21.465745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aea24-3e64-48bd-b20e-5c5eec2c3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:21.465745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aea24-3e64-48bd-b20e-5c5eec2c3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:21.557650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1253/2485] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:21.562417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:21.563589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5c7aea24-3e64-48bd-b20e-5c5eec2c3ad1 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:21.565607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5c7aea24-3e64-48bd-b20e-5c5eec2c3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:21.570457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:21.642183 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:21.728944 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1233/2486] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:21.740748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:21.741905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:21.742340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:21.791367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:21.795683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:21.823209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1234/2487] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:21.835659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:21.840974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:21.856882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cb508-94a4-43b9-9848-e5f2488f2abf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:21.869180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:21.869896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:21.870176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:21.870448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:21.871090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:21.878031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.016763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690e94c-5117-4307-8ce2-dd9a8f7e4318 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.017700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1254/2488] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:21 2022] POST /identity/v3/projects => generated 393 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:19:22.021006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.119404 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:22.153089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eca5ab-a1ab-4eb1-8358-e9e3aaeee257 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.159229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.160028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.160436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.161752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.166703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.169412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.189459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.190070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.191738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.192568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.272063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1255/2489] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:22 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:22.283966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.287836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:22.340791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ad65-2b89-44e4-8020-70732ce4bdd8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.359353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.361395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.367237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.367963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.368253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.368531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] PATH_INFO: `/v3/projects/b3431d70803b488094810a5defb63faa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.371271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3431d70803b488094810a5defb63faa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.373914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.380461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1235/2490] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:22.381427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.401293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f830f2f-76c2-4d54-9fbc-e51af647a68c service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.408733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.409767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.410306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.410926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.412323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.415622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.433777 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1236/2491] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:22.436477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.470058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ec8f7-4812-4ab9-b0ff-2f4fc1f456df admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.481682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.483661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.484018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.484360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] PATH_INFO: `/v3/projects/68d62691454a417da77320f6f8c2957c/users/d6cf8d92d1394fc78066bde19458624d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.514137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d62691454a417da77320f6f8c2957c, user_id=d6cf8d92d1394fc78066bde19458624d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.517400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.614037 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1237/2492] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:22 2022] PUT /identity/v3/projects/68d62691454a417da77320f6f8c2957c/users/d6cf8d92d1394fc78066bde19458624d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:22.618599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.629636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3431d70803b488094810a5defb63faa', 'request_id': 'req-c7340c5d-6b67-49b9-9d60-53711f9bd723'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:22.729728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3431d70803b488094810a5defb63faa', 'request_id': 'req-c7340c5d-6b67-49b9-9d60-53711f9bd723'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:22.743153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3431d70803b488094810a5defb63faa', 'request_id': 'req-c7340c5d-6b67-49b9-9d60-53711f9bd723'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:22.767930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] The token cache is being invalidate because project b3431d70803b488094810a5defb63faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:22.768480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe400da-5f7a-41c7-b7b5-f1e3406049ed admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.768730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:22.773481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:22.775473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1256/2493] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:22 2022] DELETE /identity/v3/projects/b3431d70803b488094810a5defb63faa => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:22.779457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.784018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:22.793068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:22.862263 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:22.880255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.881054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.881358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.882530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.883165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.884785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:22.917385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1238/2494] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:22.921099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:22.927632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340c5d-6b67-49b9-9d60-53711f9bd723 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:22.927818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:22.945409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:22.946521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:22.946968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:22.947371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] PATH_INFO: `/v3/users/f74afecc02d54f7c8646b45bd11c739a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:22.950678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74afecc02d54f7c8646b45bd11c739a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:22.955167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:23.062035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935b2c9-b521-4248-a848-9a67fb2cafae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:23.072353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:23.072970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:23.073276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:23.073580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:23.075434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:23.093152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:23.095193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:23.108121 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1239/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:23.109905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:23.114230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:23.157253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcbe0a-d8d4-41ca-9c8d-08b9e1c21ba5 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:23.166154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:23.167909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:23.167909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:23.167909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] PATH_INFO: `/v3/projects/68d62691454a417da77320f6f8c2957c/users/d6cf8d92d1394fc78066bde19458624d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:23.174720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d62691454a417da77320f6f8c2957c, user_id=d6cf8d92d1394fc78066bde19458624d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:23.187358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062319db-38ca-49f7-b68e-ca80670da754 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:23.191794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74afecc02d54f7c8646b45bd11c739a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:23.215349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1240/2496] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:23 2022] PUT /identity/v3/projects/68d62691454a417da77320f6f8c2957c/users/d6cf8d92d1394fc78066bde19458624d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:23.228729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:23.241914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:23.243048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:23.261765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74afecc02d54f7c8646b45bd11c739a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:23.263488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74afecc02d54f7c8646b45bd11c739a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:23.316925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74afecc02d54f7c8646b45bd11c739a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:23.360279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-745723a9-f8a5-413d-a41b-a82f8b9419af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74afecc02d54f7c8646b45bd11c739a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:23.385402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1257/2497] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:22 2022] DELETE /identity/v3/users/f74afecc02d54f7c8646b45bd11c739a => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:23.407574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] MFA Rules not processed for user `d6cf8d92d1394fc78066bde19458624d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:23.409078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:23.611737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1241/2498] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:23.623456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:23.623456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:23.623456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:23.670645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] MFA Rules not processed for user `d815becbdc9d40e8b0ab90e97488018a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:23.670645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:23.874202 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1258/2499] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:19:24.275518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:24.277917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:24.383137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:24.384758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:24.525031 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:24.546400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846ad2a-5da7-4a6f-b225-3d8faadbf24f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:24.548570 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:24.581461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:24.582156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:24.582433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:24.582822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:24.592125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:24.654152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:24.666114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:24.698718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e38d-37eb-4985-8e1c-2b707f508149 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:24.722767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1242/2500] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:24.732166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:24.734638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:24.742378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:24.747160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:24.758201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:24.762125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] PATH_INFO: `/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:24.764442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=601c87637cdc4ccaa16a6b2cd00d91b0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:24.769067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:24.795139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ec229-aef1-486e-b00e-10cf459d69f4 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:24.811194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:24.811652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:24.811933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:24.812208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:24.818495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:24.839571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:24.842679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22e83f-cdc9-42b3-a0eb-d94619a99d34 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:24.856867 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1243/2501] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:24.931751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601c87637cdc4ccaa16a6b2cd00d91b0', 'request_id': 'req-22f3f725-6492-495a-9305-4d9177c01edb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:25.005518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601c87637cdc4ccaa16a6b2cd00d91b0', 'request_id': 'req-22f3f725-6492-495a-9305-4d9177c01edb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:25.016704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601c87637cdc4ccaa16a6b2cd00d91b0', 'request_id': 'req-22f3f725-6492-495a-9305-4d9177c01edb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:25.064421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] The token cache is being invalidate because project 601c87637cdc4ccaa16a6b2cd00d91b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:25.066648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:25.068509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-22f3f725-6492-495a-9305-4d9177c01edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:25.073942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1259/2502] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:24 2022] DELETE /identity/v3/projects/601c87637cdc4ccaa16a6b2cd00d91b0 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:25.079288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.079574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.079853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.108371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:25.109892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:25.301919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1244/2503] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:25.309163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6946-a024-4bc8-a033-469667cef559 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.309721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6946-a024-4bc8-a033-469667cef559 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.310152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c6946-a024-4bc8-a033-469667cef559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.341228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-102c6946-a024-4bc8-a033-469667cef559 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:25.344003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-102c6946-a024-4bc8-a033-469667cef559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:25.363285 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1260/2504] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:25.368104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:25.383145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c977326-51e5-418d-a771-9e9f38fb6012 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:25.394106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:25.395009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.395439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.395873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.396532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:25.396830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:25.398497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:25.428102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1245/2505] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:19:25.432942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6946-a024-4bc8-a033-469667cef559 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:25.443093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c6946-a024-4bc8-a033-469667cef559 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:25.462809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:25.468699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.468988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.469261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.472584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:25.472584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:25.630455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:25.633680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1261/2506] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:25 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:25.643007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5f4d5-1aee-46dd-9bfc-270c7d2f0333 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:25.758619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:25.759252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.759573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.759849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.760598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:25.763230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:25.880140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:25.883271 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1246/2507] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:25 2022] POST /identity/v3/users => generated 281 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:25.904717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4693e0-5dd6-4dfc-a44c-ba86ed17d719 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:25.916142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:25.917118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:25.917612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:25.918040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:25.919758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:25.926011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:25.962681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1262/2508] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:25.964516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:25.982909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df468f12-de30-4fa8-90c9-78763a046406 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:25.999172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:26.001557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:26.001557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:26.004011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:26.006830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:26.009027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172c716-4d15-4a7e-bbc4-d5f69fec3f2c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:26.036021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1247/2509] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:26.041139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:26.054421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233839d-e7c5-4e9c-9bf2-06cb38f15bf3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:26.060859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:26.067794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:26.067794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:26.067794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] PATH_INFO: `/v3/projects/18111defc51f4132bf4a5ce8b0dc2461/users/31a1872c0dce424a851906a67ecb622b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:26.112421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18111defc51f4132bf4a5ce8b0dc2461, user_id=31a1872c0dce424a851906a67ecb622b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:26.116179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:26.228830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1263/2510] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:26 2022] PUT /identity/v3/projects/18111defc51f4132bf4a5ce8b0dc2461/users/31a1872c0dce424a851906a67ecb622b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:26.314351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:26.315231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:26.315978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:26.383721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] MFA Rules not processed for user `31a1872c0dce424a851906a67ecb622b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:26.385168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:26.464179 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:26.591348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:26.599384 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1248/2511] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:26.718460 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:26.725617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606549d8-27e6-4c81-82ee-ff8cd2c64056 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:26.731392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:26.732273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:26.733833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:26.733833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:26.734165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:26.737483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:26.842522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1264/2512] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:26 2022] POST /identity/v3/projects => generated 361 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:26.846437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:26.862714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d17673-e170-4500-ae1f-3be76a36c352 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:26.989659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:26.990425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:26.990807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:26.992208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:26.992550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:26.994808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:27.121153 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1249/2513] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:26 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:19:27.125142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:27.153402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e044d8-b15d-43f3-8df9-a503ec1d9385 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:27.177845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:27.179385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:27.181519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:27.182113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:27.184942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:27.192925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:27.236077 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1265/2514] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:27.236510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:27.251668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d8678-3427-4146-9a76-e46a712fabfd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:27.266316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:27.269713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:27.269713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:27.269713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] PATH_INFO: `/v3/projects/f63b67463aa949e489e25511b17a2ad8/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:27.321312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63b67463aa949e489e25511b17a2ad8, user_id=8b2e4ce3dd6445fbb6e4a9ff8b5727f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:27.327140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:27.431419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1250/2515] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:27 2022] PUT /identity/v3/projects/f63b67463aa949e489e25511b17a2ad8/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:27.435545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:27.463520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727ab7b-98c5-40c1-ba5e-461a864af0b5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:27.612473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:27.613870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:27.614394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:27.619909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:27.619909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:27.619909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705db9ff-98a8-4690-a847-f01b4ab812ea admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:27.635051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1266/2516] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:27.639159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:27.652164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0357-f9c1-4f53-a6f1-06cd2c53ce97 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:27.658482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:27.659372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:27.659808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:27.660136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] PATH_INFO: `/v3/projects/f63b67463aa949e489e25511b17a2ad8/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:27.662621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63b67463aa949e489e25511b17a2ad8, user_id=8b2e4ce3dd6445fbb6e4a9ff8b5727f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:27.666886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:27.684893 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1251/2517] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:27 2022] PUT /identity/v3/projects/f63b67463aa949e489e25511b17a2ad8/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:27.696917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:27.697369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:27.697754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:27.804247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] MFA Rules not processed for user `8b2e4ce3dd6445fbb6e4a9ff8b5727f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:27.809830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:28.057875 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1267/2518] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:28.066281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:28.068091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:28.174194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d992-80c0-4fd0-bffa-7de67f53701b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:28.185158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:28.185158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:28.185158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:28.185158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:28.185671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:28.198824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:28.200796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:28.215527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1252/2519] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:28.282543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:28.286306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:28.316068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b9d2b-29ca-4518-a92f-4c59068cd0e3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:28.332287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:28.334859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:28.334859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:28.334859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:28.345398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:28.347016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:28.365536 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1268/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:30.248662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:30.263204 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:30.362327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a5969-0873-450c-b15e-78326c119e40 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:30.377912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:30.378713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:30.379004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:30.380089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] PATH_INFO: `/v3/users/31a1872c0dce424a851906a67ecb622b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:30.383208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a1872c0dce424a851906a67ecb622b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:30.389415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:30.701789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a1872c0dce424a851906a67ecb622b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:30.702743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a1872c0dce424a851906a67ecb622b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:30.717865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a1872c0dce424a851906a67ecb622b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:30.718737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a1872c0dce424a851906a67ecb622b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:30.750718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:30.764468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e06e2-59c1-4fca-a1a5-dc0e1cc1ca83 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:30.780695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:30.781319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:30.793208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:30.793208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:30.793208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:30.861510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9c0c2f1-ac0b-449d-99a4-31373c8357b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a1872c0dce424a851906a67ecb622b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:30.882984 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:30.901963 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1253/2521] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:30 2022] DELETE /identity/v3/users/31a1872c0dce424a851906a67ecb622b => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:30.904367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:30.904697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:30.904974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:30.934703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:30.935998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:30.937511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:30.939811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:30.968235 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1269/2522] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:31.061512 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1254/2523] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:31.076195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:31.078228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:31.168388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed0a0d-1774-4635-a898-ecddbb6375fb service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:31.294128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:31.295066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:31.295357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:31.295635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:31.320503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:31.322584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:31.339136 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1270/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:32.537440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:32.539003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:32.566665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be0eb9-0870-45a6-8830-a2118e70514c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:32.580375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:32.582423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:32.583013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:32.583458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] PATH_INFO: `/v3/projects/18111defc51f4132bf4a5ce8b0dc2461` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:32.585587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18111defc51f4132bf4a5ce8b0dc2461)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:32.588913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:32.668009 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:32.830341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18111defc51f4132bf4a5ce8b0dc2461', 'request_id': 'req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:32.838060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18111defc51f4132bf4a5ce8b0dc2461', 'request_id': 'req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:32.913824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18111defc51f4132bf4a5ce8b0dc2461', 'request_id': 'req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:32.933987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] The token cache is being invalidate because project 18111defc51f4132bf4a5ce8b0dc2461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:32.934284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:32.937108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:32.941201 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1255/2525] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:32 2022] DELETE /identity/v3/projects/18111defc51f4132bf4a5ce8b0dc2461 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:32.945604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:32.962929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffce2af-24d5-49f8-ae46-b9ff4150d637 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:33.063222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:33.064675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:33.064976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:33.065254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] PATH_INFO: `/v3/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:33.067902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2e4ce3dd6445fbb6e4a9ff8b5727f1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:33.070414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:33.714831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:33.716874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:33.836101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae602c5-832a-4629-ab87-c95e3bc2bcd1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:33.844773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:33.845436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:33.845716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:33.845982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:33.848547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:33.934567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:33.936646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:33.965698 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1256/2526] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:19:34.211277 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:34.231453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2e4ce3dd6445fbb6e4a9ff8b5727f1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:34.371149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2e4ce3dd6445fbb6e4a9ff8b5727f1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:34.373456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2e4ce3dd6445fbb6e4a9ff8b5727f1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:34.398492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2e4ce3dd6445fbb6e4a9ff8b5727f1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:34.415977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2e4ce3dd6445fbb6e4a9ff8b5727f1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:34.432000 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1271/2527] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:32 2022] DELETE /identity/v3/users/8b2e4ce3dd6445fbb6e4a9ff8b5727f1 => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:34.490275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:34.492448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:34.648689 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:34.743570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd380-7444-4b3d-848e-bd3772f3ae7b service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:34.907682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:34.913539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:34.913539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:34.913539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:34.914660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:34.931118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:34.934506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb202d-df88-4221-9957-097c3450c246 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:34.948367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1257/2528] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:35.335732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:35.337693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:35.538535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c07220-650c-4e53-badb-24cdebe331d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:35.550850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:35.553918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:35.553918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:35.553918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] PATH_INFO: `/v3/projects/f63b67463aa949e489e25511b17a2ad8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:35.554171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63b67463aa949e489e25511b17a2ad8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:35.567170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:35.821274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63b67463aa949e489e25511b17a2ad8', 'request_id': 'req-ea595a59-c0c5-43d0-9c6b-1833d8691175'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:35.980728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63b67463aa949e489e25511b17a2ad8', 'request_id': 'req-ea595a59-c0c5-43d0-9c6b-1833d8691175'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:35.993114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63b67463aa949e489e25511b17a2ad8', 'request_id': 'req-ea595a59-c0c5-43d0-9c6b-1833d8691175'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:36.014675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] The token cache is being invalidate because project f63b67463aa949e489e25511b17a2ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:36.014908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:36.015427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ea595a59-c0c5-43d0-9c6b-1833d8691175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:36.017126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1272/2529] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:35 2022] DELETE /identity/v3/projects/f63b67463aa949e489e25511b17a2ad8 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:36.022437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.022986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.023281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.047814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:36.050309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:36.174691 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1258/2530] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:19:36.183800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.184165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.184515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.208371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:36.231671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:36.261073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:36.272288 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1273/2531] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:19:36.273905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718c31-19c7-48bb-a7d0-e3ddf0d60f0b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:36.279219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:36.283049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.283049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.283049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.283049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:36.283049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:36.284177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:36.305768 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1259/2532] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:19:36.307146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:36.319185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc33d51-1bd0-4b39-b21d-ffcf227991da None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:36.324365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:36.325001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.325278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.325710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.326373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:36.328284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:36.497453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1274/2533] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:36 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:36.498489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:36.514735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244158-e6ae-43ca-afbc-3e78e0653610 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:36.657600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:36.658375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.664862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.664862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.664862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:36.664862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:36.826959 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1260/2534] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:36 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:19:36.831094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:36.845678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a14e6d-1453-4f30-9719-2f75227ef108 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:36.860619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:36.861973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.863429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.863636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.871301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:36.871301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:36.917060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1275/2535] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:36.918334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:36.929922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9e52a-b836-4696-8784-8742d7d0af8b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:36.936177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:36.936784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:36.945509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:36.945509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:36.945509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:36.945509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae39a-2c9a-4803-b7a6-2b3950c1e60c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:36.984685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1261/2536] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:36.994418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:37.000294 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:37.024737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac2621-35db-4bc0-a414-d1c6ab5a8f1e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:37.045845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:37.046632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.046990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.047276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] PATH_INFO: `/v3/projects/913a5f5af92742d98b80280f18ae521b/users/6b17c878d38b4639a4ae0ade7e955c5a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.072264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913a5f5af92742d98b80280f18ae521b, user_id=6b17c878d38b4639a4ae0ade7e955c5a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:37.076236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:37.153722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1276/2537] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:36 2022] PUT /identity/v3/projects/913a5f5af92742d98b80280f18ae521b/users/6b17c878d38b4639a4ae0ade7e955c5a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:37.165403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.165403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.165881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.246140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] MFA Rules not processed for user `6b17c878d38b4639a4ae0ade7e955c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:37.247434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:37.355541 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1262/2538] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:37.360359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:37.376813 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:37.462725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27c26f-38fa-4d01-ad91-9e0e578d1294 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:37.470612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:37.471910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.472198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.472478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.473120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:37.475254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82264bed-2fee-4f25-bb70-22baaf6f6a85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:37.629684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1277/2539] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:37 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:37.634032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:37.654578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259f51-e236-4d42-8f00-6efc4b424132 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:37.694536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.695115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.695115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.771117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] MFA Rules not processed for user `4f1fe6e04e064dfba969b07d4188ab38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:37.775512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:37.784649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:37.785779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.786276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.786766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.787629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:37.796957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:37.906378 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1263/2540] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:37 2022] POST /identity/v3/users => generated 299 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:37.910101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:37.924943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98372ee6-e350-4c8d-9dfb-1ccc9d10c10e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:37.931701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:37.940314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.940314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.940314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.940314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:37.940314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:37.943721 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1278/2541] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:19:37.952993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1264/2542] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:19:37.958051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:37.970215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d54b-f81c-4a48-81fd-b2349f7c6785 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:37.975182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:37.975954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:37.976234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:37.976507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] PATH_INFO: `/v3/projects/ef5250811b57453d84e798329dbe4756/users/3ed9bf391eb245d98c55f202499b5b99/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:37.993007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5250811b57453d84e798329dbe4756, user_id=3ed9bf391eb245d98c55f202499b5b99, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:37.995833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:38.105886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1279/2543] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:37 2022] PUT /identity/v3/projects/ef5250811b57453d84e798329dbe4756/users/3ed9bf391eb245d98c55f202499b5b99/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:38.108321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:38.125601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1208fe-f934-44ed-add7-8ba965e3b6c7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:38.224004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:38.224666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:38.225008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:38.225643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:38.226798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:38.228795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7e973-6470-4226-ad56-62a25f113763 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:38.243981 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1265/2544] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:38.245540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:38.257904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6690-2fc6-42e3-a1ff-388cf2a602f5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:38.263185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:38.263858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:38.264144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:38.264441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] PATH_INFO: `/v3/projects/ef5250811b57453d84e798329dbe4756/users/3ed9bf391eb245d98c55f202499b5b99/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:38.266469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5250811b57453d84e798329dbe4756, user_id=3ed9bf391eb245d98c55f202499b5b99, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:38.269176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:38.281922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1280/2545] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:38 2022] PUT /identity/v3/projects/ef5250811b57453d84e798329dbe4756/users/3ed9bf391eb245d98c55f202499b5b99/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:38.295955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:38.295955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:38.295955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:38.329191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] MFA Rules not processed for user `3ed9bf391eb245d98c55f202499b5b99`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:38.330932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:38.419477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1266/2546] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:38.546205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:38.553515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:38.661739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd06f83-b3d6-48fa-a043-34409ffd5443 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:38.668104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:38.668803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:38.669148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:38.669647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:38.680487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:38.682987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:38.697638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1281/2547] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:39.279335 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:39.822076 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:41.075662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:41.077856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:41.190634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b547-4c11-47a1-95c8-492f58099e0d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:41.198680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:41.202774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:41.203382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:41.203805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:41.206233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:41.379418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:41.381748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e140439-a754-4328-ad23-f45eafbdb85e service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:41.422581 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1267/2548] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:42.576622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:42.702487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec4332-d823-4432-b730-9f3d330b8f25 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:42.708296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:42.709234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:42.711457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:42.711457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] PATH_INFO: `/v3/users/6b17c878d38b4639a4ae0ade7e955c5a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:42.711457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b17c878d38b4639a4ae0ade7e955c5a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:42.714810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:43.001174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b17c878d38b4639a4ae0ade7e955c5a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:43.131126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b17c878d38b4639a4ae0ade7e955c5a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:43.131785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b17c878d38b4639a4ae0ade7e955c5a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:43.169420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b17c878d38b4639a4ae0ade7e955c5a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:43.180499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b17c878d38b4639a4ae0ade7e955c5a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:43.195554 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1282/2549] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:42 2022] DELETE /identity/v3/users/6b17c878d38b4639a4ae0ade7e955c5a => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:43.200104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb5fb-e323-4b96-9117-e1b630097b19 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:43.209139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb5fb-e323-4b96-9117-e1b630097b19 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:43.209139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb5fb-e323-4b96-9117-e1b630097b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:43.241166 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:43.252589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ed1bb5fb-e323-4b96-9117-e1b630097b19 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:43.255538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed1bb5fb-e323-4b96-9117-e1b630097b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:43.330429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1268/2550] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:43.346121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:43.346121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:43.415128 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:43.485356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f765ec-af63-42cb-9c90-7f64af8ec6ae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:43.503654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:43.504584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:43.505930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:43.506317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:43.523726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:43.523726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:43.562808 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1283/2551] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:44.227289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:44.227898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:44.227898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:44.247673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] MFA Rules not processed for user `c114d44d0a314c75902da53fca797f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:44.248888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:44.313913 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1269/2552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:44.955982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:44.957898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:44.971526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bc079-90ae-4d46-9366-b2d53e26b7e2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:44.977245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:44.978157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:44.978440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:44.978714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] PATH_INFO: `/v3/projects/913a5f5af92742d98b80280f18ae521b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:44.980500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913a5f5af92742d98b80280f18ae521b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:44.982625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:45.232108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913a5f5af92742d98b80280f18ae521b', 'request_id': 'req-327cf14e-5055-4479-9793-0249939d7912'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.387193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913a5f5af92742d98b80280f18ae521b', 'request_id': 'req-327cf14e-5055-4479-9793-0249939d7912'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.401962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913a5f5af92742d98b80280f18ae521b', 'request_id': 'req-327cf14e-5055-4479-9793-0249939d7912'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.444172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] The token cache is being invalidate because project 913a5f5af92742d98b80280f18ae521b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:45.444172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.444928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.454576 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1284/2553] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:44 2022] DELETE /identity/v3/projects/913a5f5af92742d98b80280f18ae521b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:45.458751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:45.474684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ee77c-20df-49b6-bae2-46fd5b5e4597 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:45.622285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:45.622843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:45.623126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:45.623479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] PATH_INFO: `/v3/users/3ed9bf391eb245d98c55f202499b5b99` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:45.624522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed9bf391eb245d98c55f202499b5b99)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:45.626556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:45.963435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed9bf391eb245d98c55f202499b5b99'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.965569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed9bf391eb245d98c55f202499b5b99'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.972392 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:45.975313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed9bf391eb245d98c55f202499b5b99'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:45.976954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed9bf391eb245d98c55f202499b5b99'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:46.090807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-639684e4-df0f-4446-b423-5e90973023ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed9bf391eb245d98c55f202499b5b99'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:46.138743 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1270/2554] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:45 2022] DELETE /identity/v3/users/3ed9bf391eb245d98c55f202499b5b99 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:47.047104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:47.047104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:47.061243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cf14e-5055-4479-9793-0249939d7912 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:47.149954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:47.150681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:47.151256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:47.151620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] PATH_INFO: `/v3/projects/ef5250811b57453d84e798329dbe4756` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:47.152836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5250811b57453d84e798329dbe4756)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:47.154890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:47.344365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5250811b57453d84e798329dbe4756', 'request_id': 'req-986b5e84-5711-42f8-932f-5df66fbb5877'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:47.399183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5250811b57453d84e798329dbe4756', 'request_id': 'req-986b5e84-5711-42f8-932f-5df66fbb5877'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:47.407165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5250811b57453d84e798329dbe4756', 'request_id': 'req-986b5e84-5711-42f8-932f-5df66fbb5877'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:47.419660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] The token cache is being invalidate because project ef5250811b57453d84e798329dbe4756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:47.419953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:47.420631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-986b5e84-5711-42f8-932f-5df66fbb5877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:47.422992 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1285/2555] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:47 2022] DELETE /identity/v3/projects/ef5250811b57453d84e798329dbe4756 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:47.427927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:47.428463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:47.428554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:47.473937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:47.479328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:47.547436 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1271/2556] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:47.556506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:47.556814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:47.557075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:47.581851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:47.583663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:47.597458 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1286/2557] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:47.598346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:47.623226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3d9d-7935-47fa-9079-5e88c2bdac7b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:47.632671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:47.634329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:47.634726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:47.635115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:47.635928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:47.636659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:47.638738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:47.668175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1272/2558] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:19:47.677614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:47.686413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a685e8a-5f57-411d-b4d2-45090efede3b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:47.691620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:47.692323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:47.692670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:47.693187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:47.693988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:47.696747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:47.881299 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:47.894701 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1287/2559] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:47 2022] POST /identity/v3/projects => generated 409 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:47.899670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:47.913594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08be9f8-6531-482e-a4bb-72293873fdc9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.056805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.057548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.058360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.058360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.059583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.063580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:48.189738 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1273/2560] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:47 2022] POST /identity/v3/users => generated 305 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:48.192370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:48.205797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdbed4-1d1b-44ac-a82a-c62fa46513bc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.220586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.220586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.220586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.220586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.221373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.221373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:48.230283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1288/2561] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:19:48.234523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:48.246787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a331e3-bc27-44dd-8c54-b794277c8ac6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.252530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.253436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.253809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.254232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.255421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.257608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48d857-a531-4723-88a0-4a447f54d00d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:48.275071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1274/2562] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:48.276335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:48.288761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6fa9c-62b7-47a3-890b-1dedcd6774b1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.295010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.295010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.295335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.295642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] PATH_INFO: `/v3/projects/966f4fbff2ff4dbd9ed1745bcdd296c6/users/2085728a9cef4869856b9150ccd4e9f7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.311797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=966f4fbff2ff4dbd9ed1745bcdd296c6, user_id=2085728a9cef4869856b9150ccd4e9f7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.314698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:48.497236 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1289/2563] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:48 2022] PUT /identity/v3/projects/966f4fbff2ff4dbd9ed1745bcdd296c6/users/2085728a9cef4869856b9150ccd4e9f7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:48.508913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.509479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.509603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.539285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] MFA Rules not processed for user `2085728a9cef4869856b9150ccd4e9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:48.540540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:48.611112 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1275/2564] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:48.616537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:48.627384 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:48.680583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8e809-2368-4e24-abb4-e5dcfb2329ec admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.687479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.688095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.688377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.688666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.689294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.691470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:48.811018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:48.817328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1290/2565] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:48 2022] POST /identity/v3/projects => generated 409 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:48.824862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbab178-b277-4b38-91ab-a6785ec88677 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:48.910430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:48.911134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:48.911484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:48.911828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:48.912560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:48.914682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:49.075204 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1276/2566] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:48 2022] POST /identity/v3/users => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:49.077884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:49.089236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2428ab-6b81-4bfc-b61e-cde642f8e13f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:49.096721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:49.097636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.098087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.098512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.099458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:49.101430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:49.116318 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1291/2567] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:49.123127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:49.134108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96ecaf-1407-4650-b8bb-45c7758e3c35 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:49.139143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:49.140701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.141066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.141434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] PATH_INFO: `/v3/projects/59130d0fb0744f5199915ef76db90f97/users/23a192891ff54607b91c3d25d3585507/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.164586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59130d0fb0744f5199915ef76db90f97, user_id=23a192891ff54607b91c3d25d3585507, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:49.167786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:49.361039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1277/2568] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:49 2022] PUT /identity/v3/projects/59130d0fb0744f5199915ef76db90f97/users/23a192891ff54607b91c3d25d3585507/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:49.365640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:49.382245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35efa6-2437-4430-941b-bd6c89395b6c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:49.457989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:49.458608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.458887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.459157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.459800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:49.462218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc20f0-d1f8-48ad-aea5-76ce4f7c52f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:49.481402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1292/2569] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:19:49.483852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:49.514464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaff9c-d05d-40b2-b47a-08c6626e4d59 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:49.518195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:49.519091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.519772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.520341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] PATH_INFO: `/v3/projects/59130d0fb0744f5199915ef76db90f97/users/23a192891ff54607b91c3d25d3585507/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.522924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] RBAC: Authorizing `identity:create_grant(project_id=59130d0fb0744f5199915ef76db90f97, user_id=23a192891ff54607b91c3d25d3585507, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:49.526850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:49.549386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1278/2570] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:49 2022] PUT /identity/v3/projects/59130d0fb0744f5199915ef76db90f97/users/23a192891ff54607b91c3d25d3585507/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:19:49.552278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fc216-ae2d-4ef2-972a-6fff88660f82 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.552574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fc216-ae2d-4ef2-972a-6fff88660f82 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.552866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fc216-ae2d-4ef2-972a-6fff88660f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.589820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-eb5fc216-ae2d-4ef2-972a-6fff88660f82 None None] MFA Rules not processed for user `23a192891ff54607b91c3d25d3585507`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:49.591555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb5fc216-ae2d-4ef2-972a-6fff88660f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:49.684124 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1293/2571] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:49.692369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:49.775925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53af85-c003-4a18-8234-9c588d54dbff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:49.778514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:49.779487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:49.779925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:49.780387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] PATH_INFO: `/v3/users/2085728a9cef4869856b9150ccd4e9f7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:49.782382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2085728a9cef4869856b9150ccd4e9f7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:49.785756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:50.143680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2085728a9cef4869856b9150ccd4e9f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:50.147198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2085728a9cef4869856b9150ccd4e9f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:50.156155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2085728a9cef4869856b9150ccd4e9f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:50.157187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2085728a9cef4869856b9150ccd4e9f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:50.285063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2085728a9cef4869856b9150ccd4e9f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:50.357815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1279/2572] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:49 2022] DELETE /identity/v3/users/2085728a9cef4869856b9150ccd4e9f7 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:50.358425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:50.358862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:50.359103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:50.399315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:50.400529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:50.471222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1294/2573] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:19:50.483370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:50.484792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:50.554428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9be2e-336a-4ca4-b323-c69a28f42d3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:50.558966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:50.559587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:50.559869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:50.560171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:50.572604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:50.577169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:50.589092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1280/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:51.305830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:51.305830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:51.318629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f940aa-113d-4607-9cbc-39a92c71eb95 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:51.326063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:51.327166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:51.327550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:51.328047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] PATH_INFO: `/v3/projects/966f4fbff2ff4dbd9ed1745bcdd296c6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:51.331087 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:51.334263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966f4fbff2ff4dbd9ed1745bcdd296c6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:51.337113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:51.528761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966f4fbff2ff4dbd9ed1745bcdd296c6', 'request_id': 'req-b156ef41-1cf5-497a-aca1-355c11bf1333'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:51.690373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966f4fbff2ff4dbd9ed1745bcdd296c6', 'request_id': 'req-b156ef41-1cf5-497a-aca1-355c11bf1333'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:51.709429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966f4fbff2ff4dbd9ed1745bcdd296c6', 'request_id': 'req-b156ef41-1cf5-497a-aca1-355c11bf1333'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:51.734452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] The token cache is being invalidate because project 966f4fbff2ff4dbd9ed1745bcdd296c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:51.737161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:51.738324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b156ef41-1cf5-497a-aca1-355c11bf1333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:51.750000 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1295/2575] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:51 2022] DELETE /identity/v3/projects/966f4fbff2ff4dbd9ed1745bcdd296c6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:51.754651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:51.765229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:51.765857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:51.767708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:51.770822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea770d94-f36b-4c0b-a665-91dc19b56345 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:51.811542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:51.818311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:51.841633 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:51.863376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:51.864096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:51.864885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:51.865455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] PATH_INFO: `/v3/users/23a192891ff54607b91c3d25d3585507` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:51.867983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a192891ff54607b91c3d25d3585507)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:51.870497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:51.919304 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1296/2576] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:52.149874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a192891ff54607b91c3d25d3585507'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:52.150633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a192891ff54607b91c3d25d3585507'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:52.158404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a192891ff54607b91c3d25d3585507'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:52.160785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a192891ff54607b91c3d25d3585507'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:52.278861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a192891ff54607b91c3d25d3585507'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:52.299045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1281/2577] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:19:51 2022] DELETE /identity/v3/users/23a192891ff54607b91c3d25d3585507 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:52.636643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:52.642209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:52.764509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf3a60-583d-4efc-bed4-7d9c1fffd30e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:52.945651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:52.949160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:52.950702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:52.951907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:52.959098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:52.984920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:52.986868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b7dc86-9bd0-43b7-8854-260e0043ae72 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:53.002414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1297/2578] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:53.004995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:53.006644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:53.165725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0b5a0-4311-4482-b54a-5280a8098491 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:53.182501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:53.182501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:53.182501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:53.182501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] PATH_INFO: `/v3/projects/59130d0fb0744f5199915ef76db90f97` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:53.183159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=59130d0fb0744f5199915ef76db90f97)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:53.183159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:53.364519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59130d0fb0744f5199915ef76db90f97', 'request_id': 'req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:53.376831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59130d0fb0744f5199915ef76db90f97', 'request_id': 'req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:53.457188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59130d0fb0744f5199915ef76db90f97', 'request_id': 'req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:53.483640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] The token cache is being invalidate because project 59130d0fb0744f5199915ef76db90f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:19:53.484576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:53.486461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6ec1f25-7cba-44cc-97ba-b2f3f610a2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:19:53.489777 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1282/2579] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:19:53 2022] DELETE /identity/v3/projects/59130d0fb0744f5199915ef76db90f97 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:53.496364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:53.496704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:53.496980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:53.528020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:53.529778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:53.615248 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1298/2580] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:53.623735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:53.624609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:53.625222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:53.654419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:53.656829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:53.669785 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1283/2581] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:53.672328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:53.691151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce80ab-d5fb-4ccd-ae7e-8eeb4603135c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:53.715866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:53.716210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:53.717270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:53.717270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:53.717541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:19:53.720738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:53.720738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:53.751020 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1299/2582] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:19:53.755252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:53.765319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc5bee-da4b-4180-9825-e01578999784 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:53.780152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:53.781511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:53.782049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:53.784718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:53.784718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:53.787456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:53.934147 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1284/2583] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:19:53 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:53.939987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:53.961585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8b59-12c0-4c0a-8f8d-683d869dd235 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:53.977362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:54.104535 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:54.105813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:54.106519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.106878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.107365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.108304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:54.114489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:54.209572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1300/2584] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:19:53 2022] POST /identity/v3/users => generated 295 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:19:54.213889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:54.246869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7902371-dd51-4f76-a283-94f925f5b192 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:54.266764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:54.267867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.269073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.269556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.274651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:54.280821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:54.317746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1285/2585] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:54.322481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:54.347945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b900-da4d-41d2-80d1-2e1fb734625f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:54.355801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:54.358664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.359047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.359389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.360119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:54.362365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad744-7325-4015-bf91-649f12622d77 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:54.377919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1301/2586] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:19:54.386093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:54.395997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467902e-0cd8-4da2-b1c3-710a9b333a31 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:54.402128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:54.403521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.404046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.404775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] PATH_INFO: `/v3/projects/65c8af3991c444b58755762d76bccb1c/users/e125f4fd68a048d1bb1f677d994e8181/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.427206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c8af3991c444b58755762d76bccb1c, user_id=e125f4fd68a048d1bb1f677d994e8181, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:54.436056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:54.546143 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1286/2587] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:19:54 2022] PUT /identity/v3/projects/65c8af3991c444b58755762d76bccb1c/users/e125f4fd68a048d1bb1f677d994e8181/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:19:54.551847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.552487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.552797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.593481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:19:54.595204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:54.704537 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1302/2588] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:19:54.729872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:54.732122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:54.865383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af93fcc-9749-480b-a1da-474f3e80031e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:54.878974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:54.878974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:54.878974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:54.878974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:54.896860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:54.898996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:54.913450 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1287/2589] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:56.782295 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:56.845672 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:19:57.567423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:57.569813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:57.658263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe9579-02a7-40e0-b9be-65b366a85fe8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:57.665364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:57.666238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:57.666689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:57.666958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:57.669728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:57.684289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:57.686607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:57.699287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1303/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:19:58.416061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:19:58.417863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:58.456647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a623d-febf-428b-8f25-27ff7c07af60 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:19:58.472267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:19:58.473041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:19:58.477319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:19:58.478100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:19:58.488359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:19:58.512488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:19:58.514773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:19:58.536842 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1288/2591] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:19:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:06.308487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:06.309973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:06.328124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127bed-429a-4bef-a8ad-31d36ece878f service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:06.336492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:06.337534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:06.337912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:06.338322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] PATH_INFO: `/v3/users/ec7269dc6d56440ca8691179f7275aeb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:06.339626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7269dc6d56440ca8691179f7275aeb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:06.342803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:06.344689 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:06.577696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7269dc6d56440ca8691179f7275aeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:06.668678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7269dc6d56440ca8691179f7275aeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:06.669392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7269dc6d56440ca8691179f7275aeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:06.696779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7269dc6d56440ca8691179f7275aeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:06.724834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7269dc6d56440ca8691179f7275aeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:06.759668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1304/2592] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:20:06 2022] DELETE /identity/v3/users/ec7269dc6d56440ca8691179f7275aeb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:07.356674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:07.382729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53204f-43b2-4915-ae60-3a643fea4cb5 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:07.554585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:07.555529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:07.556028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:07.556655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] PATH_INFO: `/v3/projects/d4681ed2d06840f995b37e550323d6ad` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:07.558143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4681ed2d06840f995b37e550323d6ad)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:07.560278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:07.775565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4681ed2d06840f995b37e550323d6ad', 'request_id': 'req-7d892eec-e1b2-4e9e-918a-29584fbd29e1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:07.790815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4681ed2d06840f995b37e550323d6ad', 'request_id': 'req-7d892eec-e1b2-4e9e-918a-29584fbd29e1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:07.869597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4681ed2d06840f995b37e550323d6ad', 'request_id': 'req-7d892eec-e1b2-4e9e-918a-29584fbd29e1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:07.895326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] The token cache is being invalidate because project d4681ed2d06840f995b37e550323d6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:20:07.895326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:07.897593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:07.901258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1289/2593] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:20:07 2022] DELETE /identity/v3/projects/d4681ed2d06840f995b37e550323d6ad => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:07.905614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:07.907834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:07.932032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b669a8-b8c6-4914-8ddb-7e74c132096e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:08.042981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:08.046751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:08.047253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:08.048056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] PATH_INFO: `/v3/users/5b99e0cac1eb48818c5b58a0c9cd8d63` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:08.051290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b99e0cac1eb48818c5b58a0c9cd8d63)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:08.056255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:08.337384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b99e0cac1eb48818c5b58a0c9cd8d63'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:08.490794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b99e0cac1eb48818c5b58a0c9cd8d63'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:08.491647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b99e0cac1eb48818c5b58a0c9cd8d63'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:08.517932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b99e0cac1eb48818c5b58a0c9cd8d63'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:08.550516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4a005ff0-7388-4254-8914-241070a4a431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b99e0cac1eb48818c5b58a0c9cd8d63'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:08.550516 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:08.566265 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1305/2594] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:20:07 2022] DELETE /identity/v3/users/5b99e0cac1eb48818c5b58a0c9cd8d63 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:08.794706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:08.797555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:08.813643 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:08.957123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d892eec-e1b2-4e9e-918a-29584fbd29e1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:09.181787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:09.182430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:09.182714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:09.182993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:09.184970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:09.307087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:09.310223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:09.337768 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1290/2595] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:09.568853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478839-5b34-4f6b-86f4-3f5f2553ae4d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:09.569884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478839-5b34-4f6b-86f4-3f5f2553ae4d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:09.570324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1478839-5b34-4f6b-86f4-3f5f2553ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:09.588389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:09.588389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:09.668512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c1478839-5b34-4f6b-86f4-3f5f2553ae4d None None] MFA Rules not processed for user `e125f4fd68a048d1bb1f677d994e8181`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:09.671980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c1478839-5b34-4f6b-86f4-3f5f2553ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:09.782977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff89a-e452-4c25-972f-38914af73d9f service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:09.796199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:09.800957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:09.802072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:09.802538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] PATH_INFO: `/v3/projects/2556fe0c4670451aade5425cf399f4d0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:09.804026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2556fe0c4670451aade5425cf399f4d0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:09.813144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:09.853752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1306/2596] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:09.905627 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:10.025026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2556fe0c4670451aade5425cf399f4d0', 'request_id': 'req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:10.040791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2556fe0c4670451aade5425cf399f4d0', 'request_id': 'req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:10.119980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2556fe0c4670451aade5425cf399f4d0', 'request_id': 'req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:10.141411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] The token cache is being invalidate because project 2556fe0c4670451aade5425cf399f4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:20:10.141864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:10.145830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-813f3ce9-df12-4ff9-a60e-bb9cd9a632e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:10.148226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1291/2597] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:20:09 2022] DELETE /identity/v3/projects/2556fe0c4670451aade5425cf399f4d0 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:10.156867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.157374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.159319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.203414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:10.207199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:10.215153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0ec0-12a6-4bae-9b06-a6c439ff58b0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.220423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0ec0-12a6-4bae-9b06-a6c439ff58b0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.220423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a0ec0-12a6-4bae-9b06-a6c439ff58b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.244390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b90a0ec0-12a6-4bae-9b06-a6c439ff58b0 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:10.245727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b90a0ec0-12a6-4bae-9b06-a6c439ff58b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:10.356345 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1292/2598] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:20:10.403138 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1307/2599] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:10.410267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.410553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.411994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.419109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:10.424167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:10.493975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:10.495632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:10.510955 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1293/2600] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:10.511978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:10.526968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78b69f-960e-46f5-9a0f-d50e8c7a3a6d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:10.533954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:10.534768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.535102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.535972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.537075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:20:10.537461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:10.539928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:10.563008 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1294/2601] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:20:10.564887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:10.581177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52321f19-610d-4e25-b3b7-ffaf75e35b30 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:10.589410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:10.590185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.590537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.590809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.592293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:10.594554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:10.638176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c002d51-b26f-4c1a-a727-224f4a490c86 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:10.645992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:10.647055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.647571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.648083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.661561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:10.665630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:10.678200 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1308/2602] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:20:10.680567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:10.682779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:10.693825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1295/2603] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:20:10 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:20:10.699453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:10.762860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:10.830265 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:10.886699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff96e-29ba-4f47-8651-d862a5322201 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:10.902336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:10.903659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:10.904989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:10.905465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:10.906428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:10.913044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:10.920150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9207-ff51-47c7-9f34-4386e3816bcd service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:11.029919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1296/2604] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:20:10 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:20:11.032197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:11.056110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a494-476d-4911-9e1f-158c395e779c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:11.082153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:11.083191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.085234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.085531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.090836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:11.094325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:11.128165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:11.130148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.135712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.136502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.136990 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1297/2605] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:11.138101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:11.141734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:11.171501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2453-7447-4448-aca2-025e5bf188ee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:11.189913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:11.190591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.190867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.191137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.194189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:11.199182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:11.261384 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1298/2606] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:11.262792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:11.314125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744bc72-32d7-473b-9aee-6fa3725a6015 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:11.346167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:11.347780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.348074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.350731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] PATH_INFO: `/v3/projects/8c4168ae431b492fa5f8bfbb637e039b/users/a4cc56ce5e3c4a20b574d42a974a6faa/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.382376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4168ae431b492fa5f8bfbb637e039b, user_id=a4cc56ce5e3c4a20b574d42a974a6faa, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:11.385511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:11.400425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:11.402099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62b834-3132-4dc5-a596-49f5bc2638ae service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:11.437936 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1309/2607] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:11.472168 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1299/2608] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:20:11 2022] PUT /identity/v3/projects/8c4168ae431b492fa5f8bfbb637e039b/users/a4cc56ce5e3c4a20b574d42a974a6faa/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:11.478348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.478727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.479065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.505087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:11.507131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:11.619983 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:11.673012 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1310/2609] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:20:11.692340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:11.694224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:11.799677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b87170-aded-433c-8ac0-b558b7084347 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:11.804150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:11.805733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:11.806295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:11.806779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:11.820588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:11.824527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:11.849796 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1300/2610] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:21.639652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:21.641832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:21.662830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb4530-8dc8-4925-9012-e80a12c1a2b8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:21.674945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:21.675594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:21.675878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:21.676152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] PATH_INFO: `/v3/users/e125f4fd68a048d1bb1f677d994e8181` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:21.677311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e125f4fd68a048d1bb1f677d994e8181)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:21.680271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:21.916253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e125f4fd68a048d1bb1f677d994e8181'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:22.005894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e125f4fd68a048d1bb1f677d994e8181'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:22.006872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e125f4fd68a048d1bb1f677d994e8181'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:22.033182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e125f4fd68a048d1bb1f677d994e8181'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:22.043240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d49799e1-6ba2-4909-ae40-26789e4e992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e125f4fd68a048d1bb1f677d994e8181'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:22.053624 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1311/2611] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:20:21 2022] DELETE /identity/v3/users/e125f4fd68a048d1bb1f677d994e8181 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:22.248230 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=59,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:22.783471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:22.797201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed58781-cbae-4276-a394-98de6cdac2de service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:22.967532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:22.970265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:22.970644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:22.971034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] PATH_INFO: `/v3/projects/65c8af3991c444b58755762d76bccb1c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:22.974225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c8af3991c444b58755762d76bccb1c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:22.976271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:23.142688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c8af3991c444b58755762d76bccb1c', 'request_id': 'req-a43f41d2-80b3-4600-a2cf-e575a99fae46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:23.154797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c8af3991c444b58755762d76bccb1c', 'request_id': 'req-a43f41d2-80b3-4600-a2cf-e575a99fae46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:23.229099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c8af3991c444b58755762d76bccb1c', 'request_id': 'req-a43f41d2-80b3-4600-a2cf-e575a99fae46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:23.248643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] The token cache is being invalidate because project 65c8af3991c444b58755762d76bccb1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:20:23.249308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:23.256397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a43f41d2-80b3-4600-a2cf-e575a99fae46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:23.262162 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1301/2612] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:20:22 2022] DELETE /identity/v3/projects/65c8af3991c444b58755762d76bccb1c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:23.267540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:23.268056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:23.268163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:23.318705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:23.320965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:23.493416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1312/2613] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:23.505113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:23.506229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:23.506229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:23.579650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:23.582606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:23.635570 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1302/2614] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:23.637677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:23.661867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caef96-c29b-4ad2-8227-55c948c77010 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:23.678950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:23.679583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:23.679891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:23.680223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:23.681070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:20:23.681400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:23.683035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:23.722513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:23.724348 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1313/2615] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:20:23.735048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a81ef8-4711-4532-8212-208dbb58882d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:23.751556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:23.752176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:23.752453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:23.752720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:23.753431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:23.755284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:23.881922 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1303/2616] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:20:23 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:20:23.884074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:23.907151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4f12-2caf-41d7-911a-ddf55277d698 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:24.160704 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:24.185192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:24.185854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:24.186133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:24.186408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:24.187064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:24.189013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:24.271412 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1314/2617] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:20:23 2022] POST /identity/v3/users => generated 288 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:20:24.273924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:24.334300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15399b-6f73-4eab-b8dd-b3b3fecc5d16 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:24.354060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:24.354694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:24.354975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:24.355250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:24.355911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:24.362807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:24.403179 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1304/2618] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:24.406520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:24.431468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88353d5-ccf4-4912-98c7-1973b7850aa6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:24.464946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:24.464946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:24.464946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:24.464946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:24.465434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:24.465434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fecd7-e9e8-4580-a137-3763706ada56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:24.494991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1315/2619] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:24.497731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:24.520105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc79db-a148-4762-a971-ef5c8825ad6b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:24.538189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:24.539136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:24.540196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:24.540723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] PATH_INFO: `/v3/projects/8b9a5f8165c24556b4769fc2b43a7f1c/users/1e982798802a46b5b880dcc4a99e359b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:24.583941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9a5f8165c24556b4769fc2b43a7f1c, user_id=1e982798802a46b5b880dcc4a99e359b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:24.589930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:24.704490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1305/2620] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:20:24 2022] PUT /identity/v3/projects/8b9a5f8165c24556b4769fc2b43a7f1c/users/1e982798802a46b5b880dcc4a99e359b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:24.706544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c43b-ec68-49f8-88f4-00a3343680af None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:24.707122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c43b-ec68-49f8-88f4-00a3343680af None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:24.707613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c43b-ec68-49f8-88f4-00a3343680af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:24.796471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-98f9c43b-ec68-49f8-88f4-00a3343680af None None] MFA Rules not processed for user `1e982798802a46b5b880dcc4a99e359b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:24.798320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98f9c43b-ec68-49f8-88f4-00a3343680af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:25.029419 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1316/2621] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:25.333908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:25.337055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:25.438903 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:25.557225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18059924-bd3f-42cf-a3a0-44794c17b556 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:25.576841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:25.577574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:25.577860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:25.578141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:25.594694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:25.599329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:25.611034 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1306/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:27.792564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1204-f671-4098-be15-62edf0232c40 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:27.793085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1204-f671-4098-be15-62edf0232c40 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:27.793085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1204-f671-4098-be15-62edf0232c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:27.841801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-437e1204-f671-4098-be15-62edf0232c40 None None] MFA Rules not processed for user `a4cc56ce5e3c4a20b574d42a974a6faa`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:27.843333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-437e1204-f671-4098-be15-62edf0232c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:27.960162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1317/2623] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:28.198897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:28.200998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:28.234861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37af75-0512-481e-8358-1d14794fde9d service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:28.251360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:28.251989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:28.253556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:28.254635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:28.292101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:28.303597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:28.355928 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1307/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:28.665209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:28.674101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:28.674101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:28.728377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] MFA Rules not processed for user `c114d44d0a314c75902da53fca797f62`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:28.729806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:28.838961 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:28.871664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1318/2625] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:32.458313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:32.471520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654cf93-475e-46dd-a30d-5c5014ad1f86 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:32.494058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:32.495174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:32.495671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:32.496174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:32.499900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:32.624792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:32.629050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:32.675493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1308/2626] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:38.338210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:38.340643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:38.470044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0b791-1ffe-40e1-94d4-1477c8a584eb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:38.475895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:38.477147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:38.477695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:38.478251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:38.480445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:38.501383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:38.504386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:38.522112 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1319/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:42.647601 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=58 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:43.172906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:43.174442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:43.239783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640324-896b-4df4-b4d5-c08e180ced6e service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:43.244310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:43.245272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:43.245439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:43.245732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:43.247570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:43.265848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:43.267435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:43.280267 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1309/2628] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:43.514633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:43.515165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:43.528183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031db51-bfa3-4dc3-86c7-2826d900ec6c service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:43.538073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:43.539079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:43.539712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:43.539988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:43.544589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:43.557876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:43.559664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f35c7-00b4-480a-b08b-5350fd81e77d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:43.569694 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1320/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:43.620557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c370-5436-4df5-99b6-f6cac6e12fd0 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:43.626014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:43.626651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:43.626928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:43.627199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] PATH_INFO: `/v3/users/1e982798802a46b5b880dcc4a99e359b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:43.628333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e982798802a46b5b880dcc4a99e359b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:43.630314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:43.861143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e982798802a46b5b880dcc4a99e359b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:43.862892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e982798802a46b5b880dcc4a99e359b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:43.891643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e982798802a46b5b880dcc4a99e359b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:43.894257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e982798802a46b5b880dcc4a99e359b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:43.972021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e982798802a46b5b880dcc4a99e359b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:44.002113 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1310/2630] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:20:43 2022] DELETE /identity/v3/users/1e982798802a46b5b880dcc4a99e359b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:44.006231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:44.011705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:44.011705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:44.034315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:44.036911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:44.129962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1321/2631] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:20:44.163227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:44.166039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:44.223950 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:44.271334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e42734-f0b6-4c8f-b59f-32cdf032d273 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:44.275540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:44.276171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:44.276452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:44.276725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:44.287061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:44.288715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396aaa5-6cd6-48ba-89bd-99b167fe8975 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:44.301302 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1311/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:45.148058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:45.154537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:45.198742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcd1fa-4c16-4927-b7f5-de23b5f2c437 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:45.217460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:45.228580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:45.228970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:45.229326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] PATH_INFO: `/v3/projects/8b9a5f8165c24556b4769fc2b43a7f1c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:45.230951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9a5f8165c24556b4769fc2b43a7f1c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:45.233249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:45.439602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9a5f8165c24556b4769fc2b43a7f1c', 'request_id': 'req-32b648e4-e75c-47a1-bdb3-53e6486782ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:45.509721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9a5f8165c24556b4769fc2b43a7f1c', 'request_id': 'req-32b648e4-e75c-47a1-bdb3-53e6486782ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:45.521152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9a5f8165c24556b4769fc2b43a7f1c', 'request_id': 'req-32b648e4-e75c-47a1-bdb3-53e6486782ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:45.537594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] The token cache is being invalidate because project 8b9a5f8165c24556b4769fc2b43a7f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:20:45.537888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:45.538875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-32b648e4-e75c-47a1-bdb3-53e6486782ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:20:45.544660 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1322/2633] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:20:45 2022] DELETE /identity/v3/projects/8b9a5f8165c24556b4769fc2b43a7f1c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:20:45.546535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:45.547131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:45.547258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:45.570031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:45.571277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:45.659388 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1312/2634] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:45.672531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:45.672531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:45.672531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:45.694288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:45.695791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:45.708751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1323/2635] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:45.713109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:45.724642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cca99a-b67a-41c0-bb1b-78867533f0f2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:45.732766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:45.733727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:45.734168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:45.734599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:45.735453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:20:45.735924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:45.737940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:45.769628 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1313/2636] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:20:45.770576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:45.775621 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:45.783947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a46e75-29d3-4348-991d-0e113640f83a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:45.790588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:45.795224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:45.801156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:45.801156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:45.801156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:45.801156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:45.941586 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1324/2637] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:20:45.948819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:46.019992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2437da-4873-4380-8dfa-369ba8079b7e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:46.147887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:46.148625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.148915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.149749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.150472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:46.152683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:46.270326 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1314/2638] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:20:45 2022] POST /identity/v3/users => generated 292 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:20:46.271270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:46.309589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb619fe-a22e-4325-8367-f54a14600793 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:46.318409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:46.319363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.319860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.320346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.321848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:46.323738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:46.338393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1325/2639] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:46.342116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:46.353035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfa84b-5616-4768-9c40-ef307f91c588 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:46.358452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:46.359300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.359725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.365693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.365693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:46.365693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266925a1-09b0-4898-8de0-1b1987a0789f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:46.377836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1315/2640] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:20:46.378640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:46.400110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef220-f2f0-4d3b-9472-5a0441c0f1f6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:46.417869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:46.418818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.419406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.419584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] PATH_INFO: `/v3/projects/a766acde7eab4b05866a2c33f5dd3606/users/ce9f71f892094c2685b175e111fe7cf9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.454006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a766acde7eab4b05866a2c33f5dd3606, user_id=ce9f71f892094c2685b175e111fe7cf9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:46.454006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:46.539014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1326/2641] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:20:46 2022] PUT /identity/v3/projects/a766acde7eab4b05866a2c33f5dd3606/users/ce9f71f892094c2685b175e111fe7cf9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:20:46.544457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b0a9-6c18-4a52-87da-51aa6b094cf6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.544728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b0a9-6c18-4a52-87da-51aa6b094cf6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.545188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b0a9-6c18-4a52-87da-51aa6b094cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.565535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2be9b0a9-6c18-4a52-87da-51aa6b094cf6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:46.566705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2be9b0a9-6c18-4a52-87da-51aa6b094cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:46.630532 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:46.700408 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1316/2642] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:46.710562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:46.713017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:46.801084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daf3db-d7e8-4c29-a58b-bc3ef33bfc97 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:46.807889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:46.808871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:46.809475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:46.810111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:46.826973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:46.833382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:46.847559 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1327/2643] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:20:49.234386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:49.234936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:49.234936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:49.273724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:20:49.275197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:49.365978 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1317/2644] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:20:49.381126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:20:49.382796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:20:49.523170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418d249-6f61-4494-ab1d-d1ebca631c3d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:20:49.529156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:20:49.530015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:20:49.535810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:20:49.536562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:20:49.563797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:20:49.566149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:20:49.579052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1328/2645] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:20:59.334724 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=38 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:20:59.574309 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:00.318469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:00.320191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:00.361841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d6a6-63fe-4e0c-b290-0bff8c05f592 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:00.381612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:00.382558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:00.387586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:00.387586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] PATH_INFO: `/v3/users/a4cc56ce5e3c4a20b574d42a974a6faa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:00.388698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cc56ce5e3c4a20b574d42a974a6faa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:00.394374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:00.696043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cc56ce5e3c4a20b574d42a974a6faa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:00.703553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cc56ce5e3c4a20b574d42a974a6faa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:00.729503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cc56ce5e3c4a20b574d42a974a6faa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:00.730783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cc56ce5e3c4a20b574d42a974a6faa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:00.852600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bd1cd4f-a177-49e5-8955-5a4193b631a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cc56ce5e3c4a20b574d42a974a6faa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:00.898393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1318/2646] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:00 2022] DELETE /identity/v3/users/a4cc56ce5e3c4a20b574d42a974a6faa => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:01.742593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:01.756888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff57-41ef-4c84-9a5c-4900b7392cc6 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:02.054882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:02.060904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:02.060904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:02.060904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] PATH_INFO: `/v3/projects/8c4168ae431b492fa5f8bfbb637e039b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:02.072870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4168ae431b492fa5f8bfbb637e039b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:02.078501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:02.332598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4168ae431b492fa5f8bfbb637e039b', 'request_id': 'req-01d1fb39-694a-49aa-b9fb-67cd19bb8552'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:02.441681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4168ae431b492fa5f8bfbb637e039b', 'request_id': 'req-01d1fb39-694a-49aa-b9fb-67cd19bb8552'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:02.466137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4168ae431b492fa5f8bfbb637e039b', 'request_id': 'req-01d1fb39-694a-49aa-b9fb-67cd19bb8552'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:02.502771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] The token cache is being invalidate because project 8c4168ae431b492fa5f8bfbb637e039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:02.503208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:02.503964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01d1fb39-694a-49aa-b9fb-67cd19bb8552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:02.510178 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1329/2647] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:01 2022] DELETE /identity/v3/projects/8c4168ae431b492fa5f8bfbb637e039b => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:02.511672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:02.512245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:02.512335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:02.581920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:02.583315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:02.790554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:02.793367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:02.793367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:02.801892 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1319/2648] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:02.834536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:02.836213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:02.871663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:02.877568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1330/2649] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:02.889176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3db8-45b8-4f9b-933b-17c7485aa817 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:02.920939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:02.921881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:02.922266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:02.922656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:02.923543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:02.924180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:02.929918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:02.974179 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1320/2650] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:02.979248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:02.992555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482722-5037-4355-82b7-4da7e8ab94c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:02.996355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:02.997002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:02.997251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:02.997737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:02.998958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:03.001058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ed55d-3163-4cc5-a71f-c8d25a1ee2a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:03.221612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:03.234180 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1331/2651] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:02 2022] POST /identity/v3/projects => generated 397 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:03.237320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f837-af31-4475-a07e-a7f4cc038e49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:03.308367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.308659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.308922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.374685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:03.376041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:03.415518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:03.419166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.419872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.420478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.422587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:03.425586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:03.453690 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:03.520487 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1332/2652] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:03.556820 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1321/2653] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:03 2022] POST /identity/v3/users => generated 299 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:03.560951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:03.578432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c440294-be90-4596-ae94-f3d667db7577 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:03.593035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:03.594077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.594360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.594850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.595725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:03.597602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:03.599766 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:03.618023 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1333/2654] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:03.622531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:03.633371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386b98-510d-4e3f-bb65-53eab2f5e2bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:03.648944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:03.649690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.649974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.650295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.650903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:03.652667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d685456-bdc1-4aa0-ac3e-4e625f7e5aff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:03.682728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1322/2655] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:21:03.687105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:03.710595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6fa80-246b-4ce3-8afa-ac49b5a20a7d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:03.725956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:03.727338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.734342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.741172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] PATH_INFO: `/v3/projects/4fc1f6311290483885e60eff6225a4f1/users/0677bca630fd40088dd32981f81bce20/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.784209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc1f6311290483885e60eff6225a4f1, user_id=0677bca630fd40088dd32981f81bce20, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:03.790892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:03.849884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1334/2656] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:03 2022] PUT /identity/v3/projects/4fc1f6311290483885e60eff6225a4f1/users/0677bca630fd40088dd32981f81bce20/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:21:03.855567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead436-f6cd-44b2-93d8-8f3767accbf0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:03.856088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead436-f6cd-44b2-93d8-8f3767accbf0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:03.856563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ead436-f6cd-44b2-93d8-8f3767accbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:03.913113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-99ead436-f6cd-44b2-93d8-8f3767accbf0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:03.915018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99ead436-f6cd-44b2-93d8-8f3767accbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:04.075158 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1323/2657] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:04.108201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:04.110003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:04.259175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4730b5-e653-450f-9b6c-38a0be1173b9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:04.270464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:04.272577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:04.274557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:04.275156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:04.297300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:04.297785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:04.298395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:04.306935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:04.308758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2663e8-9068-42bf-a9a9-c0fe14564d9b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:04.342835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1335/2658] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:04.412867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] MFA Rules not processed for user `ce9f71f892094c2685b175e111fe7cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:04.414494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:04.574820 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1324/2659] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:04.584671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:04.585068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:04.585213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:04.647150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] MFA Rules not processed for user `ce9f71f892094c2685b175e111fe7cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:04.648743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:04.662014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1336/2660] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:05.970056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:05.971202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:06.195423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92715c5-70b5-4cff-b110-95f486c8e2ce None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:06.207626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:06.208964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:06.209460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:06.210082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:06.217596 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:06.222945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:06.225223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de12d2-c162-42e4-8fc8-74356fdd51ba service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:06.257997 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1325/2661] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:09.309853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:09.315702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:09.371933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca6492-af7d-4477-a453-f8565e866823 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:09.390478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:09.391178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:09.391524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:09.392000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:09.397625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:09.419468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb540-41af-44b5-b211-9e45f3df673d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:09.420011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb540-41af-44b5-b211-9e45f3df673d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:09.420011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb540-41af-44b5-b211-9e45f3df673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:09.470489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e6dbb540-41af-44b5-b211-9e45f3df673d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:09.472057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e6dbb540-41af-44b5-b211-9e45f3df673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:09.582733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:09.588145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:09.626872 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1337/2662] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:09.672410 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1326/2663] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:09.709659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:09.711626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:09.880983 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:09.896090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581f146-bb10-4d6d-9128-ed5d1eb02dbe service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:09.907523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:09.908593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:09.910689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:09.910689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:09.926025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:09.927747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:09.937646 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1338/2664] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:21:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:15.209887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:15.209887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:15.209887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:15.310133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] MFA Rules not processed for user `0677bca630fd40088dd32981f81bce20`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:15.311803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:15.564753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1327/2665] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:16.020717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:16.059756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcb0e1-fd5f-4735-a95c-24d8d2ce71f4 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:16.073271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:16.076575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:16.077323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:16.077977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:16.114420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:16.116673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:16.133418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1339/2666] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:21:17.740820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:17.742510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:17.771946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad1a1d-a086-473a-a423-1548ff73a14f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:17.779109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:17.779756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:17.780033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:17.780306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] PATH_INFO: `/v3/users/c114d44d0a314c75902da53fca797f62` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:17.781820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c114d44d0a314c75902da53fca797f62)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:17.788038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:17.975717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c114d44d0a314c75902da53fca797f62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:17.976421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c114d44d0a314c75902da53fca797f62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:18.000544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c114d44d0a314c75902da53fca797f62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:18.001243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c114d44d0a314c75902da53fca797f62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:18.076459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c114d44d0a314c75902da53fca797f62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:18.107836 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:18.117814 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1328/2667] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:17 2022] DELETE /identity/v3/users/c114d44d0a314c75902da53fca797f62 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:18.650162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:18.651821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:18.736562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e13465-0dc2-4b79-8e47-b36ecaa80053 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:18.764143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:18.777811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:18.887463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:18.888104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:18.888389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:18.888666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:18.903425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:18.991412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9671f-4ec8-4b26-ae20-4e589af6ec75 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:19.006032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:19.007039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.007483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.007914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] PATH_INFO: `/v3/projects/8c2cd7e4b04741e3bb1cb9852612db57` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.009854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2cd7e4b04741e3bb1cb9852612db57)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:19.012145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:19.087947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:19.091725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c35123-f6a5-41ba-9787-70828fe207fa service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:19.107423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1340/2668] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:19.109105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a55fcd-5cc9-4964-8d92-438f577a5093 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.109664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a55fcd-5cc9-4964-8d92-438f577a5093 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.110152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a55fcd-5cc9-4964-8d92-438f577a5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.138401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-69a55fcd-5cc9-4964-8d92-438f577a5093 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:19.140308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69a55fcd-5cc9-4964-8d92-438f577a5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:19.215647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2cd7e4b04741e3bb1cb9852612db57', 'request_id': 'req-0c86dae3-6add-40bb-bfac-df5828d5b8d5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:19.229646 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1341/2669] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:19.231351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2cd7e4b04741e3bb1cb9852612db57', 'request_id': 'req-0c86dae3-6add-40bb-bfac-df5828d5b8d5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:19.349143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2cd7e4b04741e3bb1cb9852612db57', 'request_id': 'req-0c86dae3-6add-40bb-bfac-df5828d5b8d5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:19.373114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] The token cache is being invalidate because project 8c2cd7e4b04741e3bb1cb9852612db57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:19.376383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:19.378212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0c86dae3-6add-40bb-bfac-df5828d5b8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:19.384405 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1329/2670] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:18 2022] DELETE /identity/v3/projects/8c2cd7e4b04741e3bb1cb9852612db57 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:21:19.385986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.386270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.386540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.394596 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:19.437236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:19.439116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:19.623555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1342/2671] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:21:19.633370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.633901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.634184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.672795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:19.676956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:19.700337 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1330/2672] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:19.700646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:19.715964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e287c-2606-4754-90eb-5b1615c7fdca None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:19.732843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:19.733494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.733774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.734113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.734705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:19.735007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:19.736947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:19.762617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1343/2673] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:21:19.767044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:19.780052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317536-6803-4640-aa61-a3a3e3193939 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:19.786897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:19.787524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:19.787803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:19.788073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:19.788713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:19.790989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:19.889300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1331/2674] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:19 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:19.890311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:19.908887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58f22-2b1a-4d2d-824d-5f238b341069 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:20.074956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:20.075692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:20.076040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:20.076403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:20.077214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:20.081402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:20.195423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1344/2675] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:19 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:21:20.199604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:20.215457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc0de-e5b3-4305-9d9e-540407899a11 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:20.222411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:20.225001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:20.225599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:20.226092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:20.226946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:20.234133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:20.324989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:20.330444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1332/2676] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:20.344122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefe1c-0180-47dd-a0cf-e77201242b9d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:20.357204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:20.358044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:20.362891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:20.362891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:20.362891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:20.362891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bad72-f4b3-46d6-8528-2836bd8653a6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:20.379652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:20.393461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1345/2677] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:20.403196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dcc156-8643-4f40-84a1-85c870db13b8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:20.403196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:20.413246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:20.421313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:20.421313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] PATH_INFO: `/v3/projects/f15acd9335914ed28820ad05a7b46120/users/568cdd06354f4e22ae62e1e88a65edf3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:20.435079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15acd9335914ed28820ad05a7b46120, user_id=568cdd06354f4e22ae62e1e88a65edf3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:20.438045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:20.537365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1333/2678] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:20 2022] PUT /identity/v3/projects/f15acd9335914ed28820ad05a7b46120/users/568cdd06354f4e22ae62e1e88a65edf3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:20.549745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:20.550220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:20.550608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:20.592779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] MFA Rules not processed for user `568cdd06354f4e22ae62e1e88a65edf3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:20.595156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:20.697082 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:20.722261 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1346/2679] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:22.202944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:22.205042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:22.211342 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:22.392062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981ad33-7523-4a7c-8fc7-3dd0925942ed admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:22.409294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:22.413981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:22.414630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:22.415070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:22.444491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:22.445473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2ff4e-2821-4040-8e94-58d3c2e71fc6 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:22.472437 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1334/2680] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:22.532604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:22.647367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68729-8ed5-4f35-92f7-222281dcb2c5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:22.654299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:22.655298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:22.655774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:22.656239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] PATH_INFO: `/v3/users/568cdd06354f4e22ae62e1e88a65edf3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:22.658170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568cdd06354f4e22ae62e1e88a65edf3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:22.660722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:22.947400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568cdd06354f4e22ae62e1e88a65edf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:23.053765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568cdd06354f4e22ae62e1e88a65edf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:23.056674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568cdd06354f4e22ae62e1e88a65edf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:23.081865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568cdd06354f4e22ae62e1e88a65edf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:23.115145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568cdd06354f4e22ae62e1e88a65edf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:23.135188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:23.135723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:23.136207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:23.139301 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1347/2681] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:22 2022] DELETE /identity/v3/users/568cdd06354f4e22ae62e1e88a65edf3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:23.181813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:23.183698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:23.335569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1335/2682] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:23.412099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:23.414138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:23.505301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-e2db-4d10-b550-5ebea65733d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:23.510645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:23.511324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:23.512756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:23.513238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:23.527573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:23.529427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4352ac2-32dc-48e0-8f38-daab960c05c7 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:23.555707 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1348/2683] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:24.144364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:24.145911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:24.159034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fbb69-0d4e-4a22-ac7e-a620f255a793 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:24.164348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:24.165898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:24.166653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:24.167241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] PATH_INFO: `/v3/projects/f15acd9335914ed28820ad05a7b46120` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:24.168959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15acd9335914ed28820ad05a7b46120)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:24.171869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:24.486697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15acd9335914ed28820ad05a7b46120', 'request_id': 'req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:24.513210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15acd9335914ed28820ad05a7b46120', 'request_id': 'req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:24.634333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15acd9335914ed28820ad05a7b46120', 'request_id': 'req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:24.658381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] The token cache is being invalidate because project f15acd9335914ed28820ad05a7b46120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:24.663108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:24.663108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e3c37aa3-7ea0-46d6-af6e-773e6e228f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:24.663108 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1336/2684] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:24 2022] DELETE /identity/v3/projects/f15acd9335914ed28820ad05a7b46120 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:24.669249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:24.670255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:24.670715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:24.694023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:24.695321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:24.706408 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:24.875602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1349/2685] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:24.885683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:24.886234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:24.886708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:24.925283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:24.928245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:24.944819 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1337/2686] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:24.949884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:24.981906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955cc54-40e2-4409-bbbb-9fc9e312670d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:24.995732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:24.999602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.000078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.000512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.001269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:25.001694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.021743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.050692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1350/2687] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:25.056402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:25.067943 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:25.078897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa63c2c-4780-4c3a-820c-475a59830eab None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:25.098873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:25.104439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.104726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.105114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.107215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.111443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.297356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1338/2688] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:25 2022] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:25.298201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:25.337255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c974a-a816-4c5c-b4cf-5759bfe13a47 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:25.452710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:25.455417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.455933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.456453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.457321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.459723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.566557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1351/2689] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:25 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:25.571097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:25.589400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3ca7-f4c3-42fd-b07f-0378fe239df7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:25.599861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:25.600581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.601029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.601873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.602869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.604737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.619043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1339/2690] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:25.623238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:25.636401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc93296-832e-4887-ac21-de49b88fb2a6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:25.653872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:25.654957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.655626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.656212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.657203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.659853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f32853-437f-4e1a-bb40-d053846999be admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.680437 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1352/2691] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:25.684675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:25.695402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1ee87-2eff-412d-9fe0-00a74ecaca08 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:25.718168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:25.720170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.720976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.721532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] PATH_INFO: `/v3/projects/9457ffb0ffff4ed884a433520e86f73b/users/08eeb542aee14097a3250b7cc2884100/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.741909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9457ffb0ffff4ed884a433520e86f73b, user_id=08eeb542aee14097a3250b7cc2884100, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:25.750945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:25.874511 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1340/2692] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:25 2022] PUT /identity/v3/projects/9457ffb0ffff4ed884a433520e86f73b/users/08eeb542aee14097a3250b7cc2884100/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:25.887252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:25.887795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:25.888309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:25.934463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] MFA Rules not processed for user `08eeb542aee14097a3250b7cc2884100`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:25.935630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:26.033089 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1353/2693] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:26.054641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:26.057111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:26.228551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d8b4-c759-4e9b-ba6c-8a490122ba27 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:26.236906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:26.238802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:26.239444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:26.240271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:26.258397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:26.260393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:26.306480 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1341/2694] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:27.386593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:27.410417 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:27.546047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f13de-d04f-4522-a59f-385f5e4f2c2e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:27.550124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:27.551175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:27.551690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:27.552299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] PATH_INFO: `/v3/users/08eeb542aee14097a3250b7cc2884100` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:27.553844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08eeb542aee14097a3250b7cc2884100)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:27.556667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:27.623813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:27.626082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:27.814439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bed421-ab99-47a6-8c3a-58205b842823 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:27.829726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:27.830373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:27.833841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:27.833841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:27.836866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:27.887135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:27.889122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bab5b-184c-43f4-b784-b2aaecd6730a service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:27.904521 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1342/2695] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:21:27.920377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08eeb542aee14097a3250b7cc2884100'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:28.031613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08eeb542aee14097a3250b7cc2884100'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:28.032880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08eeb542aee14097a3250b7cc2884100'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:28.055439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08eeb542aee14097a3250b7cc2884100'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:28.065049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08eeb542aee14097a3250b7cc2884100'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:28.137632 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1354/2696] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:27 2022] DELETE /identity/v3/users/08eeb542aee14097a3250b7cc2884100 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:28.137848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:28.138190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:28.139248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:28.152535 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:28.192447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:28.193715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:28.343816 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1343/2697] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:21:28.368874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:28.371536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:28.500238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddc488-0e8b-4f24-b806-5e3be451c5c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:28.506065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:28.506941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:28.507660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:28.508101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:28.521738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:28.523433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62642-b83d-4fa6-862e-c7a0e7357289 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:28.534930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1355/2698] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:29.878595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:29.881623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:29.901763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0032-da92-445d-999b-e249f7bbe2c5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:29.912573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:29.914471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:29.914860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:29.915889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] PATH_INFO: `/v3/projects/9457ffb0ffff4ed884a433520e86f73b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:29.919122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9457ffb0ffff4ed884a433520e86f73b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:29.922783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:30.147075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9457ffb0ffff4ed884a433520e86f73b', 'request_id': 'req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:30.155685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9457ffb0ffff4ed884a433520e86f73b', 'request_id': 'req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:30.247948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9457ffb0ffff4ed884a433520e86f73b', 'request_id': 'req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:30.263169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] The token cache is being invalidate because project 9457ffb0ffff4ed884a433520e86f73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:30.263723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:30.274819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-240a6d7f-d2bb-4a2c-96c2-f2e903d35441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:30.274819 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1344/2699] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:29 2022] DELETE /identity/v3/projects/9457ffb0ffff4ed884a433520e86f73b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:30.279343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:30.285123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:30.285123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:30.302857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:30.304403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:30.334070 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:30.377415 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1356/2700] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:21:30.383690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:30.384043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:30.384432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:30.409063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:30.410506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:30.425201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:30.434666 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1345/2701] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:30.441897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc251-36fc-413d-ab44-f9e6624e8ee5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:30.488072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:30.488756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:30.489039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:30.489307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:30.489989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:30.490290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:30.491987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:30.513603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:30.534850 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1357/2702] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:30.544765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca35a04-c90c-4962-a936-b87f14f23efd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:30.564196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:30.566789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:30.567077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:30.567369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:30.568018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:30.578365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:30.732321 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1346/2703] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:30 2022] POST /identity/v3/projects => generated 405 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:30.736986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:30.754676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3108-5b6f-4cf9-bb11-c022c6b48172 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:30.919120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:30.919761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:30.920069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:30.920305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:30.921148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:30.923368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:31.047408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1358/2704] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:30 2022] POST /identity/v3/users => generated 303 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:31.049484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:31.065663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fae5b-e8d6-40f9-b3db-319d44dd0d19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:31.073378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:31.075284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:31.075764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:31.076224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:31.083325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:31.085530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:31.100073 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1347/2705] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:31.104475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:31.121032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e9b61-680d-46a7-a9f1-97609dfcaed2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:31.149919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:31.154430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:31.154819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:31.156700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:31.157545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:31.163504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c95dc8-53ed-4b08-820e-c8c70c793af2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:31.197160 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1359/2706] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:21:31.201540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:31.213718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6242-e78b-420c-8055-14531b4d123c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:31.220614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:31.222414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:31.222978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:31.223783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] PATH_INFO: `/v3/projects/6cd2df29276f4bcdbf3329c684d5086a/users/4f1e4052cfb4446b9c89288f8fc7e76c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:31.251401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2df29276f4bcdbf3329c684d5086a, user_id=4f1e4052cfb4446b9c89288f8fc7e76c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:31.257963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:31.418216 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1348/2707] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:31 2022] PUT /identity/v3/projects/6cd2df29276f4bcdbf3329c684d5086a/users/4f1e4052cfb4446b9c89288f8fc7e76c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:31.424290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02c34-ed82-455a-9c26-d24ed7d65221 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:31.424844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02c34-ed82-455a-9c26-d24ed7d65221 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:31.424844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02c34-ed82-455a-9c26-d24ed7d65221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:31.470492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-42f02c34-ed82-455a-9c26-d24ed7d65221 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:31.475599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-42f02c34-ed82-455a-9c26-d24ed7d65221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:31.566419 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1360/2708] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:31.616851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:31.619933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:31.681398 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:31.784873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df965cc-7a51-48ac-8244-e65de9ec97dd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:31.790094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:31.792201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:31.792201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:31.792441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:31.811432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:31.813270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:31.826725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1349/2709] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:33.307074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:33.307646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:33.307646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:33.358021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:33.363989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:33.393994 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:33.442005 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1361/2710] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:33.463472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:33.465069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:33.501827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:33.505409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:33.550362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def448c-d27e-4d61-8656-a13e98e46ae3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:33.561286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:33.562966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:33.563461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:33.564338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] PATH_INFO: `/v3/users/0677bca630fd40088dd32981f81bce20` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:33.587949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0677bca630fd40088dd32981f81bce20)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:33.608478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:33.640951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156f6b-92be-4712-ba3e-f010fc1ff836 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:33.655070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:33.657708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:33.658010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:33.658287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:33.733837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:33.740574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:33.782579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1350/2711] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:21:33.904853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0677bca630fd40088dd32981f81bce20'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:34.002449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0677bca630fd40088dd32981f81bce20'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:34.003109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0677bca630fd40088dd32981f81bce20'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:34.035787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0677bca630fd40088dd32981f81bce20'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:34.074305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-556fd883-258d-4e1d-ba81-e3c77d4236b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0677bca630fd40088dd32981f81bce20'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:34.107020 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1362/2712] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:33 2022] DELETE /identity/v3/users/0677bca630fd40088dd32981f81bce20 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:35.911073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:35.938470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ccdd3-2d98-480d-9314-7b81ebb0c193 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:36.138180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:36.138909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:36.139611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:36.139885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] PATH_INFO: `/v3/projects/4fc1f6311290483885e60eff6225a4f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:36.142933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc1f6311290483885e60eff6225a4f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:36.144882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:36.421594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc1f6311290483885e60eff6225a4f1', 'request_id': 'req-79b8cc87-dfe9-4209-a425-61deb779cc79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:36.434803 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:36.437706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc1f6311290483885e60eff6225a4f1', 'request_id': 'req-79b8cc87-dfe9-4209-a425-61deb779cc79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:36.550932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc1f6311290483885e60eff6225a4f1', 'request_id': 'req-79b8cc87-dfe9-4209-a425-61deb779cc79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:36.579747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] The token cache is being invalidate because project 4fc1f6311290483885e60eff6225a4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:36.579747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:36.581790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b8cc87-dfe9-4209-a425-61deb779cc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:36.587885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1351/2713] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:35 2022] DELETE /identity/v3/projects/4fc1f6311290483885e60eff6225a4f1 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:36.593997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:36.594914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:36.595350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:36.632143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:36.636386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:36.774123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1363/2714] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:36.782787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:36.783349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:36.783349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:36.827099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:36.828077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:36.847206 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1352/2715] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:36.848712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:36.861201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3289944-3533-4d2b-99c3-6995c40bf600 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:36.912440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:36.914794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:36.916080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:36.920088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:36.921594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:36.924453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:36.934954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:36.976197 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1364/2716] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:36.976834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:37.006429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a66cd-378d-4180-a825-5b08f7938274 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:37.026111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:37.034208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.034208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.034208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:37.034208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:37.053818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:37.171145 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1353/2717] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:36 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:37.172294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:37.195025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9ce60-b246-4756-bf11-e3bc7355db67 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:37.332095 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:37.428501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:37.429173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.429559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.429841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:37.430489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:37.432624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:37.563537 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1365/2718] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:37 2022] POST /identity/v3/users => generated 291 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:21:37.568113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:37.604445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd299ff-c1a1-4fce-89be-deed0f73f59e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:37.632771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:37.632950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.633094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.633390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:37.635317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:37.639873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:37.675497 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1354/2719] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:37.679663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:37.705384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2fdba-9c7b-46bd-a48d-b96d87aaa0c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:37.724771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:37.725875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.726335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.726816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:37.731076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:37.733192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e4d54-e40b-4d16-894b-4efc7483d159 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:37.765394 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1366/2720] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:37.770017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:37.788713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006b07a-c7e6-49f1-b8d5-e4f3a6d96480 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:37.802643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:37.802643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.802643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.802643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] PATH_INFO: `/v3/projects/7f383493aa6b46c9884b54cb82063b30/users/d6e0e5acf53b4abe99c3418c82d47ab3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:37.870651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f383493aa6b46c9884b54cb82063b30, user_id=d6e0e5acf53b4abe99c3418c82d47ab3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:37.874104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:37.955330 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1355/2721] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:37 2022] PUT /identity/v3/projects/7f383493aa6b46c9884b54cb82063b30/users/d6e0e5acf53b4abe99c3418c82d47ab3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:37.959703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:37.960226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:37.960662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:38.000871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:38.004669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:38.161296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1367/2722] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:38.199064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:38.201070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:38.425596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7489e42-5208-4d1b-b500-077691fb599a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:38.439250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:38.439891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:38.440183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:38.440427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:38.474388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:38.476089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:38.506341 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1356/2723] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:40.999879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:41.002031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:41.022851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756206-97e4-4cdb-88f0-3dc8f76aacdf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:41.085315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:41.086092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:41.086935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:41.088749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] PATH_INFO: `/v3/users/c7334417689847d18bc4c1b27d173a23` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:41.092713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7334417689847d18bc4c1b27d173a23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:41.095026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:41.382058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7334417689847d18bc4c1b27d173a23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:41.493859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7334417689847d18bc4c1b27d173a23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:41.494559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7334417689847d18bc4c1b27d173a23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:41.520556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7334417689847d18bc4c1b27d173a23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:41.547832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7334417689847d18bc4c1b27d173a23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:41.570029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1368/2724] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:40 2022] DELETE /identity/v3/users/c7334417689847d18bc4c1b27d173a23 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:41.867245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:41.870087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:42.021468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c86-9631-4407-80e5-49bc836ac1db service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:42.077915 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:42.176382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:42.178440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:42.178732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:42.179352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:42.186585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:42.219308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:42.221024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:42.259827 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1357/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:42.560705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:42.562869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:42.638278 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:42.820646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d8d2-9cae-47f7-a37c-6fe0b841ebde admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:42.843424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:42.844088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:42.844360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:42.844639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] PATH_INFO: `/v3/projects/283e7fd477334b879db6b49ee5cc509f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:42.846012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=283e7fd477334b879db6b49ee5cc509f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:42.848172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:43.084586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283e7fd477334b879db6b49ee5cc509f', 'request_id': 'req-daafa3ff-716c-44df-9dfa-551c32a88cef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.198013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283e7fd477334b879db6b49ee5cc509f', 'request_id': 'req-daafa3ff-716c-44df-9dfa-551c32a88cef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.206099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283e7fd477334b879db6b49ee5cc509f', 'request_id': 'req-daafa3ff-716c-44df-9dfa-551c32a88cef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.274744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] The token cache is being invalidate because project 283e7fd477334b879db6b49ee5cc509f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:43.274744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.274744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.303788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1369/2726] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:42 2022] DELETE /identity/v3/projects/283e7fd477334b879db6b49ee5cc509f => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:43.304318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:43.325879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e3074-7608-462b-b3be-e2abe9917f61 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:43.518562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:43.519331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:43.519709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:43.520451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] PATH_INFO: `/v3/users/2d5a735c942648c1b888e65e07394d0c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:43.525466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5a735c942648c1b888e65e07394d0c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:43.530536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:43.831408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5a735c942648c1b888e65e07394d0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.832403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5a735c942648c1b888e65e07394d0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.849609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5a735c942648c1b888e65e07394d0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.850639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5a735c942648c1b888e65e07394d0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:43.976436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d0dc48d7-37d4-4d14-87b6-bc29c892911f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5a735c942648c1b888e65e07394d0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:44.046322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1358/2727] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:43 2022] DELETE /identity/v3/users/2d5a735c942648c1b888e65e07394d0c => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:44.408578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:44.410210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:44.456832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafa3ff-716c-44df-9dfa-551c32a88cef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:44.649866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:44.651844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:44.652455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:44.653478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] PATH_INFO: `/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:44.658626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760c3a4d65ca4e7d956f9ef4d7fa1a73)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:44.658626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:44.866869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760c3a4d65ca4e7d956f9ef4d7fa1a73', 'request_id': 'req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:44.951174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760c3a4d65ca4e7d956f9ef4d7fa1a73', 'request_id': 'req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:44.952648 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:44.960224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760c3a4d65ca4e7d956f9ef4d7fa1a73', 'request_id': 'req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:44.996327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] The token cache is being invalidate because project 760c3a4d65ca4e7d956f9ef4d7fa1a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:44.996648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:44.998987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c616c30-c8d4-4e88-84a4-1c7fa36c79d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:45.010604 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1370/2728] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:44 2022] DELETE /identity/v3/projects/760c3a4d65ca4e7d956f9ef4d7fa1a73 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:45.015651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:45.016217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:45.016603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:45.049620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:45.050781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:45.185373 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:45.261265 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1359/2729] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:45.272924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:45.273613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:45.273890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:45.315249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:45.316722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:45.344491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1371/2730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:45.345222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:45.367723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e6636-ae95-48c4-996d-b9343d263fbe None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:45.382779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:45.384370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:45.384656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:45.391553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:45.392617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:45.392931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:45.400218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:45.446379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1360/2731] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:45.449786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:45.464618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443443c-1b5f-4863-bbfb-bf5d4eecd01c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:45.490209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:45.490836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:45.491114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:45.491383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:45.492026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:45.505061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:45.703794 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1372/2732] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:45 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:45.705472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:45.721725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a1b7-bf25-4001-9a76-ca28cf9aaba8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:45.989424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:45.991096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:45.991714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:45.992477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:45.993310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:45.998406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:46.175164 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1361/2733] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:45 2022] POST /identity/v3/users => generated 291 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:46.179691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:46.224001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6847-658d-46bf-99bd-907b4f3b2f86 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:46.244500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:46.245592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:46.246038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:46.246489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:46.247330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:46.249466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:46.281562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:46.292619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1373/2734] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:46.299788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ee25f-0e89-4739-b28e-cc1e11ebc6b7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:46.308768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:46.326045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:46.326318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:46.326728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:46.327408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:46.329035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d204e4f-895a-46ff-8cc9-13bfd9dfe0de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:46.383292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:46.401620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1362/2735] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:21:46.406650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9117-f1f4-4990-9163-9850fa59b851 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:46.418775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:46.419882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:46.420328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:46.421064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f/users/90371d04c0ad4aeba7780f85721cf7cc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:46.462002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb45c128cef4500a837862a5609284f, user_id=90371d04c0ad4aeba7780f85721cf7cc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:46.482507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:46.600751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1374/2736] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:46 2022] PUT /identity/v3/projects/8fb45c128cef4500a837862a5609284f/users/90371d04c0ad4aeba7780f85721cf7cc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:46.612337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:46.612616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:46.612972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:46.678936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] MFA Rules not processed for user `90371d04c0ad4aeba7780f85721cf7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:46.687847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:46.766189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:46.766306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:46.865195 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1363/2737] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:46.865722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:46.886457 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:46.959209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eb51a-f092-4c5a-b384-32b0480af1dd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:46.970948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:46.971340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:46.971813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:46.972548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] PATH_INFO: `/v3/users/4f1fe6e04e064dfba969b07d4188ab38` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:46.976888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1fe6e04e064dfba969b07d4188ab38)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:46.982692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:47.074757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765635b-004b-44a0-a1a3-29146f0f77e8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:47.099857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:47.100866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.101431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.101884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.102882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:47.113719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:47.266789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1364/2738] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:46 2022] POST /identity/v3/projects => generated 381 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:47.270382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:47.342698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1fe6e04e064dfba969b07d4188ab38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:47.409182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bc007-3449-4ab3-ad60-23835170a088 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:47.414904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:47.416452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.416897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.422244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1fe6e04e064dfba969b07d4188ab38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:47.423560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1fe6e04e064dfba969b07d4188ab38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:47.428336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.431965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:47.435293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:47.454349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1fe6e04e064dfba969b07d4188ab38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:47.460692 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:47.482355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e307f25a-0f06-43f4-ae28-b9209f2da3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1fe6e04e064dfba969b07d4188ab38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:47.502172 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1375/2739] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:46 2022] DELETE /identity/v3/users/4f1fe6e04e064dfba969b07d4188ab38 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:47.503907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.504369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.504802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.566660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:47.568064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:47.596137 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1365/2740] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:47 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:47.599770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:47.621097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:47.652962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52a199-3f30-45d9-8863-f6ac0c724f89 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:47.790283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1376/2741] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:47.801198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:47.804005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:47.810239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:47.811068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.811446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.811905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.812659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:47.818245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:47.830759 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1366/2742] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:47.838725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:47.849282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3440-33df-497a-b505-f39f2b5c9a86 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:47.855271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:47.856743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.857124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.857659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] PATH_INFO: `/v3/projects/3a2242f9af98476980b282e8c2102912/users/1301b8b05d01412280b80e1996f9e4a1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.904876 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:47.911447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2242f9af98476980b282e8c2102912, user_id=1301b8b05d01412280b80e1996f9e4a1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:47.918659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:47.963521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ecc302-02f2-4eae-9b49-e397a7724aec None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:47.980416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:47.984508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:47.990506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:47.990506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:47.997613 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1367/2743] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:47 2022] PUT /identity/v3/projects/3a2242f9af98476980b282e8c2102912/users/1301b8b05d01412280b80e1996f9e4a1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:21:48.001822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:48.029326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:48.030899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:48.087930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1377/2744] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:48.207322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd344280-5b0a-447a-8094-563ae146ba52 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:48.232495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:48.233286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:48.233605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:48.233884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:48.234554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:48.237952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4492-d33b-4fef-95b8-4a290678d5f7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:48.270226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:48.280432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1368/2745] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:21:48.283002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891ed07-d684-4fc3-89b2-bade558e7cc5 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:48.298557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:48.299494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:48.299785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:48.300062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] PATH_INFO: `/v3/projects/3a2242f9af98476980b282e8c2102912/users/1301b8b05d01412280b80e1996f9e4a1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:48.306012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2242f9af98476980b282e8c2102912, user_id=1301b8b05d01412280b80e1996f9e4a1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:48.315273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:48.348088 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1378/2746] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:48 2022] PUT /identity/v3/projects/3a2242f9af98476980b282e8c2102912/users/1301b8b05d01412280b80e1996f9e4a1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:48.360248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8787-0158-4118-9f89-1551455c5d2e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:48.361027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8787-0158-4118-9f89-1551455c5d2e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:48.361318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8787-0158-4118-9f89-1551455c5d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:48.407878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2b5d8787-0158-4118-9f89-1551455c5d2e None None] MFA Rules not processed for user `1301b8b05d01412280b80e1996f9e4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:48.409595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b5d8787-0158-4118-9f89-1551455c5d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:48.608493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1369/2747] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:48.621174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:48.625424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:48.763724 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:48.840552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cbcb5-be55-4e94-be83-1af0ea7fb342 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:48.876092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:48.881305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:48.881305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:48.881931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:48.917962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:48.927214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:48.966133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1379/2748] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:49.002427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f98d6-a26f-4b31-9c20-60a1c81d8f53 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.002708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f98d6-a26f-4b31-9c20-60a1c81d8f53 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.002982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f98d6-a26f-4b31-9c20-60a1c81d8f53 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.004918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1370/2749] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:21:49.019322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:49.040066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:49.072700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c15f2-2004-4be7-a050-360a366cdf3a service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:49.098925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:49.099584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.104491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.104491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.104491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:49.104491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:49.113771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1380/2750] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:49 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:49.278604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.278811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.279053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.280691 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1371/2751] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:21:49.292848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:49.293385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:49.343305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:49.393005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba861787-f08a-4e7a-81e2-4785f7246a54 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:49.404250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:49.406043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:49.446199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:49.447406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.447696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.447971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.459860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:49.462825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebd92-ee5c-454f-b323-2a92191cf478 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:49.492334 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1381/2752] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:49 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:49.671389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc831a-c316-4812-a59b-25e104f02ba4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:49.676509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:49.677299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.677449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.677734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] PATH_INFO: `/v3/projects/ad621909b99143dd9885006238de72a6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.682934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad621909b99143dd9885006238de72a6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:49.684904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:49.733844 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:49.741678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:49.742299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:49.742978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:49.793625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] MFA Rules not processed for user `90371d04c0ad4aeba7780f85721cf7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:49.799233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:49.866096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad621909b99143dd9885006238de72a6', 'request_id': 'req-fa73eac2-3aad-455f-b9c3-553abdf41bfe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:49.906486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad621909b99143dd9885006238de72a6', 'request_id': 'req-fa73eac2-3aad-455f-b9c3-553abdf41bfe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.002741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad621909b99143dd9885006238de72a6', 'request_id': 'req-fa73eac2-3aad-455f-b9c3-553abdf41bfe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.043739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] The token cache is being invalidate because project ad621909b99143dd9885006238de72a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:50.043950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.054340 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1382/2753] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:21:50.060070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.060792 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1372/2754] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:49 2022] DELETE /identity/v3/projects/ad621909b99143dd9885006238de72a6 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:21:50.064924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:50.068541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:50.080257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:50.164402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74003954-86ab-4d22-b877-4cb85a021826 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:50.358508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73eac2-3aad-455f-b9c3-553abdf41bfe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:50.374049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:50.374930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:50.375372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:50.375823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:50.379895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:50.528546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:50.529306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:50.531086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:50.531429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] PATH_INFO: `/v3/users/1d811dc93ede4dbebc25f91027b6dfa9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:50.533607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d811dc93ede4dbebc25f91027b6dfa9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:50.539407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:50.583848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:50.591252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:50.620145 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1373/2755] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:50.862810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d811dc93ede4dbebc25f91027b6dfa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.981375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d811dc93ede4dbebc25f91027b6dfa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.982001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d811dc93ede4dbebc25f91027b6dfa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:50.996486 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:51.030418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d811dc93ede4dbebc25f91027b6dfa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:51.061109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfc05c85-df78-4cfd-9753-76c7b41e8fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d811dc93ede4dbebc25f91027b6dfa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:51.106674 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1383/2756] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:21:50 2022] DELETE /identity/v3/users/1d811dc93ede4dbebc25f91027b6dfa9 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:52.258092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:52.259605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:52.295434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfd06-220a-4968-a219-47fa94de11fd service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:52.532428 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:52.653383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:52.659255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:52.664527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:52.664527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] PATH_INFO: `/v3/projects/8212ea2596df443dbc6cf5494d994b7b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:52.670542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8212ea2596df443dbc6cf5494d994b7b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:52.672507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:52.878119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:52.879025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:52.879460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:52.882098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1384/2757] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:21:52.901273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:52.903269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:53.028223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8212ea2596df443dbc6cf5494d994b7b', 'request_id': 'req-38adf920-6ae8-4f92-92ba-5dae97d7470c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:53.092952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8212ea2596df443dbc6cf5494d994b7b', 'request_id': 'req-38adf920-6ae8-4f92-92ba-5dae97d7470c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:53.174174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8212ea2596df443dbc6cf5494d994b7b', 'request_id': 'req-38adf920-6ae8-4f92-92ba-5dae97d7470c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:53.179439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:53.182089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:53.209910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] The token cache is being invalidate because project 8212ea2596df443dbc6cf5494d994b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:21:53.209910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:53.215707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-38adf920-6ae8-4f92-92ba-5dae97d7470c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:21:53.227399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1374/2758] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:21:52 2022] DELETE /identity/v3/projects/8212ea2596df443dbc6cf5494d994b7b => generated 0 bytes in 965 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:53.229033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836590-5232-4832-971c-9d794fdf0519 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:53.229327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836590-5232-4832-971c-9d794fdf0519 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:53.251952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836590-5232-4832-971c-9d794fdf0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:53.373167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b218e-73d9-4a97-900a-1995ff6e8bb3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:53.491125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fb836590-5232-4832-971c-9d794fdf0519 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:53.492416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fb836590-5232-4832-971c-9d794fdf0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:53.533967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:53.557287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:53.557287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:53.557287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:53.557287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:53.561071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf9e3d-7168-4a42-a832-ece9ac2f35a8 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:53.566092 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1385/2759] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:52 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 666 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:21:53.926548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:53.927820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:53.928059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1375/2760] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 700 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:53.928543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.017956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:54.021526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:54.053243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87557f8-c190-4b07-b211-68716db20194 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.053923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87557f8-c190-4b07-b211-68716db20194 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.054367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87557f8-c190-4b07-b211-68716db20194 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.055910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1376/2761] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:21:54.067283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1386/2762] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:21:54.068523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87557f8-c190-4b07-b211-68716db20194 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:54.092835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:54.094378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:54.114176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87557f8-c190-4b07-b211-68716db20194 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:54.127044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:54.128310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.129011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.130538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.131484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:21:54.132227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:54.134281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:54.147947 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:54.289147 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1377/2763] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:21:54.293218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:54.332017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:54.332187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eeb9-e3cd-41f5-8292-129fee914eca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:54.344153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:54.347761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:54.348916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.349494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.349958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.354645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:54.358060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:54.378181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d1681-ce1e-47af-b802-55dff0f591f3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:54.391961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:54.392932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.393705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.394891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.397526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:54.410685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b363fc-5dbc-417b-adec-e74c2520e9c9 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:54.429863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1387/2764] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:54 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:21:54.492408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.492960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.493463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.495326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1388/2765] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:21:54.512216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:54.514176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:54.527877 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1378/2766] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:21:54 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:54.533901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:54.550364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:54.581563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f155-a41e-4d5c-a931-64946693a2c4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:54.629009 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:54.817784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee63b2-4ff8-41e7-888b-f8f64bacf9aa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:54.833767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:54.834434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.834716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.834993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.840431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:54.840670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:54.841077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:54.841425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:54.841663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:54.842317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:54.852303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:54.853107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:54.877815 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1389/2767] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:54 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:21:55.030986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1379/2768] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:21:54 2022] POST /identity/v3/users => generated 292 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:21:55.035518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:55.086203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe431-2a29-42d3-97db-7e4ce382b06d tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:55.132264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:55.137936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:55.138231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:55.139961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:55.145233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:55.156437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf63f5-e9d1-4741-97c9-c2501188a0f0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:55.223495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1390/2769] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:21:55.227730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:55.263572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c570e-7032-4a9d-bc8d-7253a9e51a1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:55.264339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:55.264627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:55.264898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:55.274829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:55.278999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:55.285150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:55.285150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:55.292396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:55.303665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:55.351355 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1380/2770] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:21:55.387927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:55.396912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] MFA Rules not processed for user `90371d04c0ad4aeba7780f85721cf7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:55.413887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:55.468816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054db273-7ac2-432f-ad64-bd64af585911 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:55.480619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:55.483024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:55.483561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:55.483944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] PATH_INFO: `/v3/projects/d342baf2538340e292e44dfc622b86fc/users/94448bbc2f4a4efaa86792f1511ff15c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:55.568040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d342baf2538340e292e44dfc622b86fc, user_id=94448bbc2f4a4efaa86792f1511ff15c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:55.574992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1afb56-02f9-4e80-8d0e-e21e00898cad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:55.692977 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1381/2771] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:21:55 2022] PUT /identity/v3/projects/d342baf2538340e292e44dfc622b86fc/users/94448bbc2f4a4efaa86792f1511ff15c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:21:55.695879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378156-caeb-48d2-8cd4-5d00c9af4a69 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:55.696164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378156-caeb-48d2-8cd4-5d00c9af4a69 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:55.696435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97378156-caeb-48d2-8cd4-5d00c9af4a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:55.743908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-97378156-caeb-48d2-8cd4-5d00c9af4a69 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:55.745686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-97378156-caeb-48d2-8cd4-5d00c9af4a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:55.833130 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1391/2772] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:55.959278 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1382/2773] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:56.048225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:56.049704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:56.245831 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:56.351032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:56.351378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:56.351662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:56.366094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a159b-03d3-47c3-8677-c17b89c9fe84 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:56.438217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] MFA Rules not processed for user `d6e0e5acf53b4abe99c3418c82d47ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:56.439463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:56.471775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:56.473008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:56.473612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:56.474103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:56.524673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:56.526390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f936bfc-d2ff-4307-abcc-c538e48e39eb service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:56.558784 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1392/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:56.616104 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1383/2775] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:57.099841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:57.100798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:57.101273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:57.140728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:57.147076 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:57.170258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] MFA Rules not processed for user `4f1e4052cfb4446b9c89288f8fc7e76c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:21:57.172092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:21:57.367889 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1393/2776] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:21:57.422736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30092e-e797-48d0-8aae-0a84c74d21e3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:57.443892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:57.451408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:57.451408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:57.451408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:57.472773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:57.475083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2843a-0963-4d89-8e22-445eafb15240 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:57.501798 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1384/2777] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:58.179880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:58.203878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d349f-062d-4a17-9a4f-a47c00ce7d2f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:58.216296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:58.216935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:58.217308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:58.217675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:58.235474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:58.237258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:58.280674 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1394/2778] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:21:58 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:21:59.462145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f6e6-0bc7-4a32-898d-167067bcae2c None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:59.462732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f6e6-0bc7-4a32-898d-167067bcae2c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:59.462732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131f6e6-0bc7-4a32-898d-167067bcae2c None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:59.464556 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1385/2779] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:21:59.482018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:21:59.497762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:21:59.641733 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:21:59.656459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979afe46-c985-42d8-9006-36290b2ac89a service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:21:59.672506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:21:59.673512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:21:59.674086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:21:59.674548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:21:59.675992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:21:59.683276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:21:59.701065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1395/2780] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:21:59 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:01.396347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2706-9b8a-48e5-aace-18b982083d4b None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:01.397212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2706-9b8a-48e5-aace-18b982083d4b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:01.397212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b2706-9b8a-48e5-aace-18b982083d4b None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:01.398278 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1386/2781] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:22:01.404145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:22:01.438211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:01.466964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f56e3-1660-4c40-82a5-d81000db1bec tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:01.482812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:01.484670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:01.485296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:01.502746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:01.502746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:01.513970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:01.539063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1396/2782] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:22:01 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:02.608969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6cb-c428-4e26-a1c0-f70f5a6c27bb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:02.609603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6cb-c428-4e26-a1c0-f70f5a6c27bb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:02.609798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a6cb-c428-4e26-a1c0-f70f5a6c27bb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:02.611594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1387/2783] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:22:02.630325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:22:02.648395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:02.677112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb3f6-521c-4853-bbc4-32a27e0c3737 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:02.693785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:02.694824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:02.695592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:02.696145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:02.698509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:02.701296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484a068-3fbc-4249-a910-85cbcf591784 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:02.716108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1397/2784] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:22:02 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:03.016062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc076-e001-4451-856b-14f413a383b3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:03.016820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc076-e001-4451-856b-14f413a383b3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:03.017516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc076-e001-4451-856b-14f413a383b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:03.075699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5fdfc076-e001-4451-856b-14f413a383b3 None None] MFA Rules not processed for user `90371d04c0ad4aeba7780f85721cf7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:03.081291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5fdfc076-e001-4451-856b-14f413a383b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:03.295753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1388/2785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:05.712929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:05.721897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:05.724016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:05.737862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:05.739093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:05.739325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:05.741389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1389/2786] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:22:05.763165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:22:05.785011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:05.786694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:05.808022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:05.861044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73b215-6e2f-453e-aada-d8a443cd2e1f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:05.878993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1301b8b05d01412280b80e1996f9e4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a2242f9af98476980b282e8c2102912', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:05.881006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:05.885765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:05.887843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:05.899843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorizing `identity:get_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:05.911673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:05.924630 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1390/2787] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:22:05 2022] GET /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 381 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:05.925834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:05.933212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:05.958358 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1398/2788] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:06.116923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:06.119888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:06.164830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a2091-7030-47f6-8067-824dc7946919 tempest-QuotasAdminNegativeTest-135448807 tempest-QuotasAdminNegativeTest-135448807-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:06.170444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1ddf-ec4b-4584-8ba0-2d03b274b392 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:06.174496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:06.178012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:06.178012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:06.178012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:06.178604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:06.191611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:06.192260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:06.192540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:06.192810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] PATH_INFO: `/v3/users/ce9f71f892094c2685b175e111fe7cf9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:06.199424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:06.202580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9f71f892094c2685b175e111fe7cf9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:06.206657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:06.212093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:06.222392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1391/2789] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:06.510996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9f71f892094c2685b175e111fe7cf9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:06.648400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:06.649945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:06.681205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c924c5-c748-4ac4-9816-b55317fa3b6f service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:06.705544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:06.706289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:06.706702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:06.706988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] PATH_INFO: `/v3/users/90371d04c0ad4aeba7780f85721cf7cc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:06.710433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90371d04c0ad4aeba7780f85721cf7cc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:06.712397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:06.727447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9f71f892094c2685b175e111fe7cf9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:06.728907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9f71f892094c2685b175e111fe7cf9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:06.780508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9f71f892094c2685b175e111fe7cf9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:06.780508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3142a57c-e8f7-41bd-97a8-27e92fb338dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9f71f892094c2685b175e111fe7cf9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:06.790091 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:06.799916 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1399/2790] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:06 2022] DELETE /identity/v3/users/ce9f71f892094c2685b175e111fe7cf9 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:07.353185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90371d04c0ad4aeba7780f85721cf7cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:07.356641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90371d04c0ad4aeba7780f85721cf7cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:07.375070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90371d04c0ad4aeba7780f85721cf7cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:07.377730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90371d04c0ad4aeba7780f85721cf7cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:07.479369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90371d04c0ad4aeba7780f85721cf7cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:07.523964 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1392/2791] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:06 2022] DELETE /identity/v3/users/90371d04c0ad4aeba7780f85721cf7cc => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:07.528873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aafc9-c1f8-4fab-b20d-71f96bbb969a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:07.529281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aafc9-c1f8-4fab-b20d-71f96bbb969a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:07.529700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4aafc9-c1f8-4fab-b20d-71f96bbb969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:07.636549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0c4aafc9-c1f8-4fab-b20d-71f96bbb969a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:07.640425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c4aafc9-c1f8-4fab-b20d-71f96bbb969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:07.816628 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:07.864907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1400/2792] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:07.870953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:07.872545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:07.915349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43b0da-c783-4fae-82a8-1c98169f34ca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:07.916295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43b0da-c783-4fae-82a8-1c98169f34ca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:07.916630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43b0da-c783-4fae-82a8-1c98169f34ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:07.993710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fb43b0da-c783-4fae-82a8-1c98169f34ca None None] MFA Rules not processed for user `d6e0e5acf53b4abe99c3418c82d47ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:07.999642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb43b0da-c783-4fae-82a8-1c98169f34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:08.061505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383548bd-d076-4f8b-8f12-2fda9308b836 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:08.076187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:08.077131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:08.077637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:08.078261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:08.106240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:08.112040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:08.161276 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1393/2793] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:22:08.234769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1401/2794] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:08.356735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:08.364093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:08.405716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cc8d-f16a-4e66-a16c-258b39bb7079 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:08.423790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:08.424445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:08.425221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:08.425687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] PATH_INFO: `/v3/projects/a766acde7eab4b05866a2c33f5dd3606` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:08.427670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a766acde7eab4b05866a2c33f5dd3606)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:08.431115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:08.619996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a766acde7eab4b05866a2c33f5dd3606', 'request_id': 'req-44919cfc-bd25-4b58-a861-7274fe9adaea'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:08.642737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a766acde7eab4b05866a2c33f5dd3606', 'request_id': 'req-44919cfc-bd25-4b58-a861-7274fe9adaea'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:08.740751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a766acde7eab4b05866a2c33f5dd3606', 'request_id': 'req-44919cfc-bd25-4b58-a861-7274fe9adaea'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:08.761118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] The token cache is being invalidate because project a766acde7eab4b05866a2c33f5dd3606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:08.764324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:08.768271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44919cfc-bd25-4b58-a861-7274fe9adaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:08.770962 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1394/2795] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:08 2022] DELETE /identity/v3/projects/a766acde7eab4b05866a2c33f5dd3606 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:08.776072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:08.776536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:08.779532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:08.816377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:08.818304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:09.012505 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1402/2796] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:09.027788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.028805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.029266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.059869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:09.061942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:09.074826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1395/2797] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:09.078099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.098165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa5eb-f5ef-4776-89f9-b6f2fe96c526 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.123277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.123915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.124201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.124474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.125186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:09.131157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.132940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.148797 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1403/2798] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:09.153512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.168956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce47198-5e90-4da4-b36a-9cab6132c9ee None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.183763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.184448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.184727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.185008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.185680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.194339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.223252 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:09.312951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.314789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:09.358461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1396/2799] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:09 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:09.358752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2463500-fe68-4f1f-b5a8-aa452c38c912 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.360412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.552480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6d7c6-6aae-452c-8d69-873095c76c78 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.567312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.567982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.568264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.568538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] PATH_INFO: `/v3/projects/8fb45c128cef4500a837862a5609284f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.577140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb45c128cef4500a837862a5609284f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.578358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.579877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.580532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.581636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.581916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.584327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.588983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.709442 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1397/2800] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:09 2022] POST /identity/v3/users => generated 295 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:09.711599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.725290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99fdb-5cc3-4dc7-ac7a-8b91e2c45e5f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.731579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.732714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.732918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.733432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.734200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.736242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.748034 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:09.763804 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1398/2801] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:09.764973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.795017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb45c128cef4500a837862a5609284f', 'request_id': 'req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:09.799296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4d3e-a479-4aa0-b7c5-9c3a717b99d8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.896994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb45c128cef4500a837862a5609284f', 'request_id': 'req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:09.910976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb45c128cef4500a837862a5609284f', 'request_id': 'req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:09.931111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] The token cache is being invalidate because project 8fb45c128cef4500a837862a5609284f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:09.931895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:09.932596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:09.934547 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1404/2802] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:09 2022] DELETE /identity/v3/projects/8fb45c128cef4500a837862a5609284f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:09.939158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.943595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:09.948054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.948595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.948868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.949132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.949820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.952287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:09.968093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1399/2803] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:09.969064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:09.972753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:09.972909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e1d2c-c72c-493c-b66e-bf6cdd9b80a2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:09.978195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:09.981030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:09.981542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:09.982001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] PATH_INFO: `/v3/users/1301b8b05d01412280b80e1996f9e4a1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:09.983756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1301b8b05d01412280b80e1996f9e4a1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:09.986029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:10.015579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f057a0-c1fd-4c3c-8e84-545e01195921 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:10.029491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:10.030647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:10.032124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:10.032678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] PATH_INFO: `/v3/projects/4cd1868480e44540be85a8c2862cd780/users/055b96d1eb20418d96450efde939e020/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:10.065798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd1868480e44540be85a8c2862cd780, user_id=055b96d1eb20418d96450efde939e020, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:10.068853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c68e73-85db-4f80-8e94-acfc1c0b5e64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:10.192502 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1400/2804] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:09 2022] PUT /identity/v3/projects/4cd1868480e44540be85a8c2862cd780/users/055b96d1eb20418d96450efde939e020/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:10.198850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:10.198977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:10.199231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:10.244843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:10.252544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:10.331664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1301b8b05d01412280b80e1996f9e4a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:10.407917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1401/2805] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:10.466659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1301b8b05d01412280b80e1996f9e4a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:10.467748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1301b8b05d01412280b80e1996f9e4a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:10.499586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1301b8b05d01412280b80e1996f9e4a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:10.518659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af33f3ee-69f5-4c95-8828-bc354617fd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1301b8b05d01412280b80e1996f9e4a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:10.520413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:10.522481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:10.533567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1405/2806] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:09 2022] DELETE /identity/v3/users/1301b8b05d01412280b80e1996f9e4a1 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:10.706182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc634e8c-d2d1-449b-952b-1e52eb9b4e8d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:10.855908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:10.857175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:10.860715 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:10.864866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:10.864866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:10.864866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:11.065110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:11.069476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:11.117051 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1402/2807] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:11.379555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:11.380041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:11.380202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:11.482172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] MFA Rules not processed for user `94448bbc2f4a4efaa86792f1511ff15c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:11.489586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:11.616082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1406/2808] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:11.622140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:11.623849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:11.658965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368125d-7752-4dc0-a2c9-1996d1608bd4 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:11.705782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:11.710482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:11.710482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:11.711497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:11.725832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:11.735515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:11.883208 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1403/2809] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:11 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:11.885087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:11.905638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57349ae-01ed-4269-b203-2b92e61b316e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:11.926235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:11.929865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:11.959662 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:11.995450 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:12.091715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061ab08-c25d-4b07-a151-38ea8b00f666 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.098649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.098649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.098649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.099308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] PATH_INFO: `/v3/projects/3a2242f9af98476980b282e8c2102912` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.100620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2242f9af98476980b282e8c2102912)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.102498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.103090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.103227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.104798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.105086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.105771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.112617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.211542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1407/2810] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:11 2022] POST /identity/v3/users => generated 299 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:12.215976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:12.234017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb258-8420-45a3-91f9-d8eb4fb05e76 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.242810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.245528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.245528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.245528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.246793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.248683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.265478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2242f9af98476980b282e8c2102912', 'request_id': 'req-6ba92554-6afa-4305-88c2-40f59355e8c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:12.269089 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1408/2811] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:22:12.271295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:12.273769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2242f9af98476980b282e8c2102912', 'request_id': 'req-6ba92554-6afa-4305-88c2-40f59355e8c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:12.292212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f69c4f-f02e-475e-92f7-025bcdb7380d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.376108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.377047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.377506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.378044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] PATH_INFO: `/v3/projects/b2cbf0a7e18f4306a93e578827220bd3/users/778b68f8ac754d7689c6686f015deaa6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.382829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2242f9af98476980b282e8c2102912', 'request_id': 'req-6ba92554-6afa-4305-88c2-40f59355e8c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:12.397477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cbf0a7e18f4306a93e578827220bd3, user_id=778b68f8ac754d7689c6686f015deaa6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.401169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.419575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] The token cache is being invalidate because project 3a2242f9af98476980b282e8c2102912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:12.423624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:12.423624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6ba92554-6afa-4305-88c2-40f59355e8c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:12.437593 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1404/2812] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:11 2022] DELETE /identity/v3/projects/3a2242f9af98476980b282e8c2102912 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:12.439566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821d4e-0560-42b7-b7f1-0fe3c66c224c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.440099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821d4e-0560-42b7-b7f1-0fe3c66c224c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.440630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821d4e-0560-42b7-b7f1-0fe3c66c224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.479221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a8821d4e-0560-42b7-b7f1-0fe3c66c224c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:12.481645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a8821d4e-0560-42b7-b7f1-0fe3c66c224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:12.504156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1405/2813] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:12.526133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1409/2814] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:12 2022] PUT /identity/v3/projects/b2cbf0a7e18f4306a93e578827220bd3/users/778b68f8ac754d7689c6686f015deaa6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:12.530743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:12.534764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.537500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:12.537650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.537906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.561118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:12.562555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:12.692533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312367-cb3f-4b33-9771-18570f9de59f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.711166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.711166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.711166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.711488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.712586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.716926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.730757 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1406/2815] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:12.735089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:12.742368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1410/2816] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:12.749038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:12.765938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caace1da-948e-46d3-86e5-9e108c5729d5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.767689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8a87-fa31-4e2c-9e33-ade4d492b30b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:12.774634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.775668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:12.776178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.779976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:12.780251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.782331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:12.783522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] PATH_INFO: `/v3/projects/b2cbf0a7e18f4306a93e578827220bd3/users/778b68f8ac754d7689c6686f015deaa6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.785453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:12.785453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:12.785453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.789816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cbf0a7e18f4306a93e578827220bd3, user_id=778b68f8ac754d7689c6686f015deaa6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:12.790306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.794287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:12.834495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1411/2817] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:12 2022] PUT /identity/v3/projects/b2cbf0a7e18f4306a93e578827220bd3/users/778b68f8ac754d7689c6686f015deaa6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:12.866698 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1407/2818] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:12.874028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.039590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d1659-cc5f-46e5-a800-5f971aae0a45 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:13.045659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:13.046988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.049538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.049538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.049538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:13.052068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:13.162765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1412/2819] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:12 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:13.168978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.181160 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:13.187302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64b13-a4d7-4aba-97fb-5a6e0d9f1cbe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:13.231295 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:13.268776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:13.269424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.269961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.270236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.270864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:13.272978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:13.364103 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1408/2820] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:13 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:13.369391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.388628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248402-6256-4290-a1df-4bba1955bf23 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:13.400968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:13.401619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.401996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.402269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.404372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:13.409513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:13.432799 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1413/2821] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:13.433788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.446554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd875da-9d15-4f31-aba7-83dc6c466f6f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:13.459880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:13.460870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.461289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.461593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.462253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:13.464396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad863-ac5b-4594-9929-273397a5156e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:13.495266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1409/2822] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:13.499259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.519964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08a7fa-1726-4fcc-a406-78f28ac53ab4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:13.530952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:13.531811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.532207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.532594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] PATH_INFO: `/v3/projects/4aa9c648b20d41d7b150fbf64cde6fe8/users/f857d6b0826e47c6875a307e7ccfb104/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.560916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa9c648b20d41d7b150fbf64cde6fe8, user_id=f857d6b0826e47c6875a307e7ccfb104, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:13.564524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:13.696787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1414/2823] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:13 2022] PUT /identity/v3/projects/4aa9c648b20d41d7b150fbf64cde6fe8/users/f857d6b0826e47c6875a307e7ccfb104/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:13.703091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436d38-17e6-436d-ac34-801b3c94ff2b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:13.703380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436d38-17e6-436d-ac34-801b3c94ff2b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:13.703850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3436d38-17e6-436d-ac34-801b3c94ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:13.764338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c3436d38-17e6-436d-ac34-801b3c94ff2b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:13.767380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3436d38-17e6-436d-ac34-801b3c94ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:13.882722 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1410/2824] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:13.898944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:13.901627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:14.077311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90728d3b-87ed-41a6-b1c9-1079b31251f5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:14.090787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:14.092739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:14.095866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:14.095866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:14.111090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:14.112187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:14.126942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1415/2825] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:19.684613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb168a4-87d4-4e0d-9ce1-2a05b4681813 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:19.684613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb168a4-87d4-4e0d-9ce1-2a05b4681813 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:19.685230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb168a4-87d4-4e0d-9ce1-2a05b4681813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:19.745582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5eb168a4-87d4-4e0d-9ce1-2a05b4681813 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:19.746874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5eb168a4-87d4-4e0d-9ce1-2a05b4681813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:19.769841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:19.779813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e509-5c30-42e4-8cbe-f9a62302fd01 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:19.794830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:19.795442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:19.796014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:19.796290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:19.799801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:19.850657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:19.852383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:19.903979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1416/2826] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:22:19.988389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1411/2827] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:22:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:20.012007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:20.013645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:20.106074 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:20.138768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedcdc8-1de5-46e4-b40a-4f03b4d7cc2d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:20.145405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:20.146210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:20.146565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:20.147244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:20.158460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:20.160443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245889-57d4-4dbc-9ab0-44946fb5fcc9 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:20.176363 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1417/2828] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:22:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:26.584906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:26.585535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:26.585716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:26.662887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] MFA Rules not processed for user `055b96d1eb20418d96450efde939e020`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:26.667596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:26.800436 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:26.858052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:26.858565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:26.858750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:26.861767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1412/2829] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:26.898294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] MFA Rules not processed for user `055b96d1eb20418d96450efde939e020`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:26.899661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:26.913621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1418/2830] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:27.475819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:27.478299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:27.740280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393420e9-ce91-4920-bca9-0cdfe226b0d4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:27.774205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:27.774813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:27.775087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:27.775554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:27.804634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:27.806293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce732e-3113-4bdc-8795-d5d3fb32bb3c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:27.832200 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1413/2831] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:31.949566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:31.950748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:32.097630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d5db6-0605-4b55-bc43-605dbc3e44d9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:32.110819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:32.111647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:32.112178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:32.117611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:32.117611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:32.146089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:32.149042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:32.198952 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1419/2832] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:36.477554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efb5a-1542-4636-a63c-483bf0f4c4ef None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:36.478116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efb5a-1542-4636-a63c-483bf0f4c4ef None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:36.478116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4efb5a-1542-4636-a63c-483bf0f4c4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:36.508438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5c4efb5a-1542-4636-a63c-483bf0f4c4ef None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:36.511022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5c4efb5a-1542-4636-a63c-483bf0f4c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:36.534101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1414/2833] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:22:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:36.550437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:36.571139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcf8f-daa7-4021-ad84-65f17e1f8984 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:36.588578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:36.589211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:36.589602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:36.589874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:36.618749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:36.621305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eba8c-d3e1-4343-8458-b2a3f7e8735d service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:36.650922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1420/2834] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:22:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:38.396243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:38.396721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:38.396858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:38.433742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:38.437283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:38.535813 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1415/2835] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:38.548735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2f716-7e50-4165-854d-a6250ec663d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:38.549263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2f716-7e50-4165-854d-a6250ec663d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:38.549263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2f716-7e50-4165-854d-a6250ec663d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:38.575080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-17c2f716-7e50-4165-854d-a6250ec663d4 None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:38.576865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-17c2f716-7e50-4165-854d-a6250ec663d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:38.584154 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1421/2836] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:38.598515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:38.625712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db22d2-a537-4b99-a90e-c50edef5b3aa None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:38.635961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:38.635961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:38.635961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:38.636707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:38.648111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:38.650040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:38.663364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1416/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:41.941696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:41.942298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:41.942298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:42.021447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] MFA Rules not processed for user `778b68f8ac754d7689c6686f015deaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:42.022931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:42.185759 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1422/2838] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:42.199071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:42.201451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:42.309951 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:42.359090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3174880-6b97-40e5-8b6e-c6ebf65bd8cd service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:42.370295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:42.371085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:42.371371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:42.371644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:42.396873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:42.398578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:42.431234 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1417/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:49.998153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:50.005637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:50.038754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456459-2cec-4bbf-96ae-c27023564b22 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:50.054252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:50.055149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:50.055578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:50.055992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] PATH_INFO: `/v3/users/2096bbb8aff742b1837931e52ac1c9ae` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:50.058252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2096bbb8aff742b1837931e52ac1c9ae)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:50.060336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:50.077326 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:50.083750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:50.085158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:50.105162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594871d-2e0f-4546-9058-2fa190be488e service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:50.114165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:50.114884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:50.115165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:50.115430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] PATH_INFO: `/v3/users/d815becbdc9d40e8b0ab90e97488018a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:50.123984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d815becbdc9d40e8b0ab90e97488018a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:50.129731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:50.265736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2096bbb8aff742b1837931e52ac1c9ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.286793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd815becbdc9d40e8b0ab90e97488018a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.287508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd815becbdc9d40e8b0ab90e97488018a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.295810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd815becbdc9d40e8b0ab90e97488018a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.296601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd815becbdc9d40e8b0ab90e97488018a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.315814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2096bbb8aff742b1837931e52ac1c9ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.317005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2096bbb8aff742b1837931e52ac1c9ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.336105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2096bbb8aff742b1837931e52ac1c9ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.345837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5d34915-05c3-422a-aef2-3f2b88d3c8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2096bbb8aff742b1837931e52ac1c9ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.354117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd815becbdc9d40e8b0ab90e97488018a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:50.370679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1423/2840] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:49 2022] DELETE /identity/v3/users/2096bbb8aff742b1837931e52ac1c9ae => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:50.419730 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1418/2841] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:50 2022] DELETE /identity/v3/users/d815becbdc9d40e8b0ab90e97488018a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:50.425250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:50.425564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:50.425869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:50.468175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:50.473416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:50.563929 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1424/2842] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:50.583263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:50.594741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:50.707951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562043-6160-4a3b-bf6a-b49c249f5be6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:50.712167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:50.712916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:50.713500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:50.713736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:50.724156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:50.725813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:50.759030 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1419/2843] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:50.802739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:50.804463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:50.833933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aaa3e-35e6-4e95-9e63-9c638d917043 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:50.839499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:50.840296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:50.840753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:50.841166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] PATH_INFO: `/v3/projects/301cee87901844ed94e635eca054960d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:50.843201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] RBAC: Authorizing `identity:delete_project(project_id=301cee87901844ed94e635eca054960d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:50.858120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:51.061384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301cee87901844ed94e635eca054960d', 'request_id': 'req-f3973ae5-c62f-425f-9442-2b564da0742d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.143516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301cee87901844ed94e635eca054960d', 'request_id': 'req-f3973ae5-c62f-425f-9442-2b564da0742d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.153687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301cee87901844ed94e635eca054960d', 'request_id': 'req-f3973ae5-c62f-425f-9442-2b564da0742d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.181310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] The token cache is being invalidate because project 301cee87901844ed94e635eca054960d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:51.182547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.183389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.190397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:51.205128 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1425/2844] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:50 2022] DELETE /identity/v3/projects/301cee87901844ed94e635eca054960d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:51.208567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aac34-5977-4232-be46-dac367fb17b1 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:51.298405 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:51.304615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:51.305269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:51.305576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:51.305853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] PATH_INFO: `/v3/users/87e70e80072d4b4b86392aae982b9d06` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:51.307832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e70e80072d4b4b86392aae982b9d06)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:51.310166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:51.592911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:51.594714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:51.642949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e70e80072d4b4b86392aae982b9d06'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.644005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e70e80072d4b4b86392aae982b9d06'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.669184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973ae5-c62f-425f-9442-2b564da0742d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:51.692181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:51.698147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:51.698580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:51.703749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e70e80072d4b4b86392aae982b9d06'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.704581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] PATH_INFO: `/v3/users/4f1e4052cfb4446b9c89288f8fc7e76c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:51.710207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e70e80072d4b4b86392aae982b9d06'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.710988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1e4052cfb4446b9c89288f8fc7e76c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:51.716059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:51.744731 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:51.885175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e70e80072d4b4b86392aae982b9d06'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:51.957556 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1420/2845] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:51 2022] DELETE /identity/v3/users/87e70e80072d4b4b86392aae982b9d06 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:51.957556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:51.959779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:52.037092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1e4052cfb4446b9c89288f8fc7e76c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.139641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31501-ea50-4ff8-9c24-6766b627b839 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:52.160272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:52.160790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1e4052cfb4446b9c89288f8fc7e76c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.161254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:52.161254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:52.161546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1e4052cfb4446b9c89288f8fc7e76c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.161621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] PATH_INFO: `/v3/projects/8c9fa6465cb74679921935af37294eca` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:52.164141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9fa6465cb74679921935af37294eca)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:52.166900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:52.210033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1e4052cfb4446b9c89288f8fc7e76c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.249668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1e4052cfb4446b9c89288f8fc7e76c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.279450 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1426/2846] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:51 2022] DELETE /identity/v3/users/4f1e4052cfb4446b9c89288f8fc7e76c => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:52.331907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9fa6465cb74679921935af37294eca', 'request_id': 'req-b4247e6c-e569-442f-8892-5da1f77cf80b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.375627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9fa6465cb74679921935af37294eca', 'request_id': 'req-b4247e6c-e569-442f-8892-5da1f77cf80b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.479801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9fa6465cb74679921935af37294eca', 'request_id': 'req-b4247e6c-e569-442f-8892-5da1f77cf80b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.500707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] The token cache is being invalidate because project 8c9fa6465cb74679921935af37294eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:52.501140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.503125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:52.504737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1421/2847] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:51 2022] DELETE /identity/v3/projects/8c9fa6465cb74679921935af37294eca => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:52.509059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:52.511805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:52.700652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669fec-e6f0-4dcd-8be5-644dec86146b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:52.817021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:52.817918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:52.818201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:52.818477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] PATH_INFO: `/v3/users/d6cf8d92d1394fc78066bde19458624d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:52.821231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cf8d92d1394fc78066bde19458624d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:52.824732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:53.132544 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:53.177398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cf8d92d1394fc78066bde19458624d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:53.260786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cf8d92d1394fc78066bde19458624d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:53.261852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cf8d92d1394fc78066bde19458624d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:53.283330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cf8d92d1394fc78066bde19458624d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:53.301182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cf8d92d1394fc78066bde19458624d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:53.316511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1427/2848] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:22:52 2022] DELETE /identity/v3/users/d6cf8d92d1394fc78066bde19458624d => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:54.006060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:54.008242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:54.009059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:54.010545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:54.045815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4247e6c-e569-442f-8892-5da1f77cf80b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:54.058263 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:54.187409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517aeef8-ca2a-421b-b082-002862fe9934 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:54.221973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:54.222902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:54.223316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:54.224190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] PATH_INFO: `/v3/projects/8348044d5ea546a48d0ad2d2de60298b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:54.226432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8348044d5ea546a48d0ad2d2de60298b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:54.227258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:54.230608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:54.231213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:54.231724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:54.232199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] PATH_INFO: `/v3/projects/6cd2df29276f4bcdbf3329c684d5086a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:54.235225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd2df29276f4bcdbf3329c684d5086a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:54.239456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:54.484373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd2df29276f4bcdbf3329c684d5086a', 'request_id': 'req-bbffe8da-2317-4142-b7b6-166d13371922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.488066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8348044d5ea546a48d0ad2d2de60298b', 'request_id': 'req-cdd29295-2759-4751-ab7d-5b78ac1445fb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.520936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd2df29276f4bcdbf3329c684d5086a', 'request_id': 'req-bbffe8da-2317-4142-b7b6-166d13371922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.605776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8348044d5ea546a48d0ad2d2de60298b', 'request_id': 'req-cdd29295-2759-4751-ab7d-5b78ac1445fb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.622601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8348044d5ea546a48d0ad2d2de60298b', 'request_id': 'req-cdd29295-2759-4751-ab7d-5b78ac1445fb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.663105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] The token cache is being invalidate because project 8348044d5ea546a48d0ad2d2de60298b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:54.664154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.665311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.667418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1428/2849] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:54 2022] DELETE /identity/v3/projects/8348044d5ea546a48d0ad2d2de60298b => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:54.668430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:54.671404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:54.762439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd2df29276f4bcdbf3329c684d5086a', 'request_id': 'req-bbffe8da-2317-4142-b7b6-166d13371922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.776170 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:54.799406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] The token cache is being invalidate because project 6cd2df29276f4bcdbf3329c684d5086a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:54.799737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.809204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bbffe8da-2317-4142-b7b6-166d13371922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:54.812026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1422/2850] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:54 2022] DELETE /identity/v3/projects/6cd2df29276f4bcdbf3329c684d5086a => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:54.813296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae6a7-9340-4741-ae69-e879acc43a26 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:54.813591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae6a7-9340-4741-ae69-e879acc43a26 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:54.813870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ae6a7-9340-4741-ae69-e879acc43a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:54.819454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd29295-2759-4751-ab7d-5b78ac1445fb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:54.862987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5f2ae6a7-9340-4741-ae69-e879acc43a26 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:54.864214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f2ae6a7-9340-4741-ae69-e879acc43a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:54.984038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:54.985225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:54.985749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:54.986263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] PATH_INFO: `/v3/projects/68d62691454a417da77320f6f8c2957c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:54.987890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d62691454a417da77320f6f8c2957c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:54.992480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.059730 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1423/2851] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.077609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465f75-4378-453e-80bd-dc6f6ce535f3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.078072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465f75-4378-453e-80bd-dc6f6ce535f3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.078350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a465f75-4378-453e-80bd-dc6f6ce535f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.193064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6a465f75-4378-453e-80bd-dc6f6ce535f3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:55.194446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a465f75-4378-453e-80bd-dc6f6ce535f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:55.200732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d62691454a417da77320f6f8c2957c', 'request_id': 'req-3666cde8-4aab-4882-9e53-bc9389ebe097'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:55.248700 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:55.279468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d62691454a417da77320f6f8c2957c', 'request_id': 'req-3666cde8-4aab-4882-9e53-bc9389ebe097'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:55.290919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d62691454a417da77320f6f8c2957c', 'request_id': 'req-3666cde8-4aab-4882-9e53-bc9389ebe097'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:55.294940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1424/2852] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.296541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fe3f-750c-4a52-b3d2-d676acc30a06 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.297025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fe3f-750c-4a52-b3d2-d676acc30a06 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.297543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fe3f-750c-4a52-b3d2-d676acc30a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.336359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] The token cache is being invalidate because project 68d62691454a417da77320f6f8c2957c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:22:55.336714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:55.337722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666cde8-4aab-4882-9e53-bc9389ebe097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:22:55.340701 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1429/2853] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:22:54 2022] DELETE /identity/v3/projects/68d62691454a417da77320f6f8c2957c => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:55.344713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.345004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.345280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.350691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5a50fe3f-750c-4a52-b3d2-d676acc30a06 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:55.352292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5a50fe3f-750c-4a52-b3d2-d676acc30a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:55.366923 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1425/2854] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.369031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.369579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.370095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.402896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:55.404309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:55.419813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:55.421243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:55.440637 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1430/2855] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.444078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.471920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1426/2856] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.480409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.493614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b6143-878b-4dc0-8c91-28f30e516815 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.506374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.507348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.508377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.508797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.513866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a274a4-e0ce-42d9-b150-c430154b3fb1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.516053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:55.520655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.521594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd5a1-7193-44a8-98ae-929dcaf74b27 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.524902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.526934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.527321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.527690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.533003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:55.533484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.537038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.564022 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1431/2857] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:55.565761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.566180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.566584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.581191 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1427/2858] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:55.582540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.595389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0d79-9421-46f3-ad73-ebd898112cd1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.600494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.602189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.602578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.603073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.603886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.606468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.607949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:55.609172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:55.633483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1432/2859] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:55.634821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.661257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a42719-c53c-4399-8f80-3be497bae6bb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.668067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.668887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.669239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.670062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.670846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.673430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.696843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1428/2860] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:55.705560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.809615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1433/2861] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:55.809615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.842522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e446-3bfb-49b4-a265-8521b01b5148 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.889641 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:55.933415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.934126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.934488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.934902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.935797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:55.936167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.937908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.949726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901cdaa-bfb5-4b9a-b1b3-846234c37594 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.956942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.957628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.958057 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1429/2862] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:22:55.959154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:55.961878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.962170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.962836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.965442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:55.971558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35c04-da31-480a-98ee-5fcacbc6c905 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:55.989993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:55.990709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:55.991068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:55.992059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:55.993250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:55.997115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.085078 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1434/2863] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:56.085982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.096458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f16ed-d14c-47d6-aa51-49729f031bdb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.102785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.103389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.103670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.103959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.104594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.111913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.153405 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1430/2864] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:55 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:56.154079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.167062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3e5b-ac2f-4799-9788-ddad68e876d9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.171954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.172560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.172838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.173105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.173769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.175601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.188706 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1431/2865] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.190020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.197002 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:56.206827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8328-9ad2-4037-941a-6d26a9c3a5f6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.218185 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1435/2866] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:56 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:56.222738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.224764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.225544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.226125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.226474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.227871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.230361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.246829 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1432/2867] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.246829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.262440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1932f-70e0-4fa9-a2e2-426f7052c15b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.332697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daaf312-5bd6-4461-9ead-a1af4fa385b8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.338924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.339681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.339962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.340235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.340885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.341780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.342460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.342917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.343005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.343258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.343957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.345966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.358847 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1436/2868] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.358847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.370166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b05e92-2202-4275-927f-344d7d1d8676 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.376059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.376059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.376059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.376059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.376716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.378240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b468b8-2446-4690-a558-cd9eb6e6fc36 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.389934 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1437/2869] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.390815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.391105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.391377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.411108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:56.412327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:56.432804 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1433/2870] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:56 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:56.433790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.444245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a7dc8-553f-4223-9eaa-7f7e2134599d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.450018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.450734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.451017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.451290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7/users/09db054841e748dabf56127304854eed/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.468008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1a98f7e93441e1932677676d85d0c7, user_id=09db054841e748dabf56127304854eed, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.470763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.487464 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1438/2871] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:56.490193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.503518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ded252-9316-48f2-9edd-c1b2d1d3e80b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.508071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.508806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.509084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.509398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] PATH_INFO: `/v3/projects/2a5e20978d1a4886b04d37eef4c23d1e/users/a1e23e3096f740508e6fb6626a29336f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.529696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5e20978d1a4886b04d37eef4c23d1e, user_id=a1e23e3096f740508e6fb6626a29336f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.532773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.558022 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1434/2872] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:56 2022] PUT /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7/users/09db054841e748dabf56127304854eed/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:56.558022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.612143 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1439/2873] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:56 2022] PUT /identity/v3/projects/2a5e20978d1a4886b04d37eef4c23d1e/users/a1e23e3096f740508e6fb6626a29336f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:56.612988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.616645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:56.639173 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:56.668715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f084-154f-40ff-af14-21b66de691a9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.710665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788f42b-ed40-4f51-b6d4-a0042f6a8a54 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.717652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.718192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.718478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.718751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.751657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.752462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.752880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.753213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.754165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.756074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fd713-1528-4a9c-8d9a-2a4c89852244 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.762541 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:56.768164 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1435/2874] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.769574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.769873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.770252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.787213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.788919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81c8c9-b5d3-4072-9bfd-3016566d3fb4 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.799423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1440/2875] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:22:56.802466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] MFA Rules not processed for user `09db054841e748dabf56127304854eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:56.804589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:56.809106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.809504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.809992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.832045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:56.833496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:56.844679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1441/2876] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:56.845767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.857821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356472b-69cf-4a8d-a695-539756e7fcf0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.865538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.866313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.866792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.867164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.867915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.869703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.884987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1442/2877] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:56.884987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.884987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:56.909279 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1436/2878] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:22:56.910177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:56.925083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959c336-3a17-4942-8f84-c48a173c8162 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.931169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.932257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.932690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:56.933115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] PATH_INFO: `/v3/projects/c06adceaeedd4244a472c64c929aa141/users/24c11fcdb66a4be0b770a0b96aaa07d6/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:56.983912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06adceaeedd4244a472c64c929aa141, user_id=24c11fcdb66a4be0b770a0b96aaa07d6, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:56.995179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ef01d-407c-4871-b8d6-8b7a7c8ac483 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:56.995989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584f708-3bdb-4681-bf5a-f130c683bb63 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:56.998962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:56.999577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:56.999856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.000323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.031853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.033744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.047217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1443/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:57.048563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.060719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b31242-7df0-4992-be83-6f46743f4154 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.066144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.066652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.067226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.067445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.068294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.070331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.100098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1437/2880] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:56 2022] PUT /identity/v3/projects/c06adceaeedd4244a472c64c929aa141/users/24c11fcdb66a4be0b770a0b96aaa07d6/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:57.113084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.113689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.113963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.160794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] MFA Rules not processed for user `24c11fcdb66a4be0b770a0b96aaa07d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:57.162313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:57.191107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1444/2881] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:57 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:57.195376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.227068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:57.313361 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1438/2882] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:22:57.314297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.346672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7cb60-92bd-4faf-9f35-60f8d84cee4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.375234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.376120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.376549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.376970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.377793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.386284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.456550 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:57.491462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88795aa-3609-4207-a671-0c91f080cdaf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.500374 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1445/2883] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:57 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:57.501404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.509705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.511286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.511592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.512077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.512732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.520290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.522251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798545a-a25e-4530-95db-34c43c20291b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.539426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.540152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.540336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.540600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.541395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.543021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.562288 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1446/2884] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:22:57.563417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.592440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571175a-4814-43c0-afd1-6107f9d7bedf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.615408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.616642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.617169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.620953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] PATH_INFO: `/v3/projects/6fe2ca4657814d00a860833773739515/users/240fca1fcc8c4a38b2bc42c25db13126/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.656181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe2ca4657814d00a860833773739515, user_id=240fca1fcc8c4a38b2bc42c25db13126, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.660422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:57.698451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1439/2885] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:57 2022] POST /identity/v3/projects => generated 379 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:57.704338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.829452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1447/2886] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:57 2022] PUT /identity/v3/projects/6fe2ca4657814d00a860833773739515/users/240fca1fcc8c4a38b2bc42c25db13126/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:57.833229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:57.846164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058e5c6-e99d-4e60-85e7-3127f9f8a902 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.974110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a04a-edeb-4937-accc-8bb976c4a8a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:57.981750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:57.982373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:57.982702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:57.982978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:57.984068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:57.986047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.013598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1448/2887] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:58.014532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.036393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.038150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.039900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.040331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.043161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.044551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461be1e-f6e9-45be-bd8b-994f583f6177 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.046562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.059414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.061005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.061449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] PATH_INFO: `/v3/projects/6fe2ca4657814d00a860833773739515/users/240fca1fcc8c4a38b2bc42c25db13126/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.063587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe2ca4657814d00a860833773739515, user_id=240fca1fcc8c4a38b2bc42c25db13126, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.070690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52550bc9-534c-416b-a4a7-af8ebeaf114e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.085942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1449/2888] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:58 2022] PUT /identity/v3/projects/6fe2ca4657814d00a860833773739515/users/240fca1fcc8c4a38b2bc42c25db13126/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:58.097355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.097818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.098195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.137785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] MFA Rules not processed for user `240fca1fcc8c4a38b2bc42c25db13126`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:58.139038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:58.181411 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1440/2889] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:22:57 2022] POST /identity/v3/users => generated 296 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:22:58.181411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.216579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b30bf-353a-46ef-9527-26f238f85b89 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.223186 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:58.276851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1450/2890] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:22:58.285959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.297320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322a9f8-9f95-436b-9e45-889579e95694 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.304966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.305825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.306353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.306772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.308119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:58.308754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.310759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.332299 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1451/2891] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:22:58.338919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.360625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef5fda-32ac-4de2-b8ca-3c09a0b3dd95 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.369084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.370752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.372064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.372388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.372704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.372998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.373437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.373624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.374381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.374510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.376605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.377571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.391172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1441/2892] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:58.397048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.410919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a16e-53cc-4b98-9b80-8f6123835eff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.417619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.417847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.418190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.418356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] PATH_INFO: `/v3/projects/1e5107632dd149218a4fb4e865bb445e/users/c889f69d49434623bb4c2c9195eeaa3a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.433148 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:58.439665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5107632dd149218a4fb4e865bb445e, user_id=c889f69d49434623bb4c2c9195eeaa3a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.442594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.489783 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1452/2893] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:22:58 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:22:58.494099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.516429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1442/2894] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:58 2022] PUT /identity/v3/projects/1e5107632dd149218a4fb4e865bb445e/users/c889f69d49434623bb4c2c9195eeaa3a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:22:58.524089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.603521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05511d-34c8-404d-ba52-0528c6a590df tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.656218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efee7d-1647-49e6-8309-07be38f8199f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.667983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.668924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.669306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.669714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.670609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.672525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.690393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1443/2895] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:22:58.704040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.704359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.705277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.705590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.705918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.706579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:22:58.706934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.709045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.717222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2f1d-7310-4456-9bdd-da4332b23d95 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:58.725063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:58.725909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.726442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.726838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] PATH_INFO: `/v3/projects/1e5107632dd149218a4fb4e865bb445e/users/c889f69d49434623bb4c2c9195eeaa3a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.729406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5107632dd149218a4fb4e865bb445e, user_id=c889f69d49434623bb4c2c9195eeaa3a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:58.733024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff96a3-63aa-49d2-b927-073fe60c8f65 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:58.744432 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1453/2896] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:22:58.748012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:58.751120 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1444/2897] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:22:58 2022] PUT /identity/v3/projects/1e5107632dd149218a4fb4e865bb445e/users/c889f69d49434623bb4c2c9195eeaa3a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:22:58.752461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:58.762526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:58.762874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:58.763209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:58.826422 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:58.840629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] MFA Rules not processed for user `c889f69d49434623bb4c2c9195eeaa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:22:58.842331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:58.912852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e1d62-844f-4eaf-84a9-fed2e18de16b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:59.062185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1445/2898] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:22:59.075473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:59.076148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:22:59.111572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:59.112466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.113013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.113453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.219072 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:22:59.277808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4de0d-02c5-4b3a-8ef3-fca2c1c96ee0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:59.283098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:59.287559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339657ad-e8dd-44b3-9333-819fe0663968 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:59.295997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:59.297061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.297061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.297579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.320110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:59.321799 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1454/2899] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:22:59.322455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339dfd0-61f6-47cb-b0e7-a4f35c0669a7 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:59.341179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.341518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.341899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.343291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1455/2900] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:22:59.351482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:22:59.357278 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1446/2901] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:22:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:22:59.401465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:59.427043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823b5a-761b-44cf-af0b-ea28f030c893 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:59.438765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:59.439405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.439690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.439960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/1967c4b534c34af2b66bdde096dbc126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.443337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=1967c4b534c34af2b66bdde096dbc126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:59.451151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:22:59.456445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1456/2902] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:22:59 2022] GET /identity/v3/projects/1967c4b534c34af2b66bdde096dbc126 => generated 369 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:22:59.916760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5bc03-aa60-4c61-9c49-6c6315fb9e97 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.917281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5bc03-aa60-4c61-9c49-6c6315fb9e97 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.917818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5bc03-aa60-4c61-9c49-6c6315fb9e97 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.919244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1447/2903] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:22:59.929279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:22:59.950252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:22:59.974455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb5f0-5d39-42ee-bed6-7a0efc644510 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:22:59.988468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:22:59.989268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:22:59.989580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:22:59.989855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/1967c4b534c34af2b66bdde096dbc126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:22:59.996097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=1967c4b534c34af2b66bdde096dbc126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:22:59.999240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5546a-c3d1-4ae1-88ec-2ddf24c810db tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:00.001059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1457/2904] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:22:59 2022] GET /identity/v3/projects/1967c4b534c34af2b66bdde096dbc126 => generated 369 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:00.371167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5bc03-aa60-4c61-9c49-6c6315fb9e97 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:00.479509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:00.482855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:00.482855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:00.482855 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1458/2905] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:00.490232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:00.523618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:00.542104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5bc03-aa60-4c61-9c49-6c6315fb9e97 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:00.547538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:00.548186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:00.548473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:00.551481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] PATH_INFO: `/v3/users/24c11fcdb66a4be0b770a0b96aaa07d6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:00.551481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c11fcdb66a4be0b770a0b96aaa07d6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:00.551883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:00.568657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefb73b-8b06-4958-9b65-22f010285619 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:00.576013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:00.576858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:00.577155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:00.580133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/1967c4b534c34af2b66bdde096dbc126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:00.580133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=1967c4b534c34af2b66bdde096dbc126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:00.582036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:00.584749 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1459/2906] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:00 2022] GET /identity/v3/projects/1967c4b534c34af2b66bdde096dbc126 => generated 369 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:00.615585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:00.626126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3df7d-31a2-43ad-8f20-0482ce0d726e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:00.633645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:00.634368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:00.634650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:00.634921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/1967c4b534c34af2b66bdde096dbc126` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:00.636226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1967c4b534c34af2b66bdde096dbc126)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:00.638263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:00.798345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c11fcdb66a4be0b770a0b96aaa07d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.799496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c11fcdb66a4be0b770a0b96aaa07d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.811776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c11fcdb66a4be0b770a0b96aaa07d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.812775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c11fcdb66a4be0b770a0b96aaa07d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.827344 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:00.840598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1967c4b534c34af2b66bdde096dbc126', 'request_id': 'req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.931202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-92ed524d-788c-4215-b09a-a9e2ddc31aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c11fcdb66a4be0b770a0b96aaa07d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:00.983161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1448/2907] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:00 2022] DELETE /identity/v3/users/24c11fcdb66a4be0b770a0b96aaa07d6 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:00.988259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:00.988548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:00.989028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.000297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1967c4b534c34af2b66bdde096dbc126', 'request_id': 'req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:01.020227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1967c4b534c34af2b66bdde096dbc126', 'request_id': 'req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:01.077055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] The token cache is being invalidate because project 1967c4b534c34af2b66bdde096dbc126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:01.077449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:01.079719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-662ac0df-1ac6-41b3-8ad5-a9ef766ca9c6 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:01.087696 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1460/2908] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:00 2022] DELETE /identity/v3/projects/1967c4b534c34af2b66bdde096dbc126 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:23:01.105055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:01.108206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:01.182211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:01.182604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:01.182922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.184933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1461/2909] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:01.196504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:01.199353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:01.306876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1449/2910] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:01.327222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:01.328658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:01.334402 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:01.347909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:01.354337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:01.425520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a48e9d-c9cf-4ac2-a44d-fe111d4f7f8e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:01.431408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:01.433738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:01.434022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:01.434292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.451041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:01.452499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:01.471050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1450/2911] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:01.497045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bafb8-efb1-4211-a468-ecd929d69337 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:01.514304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:01.514970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:01.515257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:01.515573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.520499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd1a98f7e93441e1932677676d85d0c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:01.523638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:01.542215 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1462/2912] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:01 2022] GET /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7 => generated 375 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:23:01.564327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:01.587953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978ea69-b5d8-4540-98b6-5ebf727b6a5a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:01.605054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:01.605905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:01.606203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:01.607134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.612458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:01.612458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:01.618849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:01.656158 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1451/2913] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:01.662161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:01.681027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48740-10c7-4fd4-a01c-651b6069427b tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:01.693287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:01.695034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:01.698621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:01.698621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:01.698621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:01.703080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01aa54-fd5e-4b94-bb9c-d0a68a867931 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:01.938878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:01.941717 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1463/2914] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:01 2022] POST /identity/v3/projects => generated 371 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:01.960274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f01f56-86eb-44d1-9948-22e7e9858ca5 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:02.089539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:02.090174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.090451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.090719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.091374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:02.091675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:02.093291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:02.132623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1452/2915] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:02.197618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c083-a618-4529-9d1b-a1fe2bc0926c None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.198095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c083-a618-4529-9d1b-a1fe2bc0926c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.198481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c083-a618-4529-9d1b-a1fe2bc0926c None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.200457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1464/2916] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:02.226119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:02.406623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:02.439836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d3a0-4109-47e2-a986-4d0b1d2b4d23 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:02.449710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:02.450827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.451304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.453544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/7be4ccdd59a44161805b8791f2d7bede` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.455301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=7be4ccdd59a44161805b8791f2d7bede)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:02.457626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:02.460085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1453/2917] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:02 2022] GET /identity/v3/projects/7be4ccdd59a44161805b8791f2d7bede => generated 371 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:02.692238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.693180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.693180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.694786 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1465/2918] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:02.707646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:02.737074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:02.755896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758f187-e8bd-4a2a-bdc6-cbff3818bcba tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:02.764621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:02.765840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.766274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.766676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/7be4ccdd59a44161805b8791f2d7bede` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.768637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=7be4ccdd59a44161805b8791f2d7bede)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:02.772525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:02.776815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1454/2919] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:02 2022] GET /identity/v3/projects/7be4ccdd59a44161805b8791f2d7bede => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:02.804965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:02.806929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:02.899270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:02.912590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fded92e-adef-4889-a784-83d60d221d99 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:02.919025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:02.920338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.920338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.924940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.924940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:02.924940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:02.924940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:02.925915 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:02.950046 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1455/2920] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:02.950226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:02.963009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2eae-9972-4cf4-b6e8-d65b3c7520ee tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:02.972067 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:02.985082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:02.985921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:02.986310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:02.986783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:02.988192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:02.991704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:03.014314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20519e17-0630-4692-b1d6-6c228d9fa933 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:03.019458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:03.020121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:03.020402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:03.020677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] PATH_INFO: `/v3/projects/c06adceaeedd4244a472c64c929aa141` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:03.022042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06adceaeedd4244a472c64c929aa141)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:03.024063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:03.426956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1456/2921] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:02 2022] POST /identity/v3/users => generated 383 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:03.428365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:03.451702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538cc6b-7e47-404e-8a5e-92f84f7aa477 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:03.475447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06adceaeedd4244a472c64c929aa141', 'request_id': 'req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:03.555935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:03.555935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:03.555935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:03.556281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:03.556281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:03.556281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:03.559434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5dd9e0-efba-4ca2-b841-4531fba9a065 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:03.570961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06adceaeedd4244a472c64c929aa141', 'request_id': 'req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:03.584850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06adceaeedd4244a472c64c929aa141', 'request_id': 'req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:03.588821 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1457/2922] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:03.625600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:03.625906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:03.626247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:03.628695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1458/2923] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:23:03.633368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:03.639584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:03.649367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] The token cache is being invalidate because project c06adceaeedd4244a472c64c929aa141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:03.650005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:03.651691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:03.657525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1466/2924] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:02 2022] DELETE /identity/v3/projects/c06adceaeedd4244a472c64c929aa141 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:03.661899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:03.666137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:03.839563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:03.847301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d0d9-9a46-45ea-83fa-240f7909a2fc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:03.862147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862ee2-f423-4ec1-a13a-01467d6562e4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:03.864919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:03.866910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:03.867549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:03.869092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] PATH_INFO: `/v3/users/c889f69d49434623bb4c2c9195eeaa3a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:03.871547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c889f69d49434623bb4c2c9195eeaa3a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:03.872578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:03.873498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:03.873935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:03.874367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/7be4ccdd59a44161805b8791f2d7bede` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:03.882201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=7be4ccdd59a44161805b8791f2d7bede)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:03.884596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04de01d-a2d4-427e-be91-cbb6ed591e8c tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:03.885028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:03.886804 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1459/2925] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:03 2022] GET /identity/v3/projects/7be4ccdd59a44161805b8791f2d7bede => generated 371 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:04.205258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c889f69d49434623bb4c2c9195eeaa3a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.273223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c889f69d49434623bb4c2c9195eeaa3a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.274575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c889f69d49434623bb4c2c9195eeaa3a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.290169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:04.290426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:04.290712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:04.293056 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1460/2926] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 30 01:23:04.304523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:04.306374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:04.309638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c889f69d49434623bb4c2c9195eeaa3a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.330068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c889f69d49434623bb4c2c9195eeaa3a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.343337 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1467/2927] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:03 2022] DELETE /identity/v3/users/c889f69d49434623bb4c2c9195eeaa3a => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:23:04.390391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:04.392189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:04.427569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e65e03-07b2-4970-8584-4b8abea08ee4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:04.588888 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:04.608067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:04.608636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:04.608924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:04.609246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/7be4ccdd59a44161805b8791f2d7bede` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:04.611862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=7be4ccdd59a44161805b8791f2d7bede)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:04.614020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:04.625356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1461/2928] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:04 2022] GET /identity/v3/projects/7be4ccdd59a44161805b8791f2d7bede => generated 371 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:23:04.666206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:04.683761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7b898-d8bf-4e9a-a0c4-0a56b8136665 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:04.691298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:04.692053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:04.692410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:04.692757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/users/55b367476d0443fb9fdb4193f811a420` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:04.715298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:delete_user(user_id=55b367476d0443fb9fdb4193f811a420)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:04.717458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:04.811486 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:04.875140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b367476d0443fb9fdb4193f811a420'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.966753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b367476d0443fb9fdb4193f811a420'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:04.968492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b367476d0443fb9fdb4193f811a420'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.022425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b367476d0443fb9fdb4193f811a420'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.043379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b367476d0443fb9fdb4193f811a420'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.054378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1468/2929] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:04 2022] DELETE /identity/v3/users/55b367476d0443fb9fdb4193f811a420 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:05.063070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:05.067538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:05.081083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:05.089151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:05.105626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171787eb-0d41-4ee1-b120-e37a7e7dfdd4 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:05.247879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:05.250071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:05.254133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:05.254713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/7be4ccdd59a44161805b8791f2d7bede` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:05.256394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7be4ccdd59a44161805b8791f2d7bede)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:05.258599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:05.295270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea81337-a2d1-4899-b5a8-7af5d6d21d44 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:05.310891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:05.312212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:05.312888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:05.313177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] PATH_INFO: `/v3/projects/1e5107632dd149218a4fb4e865bb445e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:05.316683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5107632dd149218a4fb4e865bb445e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:05.318657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:05.448557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be4ccdd59a44161805b8791f2d7bede', 'request_id': 'req-febf12d3-bf75-49a7-9703-9f3c0975fc46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.466308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be4ccdd59a44161805b8791f2d7bede', 'request_id': 'req-febf12d3-bf75-49a7-9703-9f3c0975fc46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.551531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5107632dd149218a4fb4e865bb445e', 'request_id': 'req-36dcd351-2a0c-4d18-a382-4bf7f7238b16'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.589056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be4ccdd59a44161805b8791f2d7bede', 'request_id': 'req-febf12d3-bf75-49a7-9703-9f3c0975fc46'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.612172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] The token cache is being invalidate because project 7be4ccdd59a44161805b8791f2d7bede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:05.615562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.618645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-febf12d3-bf75-49a7-9703-9f3c0975fc46 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.620821 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1462/2930] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:05 2022] DELETE /identity/v3/projects/7be4ccdd59a44161805b8791f2d7bede => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:05.644670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:05.645211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:05.645664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:05.647453 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1463/2931] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:05.675100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:05.677039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:05.679813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5107632dd149218a4fb4e865bb445e', 'request_id': 'req-36dcd351-2a0c-4d18-a382-4bf7f7238b16'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.689080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5107632dd149218a4fb4e865bb445e', 'request_id': 'req-36dcd351-2a0c-4d18-a382-4bf7f7238b16'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.734559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] The token cache is being invalidate because project 1e5107632dd149218a4fb4e865bb445e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:05.735021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.737732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36dcd351-2a0c-4d18-a382-4bf7f7238b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:05.743475 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1469/2932] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:05 2022] DELETE /identity/v3/projects/1e5107632dd149218a4fb4e865bb445e => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:05.745191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a126ae-cbcc-47c1-a93d-d2dce6298ace None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:05.750988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a126ae-cbcc-47c1-a93d-d2dce6298ace None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:05.751548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a126ae-cbcc-47c1-a93d-d2dce6298ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:05.828718 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:05.844752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-17a126ae-cbcc-47c1-a93d-d2dce6298ace None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:05.848226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-17a126ae-cbcc-47c1-a93d-d2dce6298ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:05.912642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:05.915222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:05.964149 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:06.038730 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1470/2933] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:06.041933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.042222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.042494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.063534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e5d5-87ed-4755-9620-13806daba697 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.077502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.079365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.081269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.081672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.086002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:06.086695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd1a98f7e93441e1932677676d85d0c7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.087798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:06.092085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3084-ceb9-4c72-905d-52505d8afc3f tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.099897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1471/2934] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:06.104384 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1464/2935] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:05 2022] GET /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7 => generated 375 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:06.107700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.126227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a116f-5c6f-43cf-bd79-8443878b7bef None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.131468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865201d-3c53-4499-870e-987d245e52d9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.131933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865201d-3c53-4499-870e-987d245e52d9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.132213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865201d-3c53-4499-870e-987d245e52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.157991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.157991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.157991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.157991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.158447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:06.158739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.160330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.211283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1472/2936] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:06.215289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.216637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5865201d-3c53-4499-870e-987d245e52d9 None None] MFA Rules not processed for user `a1e23e3096f740508e6fb6626a29336f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:06.222867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5865201d-3c53-4499-870e-987d245e52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:06.237936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee6fea-2443-41c6-9b2a-e501af0e37e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.249132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.250524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.251530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.252107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.253039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.257653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.377898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1465/2937] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:06.379917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.381579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.382808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.390125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1466/2938] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:06.394865 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1473/2939] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:06 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:06.395112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:06.398636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:06.398796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.560450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cecab-0a8d-463e-ad96-10572f34a183 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.585928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.587472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.587793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.588057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.589263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.594019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.625591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.629935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:06.698460 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:06.730014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1474/2940] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:06 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:06.733352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d69ce3-4b86-4c40-847d-7ecab056abf7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.734240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.738855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.739503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.739783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.740061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.741491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd1a98f7e93441e1932677676d85d0c7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.743942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.746174 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1467/2941] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:06 2022] GET /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7 => generated 375 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:06.757729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd69f3-88b8-48a4-816e-8f4bcc69eb78 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.763832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.764665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.764959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.765231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.767061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.768798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.791398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1475/2942] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:06.795859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.814407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44680f-02b5-4f00-90d0-c01e12a3567e tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.822751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.823594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.823872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.824346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.825276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.826994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.843849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1468/2943] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:06.846167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.859289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8614-4712-4c48-84f6-544ee00f74bf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.869819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.870524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.870806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.871135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] PATH_INFO: `/v3/projects/071a4f9e348b484795cea54316963a62/users/ab8011ce402b41ca9d3972a7a2a02cad/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:06.894753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=071a4f9e348b484795cea54316963a62, user_id=ab8011ce402b41ca9d3972a7a2a02cad, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:06.899830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52a8e-b480-489f-a23a-0e079c304feb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:06.904732 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:06.916043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:06.919501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:06.948529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683ca4-9072-4be6-bd96-a76fe65fcfd1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:06.954541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:06.955718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:06.955718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:06.956434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:07.004249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1476/2944] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:06 2022] PUT /identity/v3/projects/071a4f9e348b484795cea54316963a62/users/ab8011ce402b41ca9d3972a7a2a02cad/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:07.024705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:07.026717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:07.027398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:07.112654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] MFA Rules not processed for user `ab8011ce402b41ca9d3972a7a2a02cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:07.116049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:07.122641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:07.125326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:07.147114 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1469/2945] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:07.306448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1477/2946] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:07.311574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:07.333286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937a62b-e8f1-4091-a664-3595e09b5dad service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:07.480049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:07.480691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:07.480973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:07.481256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:07.489316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:07.491333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:07.651343 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1470/2947] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:07 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:23:07.653283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:07.670985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f65565-e66a-4a03-9551-47761aaccf6b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:07.879060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:07.879060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:07.879060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:07.879060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:07.879664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:07.879664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:07.996818 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1478/2948] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:07 2022] POST /identity/v3/users => generated 295 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:08.000656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:08.018687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbdcbd-5de5-44bf-a1ce-e0f1ab6274c4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:08.032149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:08.032943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.033361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.033748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.034672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:08.036493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:08.063473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1471/2949] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:08.067441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:08.084329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad43f5-c0e5-4d5b-9d46-ec5cb016beaa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:08.094157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:08.095266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.095543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.095815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] PATH_INFO: `/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457/users/b96ea2277a384b20b03530ec92b95d0a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.121958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1feaa9e89184d7c8f87d67b5b8f4457, user_id=b96ea2277a384b20b03530ec92b95d0a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:08.124712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:08.253364 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1479/2950] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:08 2022] PUT /identity/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457/users/b96ea2277a384b20b03530ec92b95d0a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:08.258541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:08.275760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74956bb7-ccef-44c2-a296-0ba92739f058 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:08.406872 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:08.428781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:08.429710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.430153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.430589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.431237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:08.433388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbbf3f-9258-4026-9d2b-ab4247bb97f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:08.449167 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1472/2951] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:08.453018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:08.470522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4a0a5-9015-4fa8-a9e8-30dd29cb8a85 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:08.481993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:08.482669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.482948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.483281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] PATH_INFO: `/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457/users/b96ea2277a384b20b03530ec92b95d0a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.486586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1feaa9e89184d7c8f87d67b5b8f4457, user_id=b96ea2277a384b20b03530ec92b95d0a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:08.489254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6efc1-33b0-4581-b8f8-3e139ce1c674 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:08.540651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1480/2952] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:08 2022] PUT /identity/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457/users/b96ea2277a384b20b03530ec92b95d0a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:08.551482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90915-a68f-465d-ae25-e23cc9330bfb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.552723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90915-a68f-465d-ae25-e23cc9330bfb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.553285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90915-a68f-465d-ae25-e23cc9330bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.590847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eee90915-a68f-465d-ae25-e23cc9330bfb None None] MFA Rules not processed for user `b96ea2277a384b20b03530ec92b95d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:08.592731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eee90915-a68f-465d-ae25-e23cc9330bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:08.603646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.604244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.604489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.606222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1481/2953] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:23:08.612117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:23:08.725528 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:08.784981 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1473/2954] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:08.794295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:08.802688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03352-7e60-4d4c-886e-cbb0cba2b2d5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:08.802989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03352-7e60-4d4c-886e-cbb0cba2b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:08.803229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03352-7e60-4d4c-886e-cbb0cba2b2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:08.863423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aaf03352-7e60-4d4c-886e-cbb0cba2b2d5 None None] MFA Rules not processed for user `ab8011ce402b41ca9d3972a7a2a02cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:08.864650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaf03352-7e60-4d4c-886e-cbb0cba2b2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:08.998730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a6fb-82b9-42df-835f-43b7b61a1223 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:09.013123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '240fca1fcc8c4a38b2bc42c25db13126', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fe2ca4657814d00a860833773739515', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:09.013862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:09.014195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:09.014427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:09.016366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd1a98f7e93441e1932677676d85d0c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:09.021829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:09.049163 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1482/2955] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:23:08 2022] GET /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7 => generated 375 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:23:09.075035 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1474/2956] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:09.332003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:09.351759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188262f8-7ae0-45a6-a681-7f0dd4fd0d61 tempest-QuotasAdminTestJSON-187376260 tempest-QuotasAdminTestJSON-187376260-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:09.373746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:09.376041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:09.376363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:09.377506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:09.406861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:09.415079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:09.467058 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1483/2957] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:10.373955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:10.374506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:10.374506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:10.420462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:10.422640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:10.625175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1475/2958] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:10.655619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:10.657380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:10.907896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ecbce-f041-43d1-98d2-16bf28646ac9 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:10.923055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:10.924057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:10.924203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:10.924546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:10.940735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:10.943686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef44ec4-8626-46aa-8b7e-23b414904661 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:10.959299 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1484/2959] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:11.932736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:11.940955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:12.038610 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:12.149409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6504-44e3-4f6d-9c0b-f16ef40d3b3f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:12.162004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:12.162912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:12.163373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:12.163809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] PATH_INFO: `/v3/users/09db054841e748dabf56127304854eed` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:12.165598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09db054841e748dabf56127304854eed)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:12.171157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:12.405861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09db054841e748dabf56127304854eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:12.411019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09db054841e748dabf56127304854eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:12.438077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09db054841e748dabf56127304854eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:12.445852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09db054841e748dabf56127304854eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:12.559459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09db054841e748dabf56127304854eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:12.597080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1476/2960] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:11 2022] DELETE /identity/v3/users/09db054841e748dabf56127304854eed => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:12.601802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c41e6-bce0-41aa-87ca-2c1ead7d51d9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:12.602332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c41e6-bce0-41aa-87ca-2c1ead7d51d9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:12.602332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c41e6-bce0-41aa-87ca-2c1ead7d51d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:12.649158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-814c41e6-bce0-41aa-87ca-2c1ead7d51d9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:12.650742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-814c41e6-bce0-41aa-87ca-2c1ead7d51d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:12.738337 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:12.756140 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1485/2961] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:12.766144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:12.767620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:13.061431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:13.062045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:13.062468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:13.088549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cd3d3-1b97-40ab-a81b-d53af580b1e2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:13.100341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:13.103841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:13.105118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:13.106031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:13.113870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] MFA Rules not processed for user `a1e23e3096f740508e6fb6626a29336f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:13.117564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:13.160635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:13.166512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:13.223989 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1486/2962] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:13.226263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1477/2963] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:14.076327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:14.078686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:14.111867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f585704-168f-4d43-bad8-128a64e00884 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:14.128071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:14.128407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:14.128785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:14.129064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] PATH_INFO: `/v3/projects/bd1a98f7e93441e1932677676d85d0c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:14.132413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1a98f7e93441e1932677676d85d0c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:14.139223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:14.337789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1a98f7e93441e1932677676d85d0c7', 'request_id': 'req-ba1d15ed-609f-4114-a9e1-c26aa26b351c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.459067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1a98f7e93441e1932677676d85d0c7', 'request_id': 'req-ba1d15ed-609f-4114-a9e1-c26aa26b351c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.469226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1a98f7e93441e1932677676d85d0c7', 'request_id': 'req-ba1d15ed-609f-4114-a9e1-c26aa26b351c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.495910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] The token cache is being invalidate because project bd1a98f7e93441e1932677676d85d0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:14.496324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.498528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.506626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:14.515308 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1487/2964] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:14 2022] DELETE /identity/v3/projects/bd1a98f7e93441e1932677676d85d0c7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:14.524875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e87e1-bfb5-4c77-a902-706f53f9ddc2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:14.645842 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:14.668893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:14.670095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:14.671278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:14.674255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] PATH_INFO: `/v3/users/240fca1fcc8c4a38b2bc42c25db13126` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:14.674807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240fca1fcc8c4a38b2bc42c25db13126)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:14.677673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:14.934558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240fca1fcc8c4a38b2bc42c25db13126'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.937055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240fca1fcc8c4a38b2bc42c25db13126'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.958654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240fca1fcc8c4a38b2bc42c25db13126'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:14.959666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240fca1fcc8c4a38b2bc42c25db13126'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:15.041905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-289b6f59-c618-4da7-b48b-dd4f00d32b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240fca1fcc8c4a38b2bc42c25db13126'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:15.083514 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1478/2965] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:14 2022] DELETE /identity/v3/users/240fca1fcc8c4a38b2bc42c25db13126 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:16.312611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:16.314357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:16.340003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d15ed-609f-4114-a9e1-c26aa26b351c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:16.417754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:16.418560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:16.418872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:16.419140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] PATH_INFO: `/v3/projects/6fe2ca4657814d00a860833773739515` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:16.420438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe2ca4657814d00a860833773739515)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:16.422491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:16.448271 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:16.550142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe2ca4657814d00a860833773739515', 'request_id': 'req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:16.805739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe2ca4657814d00a860833773739515', 'request_id': 'req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:16.819018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe2ca4657814d00a860833773739515', 'request_id': 'req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:16.832381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] The token cache is being invalidate because project 6fe2ca4657814d00a860833773739515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:16.832715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:16.833505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6f1dbc2-3e70-4ed5-80b6-513ef74c6f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:16.834993 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1488/2966] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:16 2022] DELETE /identity/v3/projects/6fe2ca4657814d00a860833773739515 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:16.842347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:16.842878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:16.842878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:16.878462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:16.879971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:16.986653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1479/2967] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:16.997739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:16.998524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:16.998997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.038443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:17.040011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:17.072965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1489/2968] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:17.074276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.088642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9b84f-1cef-4441-a1a1-9d3d1c090a7b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.103802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.105967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.106260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.112011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.113005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:17.113328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.115004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.152055 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1480/2969] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:17.156880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.170460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11632a-e830-4f4c-aae9-23693833de85 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.186166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.187876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.188333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.189420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.191649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.200153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.331112 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1490/2970] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:17 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:23:17.335237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.348882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8933ac-d33f-461b-bf78-49fc5c0d6e69 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.495856 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:17.508637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.509613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.530260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.530260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.530260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.530260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.703132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1481/2971] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:17 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:17.704944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.722385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc191-75ce-4b11-b3fa-b5245ac8a239 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.733471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.738918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.738918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.738918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.738918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.740125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.753627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1491/2972] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:17.757990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.771167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd1b7a-464c-4e1e-ae77-d55e304b1355 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.782768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.783640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.784068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.784478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.785317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.787256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f95b5-aa1f-41dd-87b9-c186e528f3bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.799662 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1482/2973] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:17.804306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:17.815813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332f08d-7aca-47eb-81dc-943fe6ed2aba admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:17.823813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:17.824477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.827684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.827684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] PATH_INFO: `/v3/projects/7f1b778d34e541fa87ff945108b8f5bd/users/ace6fd59303f4846b6befb50dbf6d3e0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:17.855173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1b778d34e541fa87ff945108b8f5bd, user_id=ace6fd59303f4846b6befb50dbf6d3e0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:17.862861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:17.978292 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1492/2974] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:17 2022] PUT /identity/v3/projects/7f1b778d34e541fa87ff945108b8f5bd/users/ace6fd59303f4846b6befb50dbf6d3e0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:17.990756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:17.991532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:17.991532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:18.112003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] MFA Rules not processed for user `ace6fd59303f4846b6befb50dbf6d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:18.116872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:18.229615 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1483/2975] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:19.705667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:19.707489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:19.765084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:19.767229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:19.873415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eae59-43ad-42f9-848b-cd71b23e1d3d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:19.896189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:19.896859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:19.897147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:19.897462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:19.899370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:19.970263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b818c-35dd-4408-ab97-3b863e954b61 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:19.989621 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:19.996932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:19.996932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:19.996932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:19.999034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:20.025899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:20.027605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded494-3592-42d3-ac3f-9d6eae6b0f7e service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:20.040413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:20.042634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:20.047173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1493/2976] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:20.062644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1484/2977] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:20.706001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e163739-f266-43bc-8911-65898c7730ad None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:20.707088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e163739-f266-43bc-8911-65898c7730ad None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:20.707427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e163739-f266-43bc-8911-65898c7730ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:20.734800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3e163739-f266-43bc-8911-65898c7730ad None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:20.736105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e163739-f266-43bc-8911-65898c7730ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:20.799165 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1494/2978] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:23:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:20.821795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:20.823696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:20.921582 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:20.921582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6a27-a098-46a9-9e61-1cb1aee5ada2 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:20.921582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:20.921582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:20.923178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:20.923178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:20.932729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:20.934509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b3f5-6cd8-4f75-8376-1bcac1df613d service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:20.943459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1485/2979] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:21.482961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:21.483534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:21.483885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:21.537387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] MFA Rules not processed for user `ace6fd59303f4846b6befb50dbf6d3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:21.538686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:21.546925 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1495/2980] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:22.302332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:22.303167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:22.303651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:22.327827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:22.329956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:22.349933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1486/2981] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:22.358948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:22.381197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b3e2-d49c-4b94-852f-9528c4caf582 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:22.389270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:22.390328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:22.390931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:22.391357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:22.406332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:22.411178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6ce64-f9b4-4c93-98bb-312bdd4146ce service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:22.473226 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1496/2982] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:23.022503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:23.245188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897419-03a2-4642-b63b-47e26bb52e7d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:23.261921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:23.263140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:23.266051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:23.268042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] PATH_INFO: `/v3/users/ace6fd59303f4846b6befb50dbf6d3e0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:23.272388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace6fd59303f4846b6befb50dbf6d3e0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:23.285992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:23.599645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace6fd59303f4846b6befb50dbf6d3e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:23.602896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace6fd59303f4846b6befb50dbf6d3e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:23.630036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace6fd59303f4846b6befb50dbf6d3e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:23.631592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace6fd59303f4846b6befb50dbf6d3e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:23.745794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace6fd59303f4846b6befb50dbf6d3e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:23.873591 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1487/2983] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:23 2022] DELETE /identity/v3/users/ace6fd59303f4846b6befb50dbf6d3e0 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:23.875454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce850-cc05-47d2-a4ad-9c457d06cf29 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:23.876704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce850-cc05-47d2-a4ad-9c457d06cf29 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:23.877628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ce850-cc05-47d2-a4ad-9c457d06cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:23.930148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-471ce850-cc05-47d2-a4ad-9c457d06cf29 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:23.931895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-471ce850-cc05-47d2-a4ad-9c457d06cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:24.101388 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1497/2984] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:24.152660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:24.154808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:24.360459 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:24.375885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7e13b-3c4d-4cc5-8249-cd26a68027a8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:24.390507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:24.391186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:24.391404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:24.391678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:24.436740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:24.441779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:24.498332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1488/2985] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:24.902888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060769ec-b25b-43b6-a638-1835a452f75b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:24.903723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060769ec-b25b-43b6-a638-1835a452f75b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:24.904152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060769ec-b25b-43b6-a638-1835a452f75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:24.927545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-060769ec-b25b-43b6-a638-1835a452f75b None None] MFA Rules not processed for user `94448bbc2f4a4efaa86792f1511ff15c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:24.929074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-060769ec-b25b-43b6-a638-1835a452f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:25.064682 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1498/2986] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:25.504470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:25.506943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:25.513426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:25.516276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:25.517663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:25.534153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ff28b-13f7-4c87-b0cb-dd542bdb766b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:25.559425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:25.563353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:25.563889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:25.566864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] PATH_INFO: `/v3/projects/7f1b778d34e541fa87ff945108b8f5bd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:25.570838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1b778d34e541fa87ff945108b8f5bd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:25.581897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:25.599193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:25.606182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:25.632869 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:25.767241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1499/2987] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:25.790200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:25.792503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:25.841190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1b778d34e541fa87ff945108b8f5bd', 'request_id': 'req-a586ca89-9e15-42e6-9384-a938f945c878'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:25.866633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1b778d34e541fa87ff945108b8f5bd', 'request_id': 'req-a586ca89-9e15-42e6-9384-a938f945c878'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:25.932291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070004-1071-4d43-8ed4-9ee962f723d8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:25.961267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1b778d34e541fa87ff945108b8f5bd', 'request_id': 'req-a586ca89-9e15-42e6-9384-a938f945c878'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:25.982816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] The token cache is being invalidate because project 7f1b778d34e541fa87ff945108b8f5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:25.983502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:25.984409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a586ca89-9e15-42e6-9384-a938f945c878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:25.993383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1489/2988] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:25 2022] DELETE /identity/v3/projects/7f1b778d34e541fa87ff945108b8f5bd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:25.995151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7354a4-648a-4923-838a-eff01a4c51a0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:25.995662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7354a4-648a-4923-838a-eff01a4c51a0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:25.996153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7354a4-648a-4923-838a-eff01a4c51a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.054719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ab7354a4-648a-4923-838a-eff01a4c51a0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:26.056082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ab7354a4-648a-4923-838a-eff01a4c51a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:26.229791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1490/2989] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:26.231469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.231859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.232232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.263587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:26.264961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:26.281643 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1491/2990] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:26.285961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:26.300064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:26.300699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.300977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.301248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.308341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ddce-47d4-4584-a6ee-92667904783d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:26.313656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:26.314905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:26.315918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.316287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.316652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.317542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:26.317941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:26.319640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:26.341119 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1492/2991] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:26.342772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:26.355667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8283-8b87-4002-955d-64fd023fd127 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:26.361284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:26.362534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.363160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.363635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.365261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:26.376348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:26.500997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:26.508063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:26.535490 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1500/2992] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:26.550520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1493/2993] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:26 2022] POST /identity/v3/projects => generated 413 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:26.554622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:26.567973 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:26.584752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c19f6b-5327-490e-a4b1-7d43d769c071 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:26.737143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:26.737143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.737143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.737143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.738122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:26.743118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:26.894679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1501/2994] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:26 2022] POST /identity/v3/users => generated 307 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:26.900651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:26.931132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f329e70-1686-484f-ab6f-19083fb5d50f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:26.953156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:26.961746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:26.962305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:26.963267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:26.965053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:26.967636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:26.986023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1494/2995] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:26.986644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:26.999499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fdc94-a2f8-4f2a-87b3-5e6f7e1fa098 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:27.030155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:27.030797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:27.031080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:27.031356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:27.032015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:27.043025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca6bc0-04f1-4a75-9f25-348670ea3bce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:27.090977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1502/2996] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:23:27.095674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:27.118883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d4ba2-7585-4ba5-934c-c64a4711e14f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:27.139989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:27.143323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:27.144474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:27.147513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] PATH_INFO: `/v3/projects/0e4747ca082b4a9b82bb64c9ea2ec750/users/9cb216afb20940ce9cc86b2d1faab962/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:27.199700 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:27.211082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4747ca082b4a9b82bb64c9ea2ec750, user_id=9cb216afb20940ce9cc86b2d1faab962, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:27.227745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:27.349947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1495/2997] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:27 2022] PUT /identity/v3/projects/0e4747ca082b4a9b82bb64c9ea2ec750/users/9cb216afb20940ce9cc86b2d1faab962/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:27.355365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:27.355922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:27.356380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:27.441895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:27.443443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:27.593678 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1503/2998] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:27.653573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:27.682461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:27.928327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986facab-921f-441f-be33-ae997ec01371 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:27.951196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:27.951833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:27.952285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:27.952558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:27.977438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:27.979138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f5929-0e4d-4512-8639-6cd8d13251bd service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:28.003833 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1496/2999] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:30.815545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:30.817008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:31.004715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec20fd0-be64-45d5-a0ba-0ef95d2d7a52 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:31.019488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:31.020426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:31.022704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:31.023274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:31.026494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:31.059039 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:31.135394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:31.137405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:31.177176 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1504/3000] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:32.387002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:32.387504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:32.387606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:32.689011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:32.690315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:32.825549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1497/3001] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:32.839050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:32.840154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:33.017528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859c94-b558-4e0d-ada7-c376b01b4770 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:33.034115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:33.034749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:33.035025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:33.035296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:33.054658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:33.056208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:33.076472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1505/3002] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:35.995656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:36.025560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff1346-86f6-473c-8d1c-e56a914d9a3e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:36.040982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:36.045584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:36.047026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:36.047357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:36.056032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:36.093049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:36.096877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:36.139807 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1498/3003] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:43.078374 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=53 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:45.693722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:45.695238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:45.726773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14b2b-e25f-435e-bbea-d2c98de48824 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:45.745072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:45.745072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:45.745072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:45.745072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] PATH_INFO: `/v3/users/d6e0e5acf53b4abe99c3418c82d47ab3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:45.750307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e0e5acf53b4abe99c3418c82d47ab3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:45.761675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:45.937327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:45.947399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a1de-f1a4-4461-9bc3-899d20a51ccd service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:45.967611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:45.971722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:45.971722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:45.971722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:45.975987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:46.014272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:46.020076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:46.052493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1499/3004] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:46.087146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e0e5acf53b4abe99c3418c82d47ab3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:46.168118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e0e5acf53b4abe99c3418c82d47ab3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:46.169218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e0e5acf53b4abe99c3418c82d47ab3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:46.189753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e0e5acf53b4abe99c3418c82d47ab3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:46.210093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83ceeda5-d636-4ed8-89dc-4467e4f09c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e0e5acf53b4abe99c3418c82d47ab3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:46.222513 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1506/3005] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:45 2022] DELETE /identity/v3/users/d6e0e5acf53b4abe99c3418c82d47ab3 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:46.713215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:46.749419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a597-dd6f-45e2-910d-30690d013793 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:46.958097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:46.964633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:46.965412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:46.965919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] PATH_INFO: `/v3/projects/7f383493aa6b46c9884b54cb82063b30` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:46.969634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f383493aa6b46c9884b54cb82063b30)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:46.978739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:47.019361 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:47.319463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f383493aa6b46c9884b54cb82063b30', 'request_id': 'req-1ea2b78a-4bf2-48bc-b7c0-326981083aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:47.344717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f383493aa6b46c9884b54cb82063b30', 'request_id': 'req-1ea2b78a-4bf2-48bc-b7c0-326981083aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:47.407219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f383493aa6b46c9884b54cb82063b30', 'request_id': 'req-1ea2b78a-4bf2-48bc-b7c0-326981083aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:47.485492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] The token cache is being invalidate because project 7f383493aa6b46c9884b54cb82063b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:47.485492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:47.485492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ea2b78a-4bf2-48bc-b7c0-326981083aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:47.485492 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1500/3006] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:46 2022] DELETE /identity/v3/projects/7f383493aa6b46c9884b54cb82063b30 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:47.486202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:47.486202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:47.486202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:47.529393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:47.529393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:47.640599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1507/3007] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:47.640707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:47.640707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:47.640707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:47.658344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:47.659652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:47.667766 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1501/3008] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:47.676176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:47.688560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee2d7-225e-414d-82df-c30aaeb6397e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:47.695484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:47.695755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:47.696103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:47.696436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:47.697219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:47.698206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:47.700115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:47.721027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:47.721606 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1508/3009] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:47.731186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08705622-b5a3-4ef4-b03d-020f677c38db None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:47.738731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:47.739901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:47.740239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:47.740594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:47.741830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:47.744200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:47.989539 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1502/3010] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:47 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:47.992369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:48.006350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e56d2-a110-497f-88df-17f626597ebc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:48.133641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:48.134838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.135234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.135635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.137029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:48.140093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:48.151204 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:48.234856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1509/3011] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:47 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:48.236474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:48.258222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667d4b7-8752-4ac8-83cd-f3c8889d6da8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:48.273904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:48.274718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.277697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.278611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.279529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:48.281322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:48.296141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1503/3012] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:48.300029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:48.327878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41044f-31ed-4823-9228-5b799e75c974 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:48.358619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:48.360374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.360834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.361267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.362345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:48.365691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c81688-c01e-4c35-8494-60ccbee75862 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:48.411765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1510/3013] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:48.414158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:48.430350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81b3cf-02cc-44d2-aa22-8a6c091a5b34 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:48.445903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:48.448807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.454520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.454985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] PATH_INFO: `/v3/projects/121fd24a0b6b4eb3aa1cac304dda16a0/users/e533367cf3fc4e06a96c6add0540b897/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.498944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=121fd24a0b6b4eb3aa1cac304dda16a0, user_id=e533367cf3fc4e06a96c6add0540b897, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:48.511101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4955cd-60bb-4133-8182-b16622066bde admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:48.640552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1504/3014] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:48 2022] PUT /identity/v3/projects/121fd24a0b6b4eb3aa1cac304dda16a0/users/e533367cf3fc4e06a96c6add0540b897/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:48.643688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.644165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.645209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.734743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:48.743193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:48.905633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e1f2-7728-48cf-b70e-634b5fd37db6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:48.905633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e1f2-7728-48cf-b70e-634b5fd37db6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:48.905987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e1f2-7728-48cf-b70e-634b5fd37db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:48.997763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b454e1f2-7728-48cf-b70e-634b5fd37db6 None None] MFA Rules not processed for user `9cb216afb20940ce9cc86b2d1faab962`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:48.998441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b454e1f2-7728-48cf-b70e-634b5fd37db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:49.058668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1511/3015] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:49.071195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:49.071195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:49.158798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567fafb-5d60-4be5-b47c-b9682a5a29c0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:49.166012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:49.166633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:49.166909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:49.167208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:49.169493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1505/3016] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:49.183275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:49.184080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:49.184564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:49.187696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:49.189218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:49.202544 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1512/3017] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:49.208275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] MFA Rules not processed for user `9cb216afb20940ce9cc86b2d1faab962`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:49.209918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:49.219205 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1506/3018] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:49.301621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:49.303249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:49.351824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb154cd-f643-405e-b1ba-ef2b24a112fe service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:49.358774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:49.359421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:49.359702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:49.359974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] PATH_INFO: `/v3/users/055b96d1eb20418d96450efde939e020` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:49.363163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055b96d1eb20418d96450efde939e020)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:49.369898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:49.660817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055b96d1eb20418d96450efde939e020'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:49.755579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055b96d1eb20418d96450efde939e020'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:49.756192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055b96d1eb20418d96450efde939e020'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:49.770129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055b96d1eb20418d96450efde939e020'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:49.776204 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:49.779695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055b96d1eb20418d96450efde939e020'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:49.791499 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1513/3019] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:49 2022] DELETE /identity/v3/users/055b96d1eb20418d96450efde939e020 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:23:49.882318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:49.885502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:49.930648 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:50.045896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f28eb-8f1f-4470-9d03-4cfbbd4985e0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:50.136425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:50.138835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:50.141875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:50.142436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:50.145722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.159531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:50.161989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.286912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2045e1-3153-4beb-9069-3c51bab3df57 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:50.293850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:50.294992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:50.295553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:50.295979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] PATH_INFO: `/v3/projects/4cd1868480e44540be85a8c2862cd780` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:50.297280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd1868480e44540be85a8c2862cd780)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:50.300032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:50.331235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:50.333026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730ec5-dc06-46c8-805b-ecf7035cbcc4 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:50.356271 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1507/3020] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:50.410812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:50.411143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:50.411423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:50.436344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd1868480e44540be85a8c2862cd780', 'request_id': 'req-4c21ea0f-76f4-475b-8f0b-df544fb69db0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:50.495441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:50.497039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.534357 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:50.550276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd1868480e44540be85a8c2862cd780', 'request_id': 'req-4c21ea0f-76f4-475b-8f0b-df544fb69db0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:50.561656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd1868480e44540be85a8c2862cd780', 'request_id': 'req-4c21ea0f-76f4-475b-8f0b-df544fb69db0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:50.587874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] The token cache is being invalidate because project 4cd1868480e44540be85a8c2862cd780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:50.588251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:50.593763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c21ea0f-76f4-475b-8f0b-df544fb69db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:50.595922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1514/3021] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:50 2022] DELETE /identity/v3/projects/4cd1868480e44540be85a8c2862cd780 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:50.603413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:50.603785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:50.604135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:50.631746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1508/3022] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:50.638131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:50.639523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.670937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:50.672456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.836046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ac6da-8597-41a4-9bd7-e7e1d8f753b9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:50.843176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388aae-e487-488c-a962-619711c9082a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:50.843878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388aae-e487-488c-a962-619711c9082a service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:50.844228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388aae-e487-488c-a962-619711c9082a service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:50.844489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388aae-e487-488c-a962-619711c9082a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:50.846720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22388aae-e487-488c-a962-619711c9082a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:50.866210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388aae-e487-488c-a962-619711c9082a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:50.867825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388aae-e487-488c-a962-619711c9082a service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:50.879251 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1509/3023] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:23:51.045553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1515/3024] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:51.052324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.052904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.052904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.092406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:51.093908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:51.132727 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1510/3025] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:51.134359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.169408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b980ff-1deb-47a0-bff4-ccf8697eb746 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.185172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.185172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.185172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.185172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.189078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:51.189483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.191435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.231161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.233690 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1516/3026] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:23:51.249690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95f0e8-ca77-4c7b-ac1a-b1a5f369fbb7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.254883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.255541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.255820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.256116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.256754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.258858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.408485 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1511/3027] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:51 2022] POST /identity/v3/projects => generated 397 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:51.412850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.429453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f6e4-f532-4b7f-bdf3-676c0531b305 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.451370 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:51.558204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.559144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.559403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.560221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.560997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.563630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.707775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1517/3028] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:51 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:51.711714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.738118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fa7d7-f8a0-49b3-b419-4c6b5b60b02f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.746234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.746923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.749179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.749539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.750325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.752084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.768081 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1512/3029] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:51.772130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.785475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751c01c-26c2-4995-91ed-d6d339a5ebec admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.793315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.794260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.794599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.794873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.795754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.797874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a824af-b3cf-4091-9a90-3d85f01b46e9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.812520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1518/3030] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:23:51.816910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:51.831764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760561-82a0-4d8d-beb9-6eced1e8f300 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:51.843894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:51.843894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.843894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.843894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] PATH_INFO: `/v3/projects/ada31213f567489299af80277ee35f65/users/6e8b2c03e5294bbe9ee8cda7468c9d86/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:51.862573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada31213f567489299af80277ee35f65, user_id=6e8b2c03e5294bbe9ee8cda7468c9d86, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:51.868179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:51.985403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1513/3031] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:51 2022] PUT /identity/v3/projects/ada31213f567489299af80277ee35f65/users/6e8b2c03e5294bbe9ee8cda7468c9d86/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:51.990571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:51.990867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:51.991123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:52.018843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:52.020409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:52.198580 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1519/3032] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:52.201288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:52.201288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:52.235033 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:52.296275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a717f-a440-42fb-8d56-9390a24db27a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:52.314013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:52.315379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:52.316086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:52.316787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:52.335930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:52.339672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:52.359393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1514/3033] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:53.485983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:53.487423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:53.501723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88b511-68ec-4c36-8667-e360c1e123c8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:53.513041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:53.513721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:53.514005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:53.514298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] PATH_INFO: `/v3/users/ab8011ce402b41ca9d3972a7a2a02cad` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:53.515630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8011ce402b41ca9d3972a7a2a02cad)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:53.517855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:53.551322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:53.552780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:53.630695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de62595-6cf0-4ff3-a4d6-cc1c96fc8522 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:53.636379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:53.637025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:53.637306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:53.637620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:53.639594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:53.718537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:53.720278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08c75-da9b-46a3-bd3d-2856830465ad service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:53.741621 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1515/3034] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:53 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:23:53.841478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8011ce402b41ca9d3972a7a2a02cad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:53.906110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8011ce402b41ca9d3972a7a2a02cad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:53.911171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8011ce402b41ca9d3972a7a2a02cad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:53.943403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8011ce402b41ca9d3972a7a2a02cad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:53.982128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8011ce402b41ca9d3972a7a2a02cad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:53.989841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1520/3035] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:53 2022] DELETE /identity/v3/users/ab8011ce402b41ca9d3972a7a2a02cad => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:53.994592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:53.995100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:53.995597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:54.023137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:54.024373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:54.112154 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1516/3036] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:23:54.122418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:54.124735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:54.131303 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:54.197887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06efd28-fe80-403d-8ce7-272acf86c5c5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:54.203332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:54.203962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:54.207315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:54.207315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:54.218245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:54.219699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:54.231030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1521/3037] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:54.506092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:54.507850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:54.522764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbc1cc-13df-4265-8c55-3c6857e95956 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:54.528455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:54.529275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:54.529568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:54.530042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] PATH_INFO: `/v3/projects/071a4f9e348b484795cea54316963a62` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:54.531366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071a4f9e348b484795cea54316963a62)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:54.533496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:54.547852 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:54.654504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071a4f9e348b484795cea54316963a62', 'request_id': 'req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:54.660734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071a4f9e348b484795cea54316963a62', 'request_id': 'req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:54.721348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071a4f9e348b484795cea54316963a62', 'request_id': 'req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:54.734255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] The token cache is being invalidate because project 071a4f9e348b484795cea54316963a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:54.734627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:54.735344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:54.736862 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1517/3038] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:54 2022] DELETE /identity/v3/projects/071a4f9e348b484795cea54316963a62 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:54.740763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:54.751037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06554752-d860-492b-9eb7-7d1dbc3ccd3b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:54.812366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:54.812907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:54.813183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:54.813490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] PATH_INFO: `/v3/users/b96ea2277a384b20b03530ec92b95d0a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:54.814600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96ea2277a384b20b03530ec92b95d0a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:54.816559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:55.038386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96ea2277a384b20b03530ec92b95d0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.116215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96ea2277a384b20b03530ec92b95d0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.116927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96ea2277a384b20b03530ec92b95d0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.132164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96ea2277a384b20b03530ec92b95d0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.140472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96ea2277a384b20b03530ec92b95d0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.147052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1522/3039] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:23:54 2022] DELETE /identity/v3/users/b96ea2277a384b20b03530ec92b95d0a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:23:55.616351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:55.618120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:55.641705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742df34-f9bc-4f6c-a2ff-8f2618e76ea1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:55.744931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:55.747823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:55.748273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:55.748756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] PATH_INFO: `/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:55.750447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1feaa9e89184d7c8f87d67b5b8f4457)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:55.752600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:55.790210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:55.793536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:55.859103 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:55.973291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1feaa9e89184d7c8f87d67b5b8f4457', 'request_id': 'req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:55.985924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c55b-a020-4e23-ac74-b68fc5d5cbcb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:55.987125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1feaa9e89184d7c8f87d67b5b8f4457', 'request_id': 'req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:56.101608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.102480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.103128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.106216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1feaa9e89184d7c8f87d67b5b8f4457', 'request_id': 'req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:56.108322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.119936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.125690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] The token cache is being invalidate because project d1feaa9e89184d7c8f87d67b5b8f4457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:23:56.125986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:56.130247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95d48cbd-d96a-4bd6-aeec-9726ad5b5f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:23:56.132557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1518/3040] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:23:55 2022] DELETE /identity/v3/projects/d1feaa9e89184d7c8f87d67b5b8f4457 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:56.142066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.142926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.143355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.146581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.150624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723b375-360a-4b5a-b6d8-f03db0032d09 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.170211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:56.172484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.185596 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1523/3041] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:56.203526 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:56.266970 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1519/3042] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:56.274709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.274992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.275266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.317282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:56.318607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.335421 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1524/3043] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:56.339958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.352791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9896-aa45-48ad-90a4-bf628a799c98 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.368217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.368217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.368217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.368217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.368566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:23:56.368566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.370433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.391122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1520/3044] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:23:56.395331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.416653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4985-ec76-4c45-a6f3-85855838a4ca None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.432364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.433509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.433964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.434325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.435219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.437790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.588432 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1525/3045] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:23:56 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:56.597569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.614529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8d919-8cc3-4976-8eb1-1d3b55306c72 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.684963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.687946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.697080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.697360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.697653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.697929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.699541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.701579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.784072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94eef-ea8a-4df8-8c12-45f9a27db2d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.791664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.793563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.793563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.793563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.803089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.819278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.819278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df8d6-72ff-4493-978f-4fedef2d598e service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.820246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1521/3046] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:23:56 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:23:56.821681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.832961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1526/3047] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:56.846843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882edc-6775-4c1b-b2d4-3c06b7046c11 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.850218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3688-7b7a-47ba-b133-34e3c29cadab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.852578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3688-7b7a-47ba-b133-34e3c29cadab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.852980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3688-7b7a-47ba-b133-34e3c29cadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.858964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.859815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.861578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.864986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.866226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.868159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.901363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-195c3688-7b7a-47ba-b133-34e3c29cadab None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:56.902931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-195c3688-7b7a-47ba-b133-34e3c29cadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:56.910631 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1522/3048] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:56.913304 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:56.917764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.935372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407398f4-599f-48c4-b0a7-722dc74066a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.941247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.942002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.942689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.942689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:56.943421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:56.945823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:56.966009 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1523/3049] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:23:56.968366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:56.984741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955be216-dead-4c87-a2b2-d6cc4d78b5f0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:56.989585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:56.990342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:56.990722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:56.991061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] PATH_INFO: `/v3/projects/6b2476687fed48edb9f3c049376bfc7d/users/0b5e62bcc8f3464ba9652f3de19634de/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:57.016842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2476687fed48edb9f3c049376bfc7d, user_id=0b5e62bcc8f3464ba9652f3de19634de, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:57.020726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:57.064492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1527/3050] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:57.065674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72ebb-d132-44de-a6f3-af6da7e07558 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:57.067944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72ebb-d132-44de-a6f3-af6da7e07558 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:57.067944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72ebb-d132-44de-a6f3-af6da7e07558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:57.098856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-10c72ebb-d132-44de-a6f3-af6da7e07558 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:57.101264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10c72ebb-d132-44de-a6f3-af6da7e07558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:57.156064 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1524/3051] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:23:56 2022] PUT /identity/v3/projects/6b2476687fed48edb9f3c049376bfc7d/users/0b5e62bcc8f3464ba9652f3de19634de/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:23:57.157229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:57.161281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:57.244295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1528/3052] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:57.245911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed600dd-b091-46e5-97f1-b5ef8be6e43c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:57.246447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed600dd-b091-46e5-97f1-b5ef8be6e43c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:57.246725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed600dd-b091-46e5-97f1-b5ef8be6e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:57.318735 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:23:57.331336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092c46-187e-48b4-921f-5496569ecc57 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:57.343202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:57.343979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:57.344359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:57.344952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:57.345764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0ed600dd-b091-46e5-97f1-b5ef8be6e43c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:57.347572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0ed600dd-b091-46e5-97f1-b5ef8be6e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:57.467205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:57.469672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:57.481652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1525/3053] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:23:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:23:57.509523 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1529/3054] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:23:57.528318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:23:57.529834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:23:57.643128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0ab73-d36e-46d8-969b-bce5af1124da service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:23:57.648194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:23:57.649249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:57.649427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:57.650068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:57.664138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:23:57.668008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd257a-faee-4fb9-adad-2d722afe146d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:23:57.680590 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1526/3055] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:23:59.803903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a204-15d2-4e9e-b084-2891c80288d0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:23:59.804485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a204-15d2-4e9e-b084-2891c80288d0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:23:59.804485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585a204-15d2-4e9e-b084-2891c80288d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:23:59.856171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1585a204-15d2-4e9e-b084-2891c80288d0 None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:23:59.857417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1585a204-15d2-4e9e-b084-2891c80288d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:00.016550 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1530/3056] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:04.220632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:04.221520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:04.221946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:04.275148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] MFA Rules not processed for user `e533367cf3fc4e06a96c6add0540b897`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:04.277171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:04.478568 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1527/3057] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:24:04.491168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc366a8-7fe3-448b-84f0-4e9281187d88 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:04.492502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc366a8-7fe3-448b-84f0-4e9281187d88 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:04.492929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc366a8-7fe3-448b-84f0-4e9281187d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:04.552114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3dc366a8-7fe3-448b-84f0-4e9281187d88 None None] MFA Rules not processed for user `e533367cf3fc4e06a96c6add0540b897`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:04.554528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3dc366a8-7fe3-448b-84f0-4e9281187d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:04.569811 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1531/3058] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:04.584504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:04.585023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:04.684564 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:04.816671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2691d-5a6a-464f-a75e-bc5bf94e6579 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:04.834803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:04.835549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:04.835956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:04.836328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:04.869946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:04.871788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399dc53-adc1-4f2f-bbcb-4eef080e2dc7 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:04.912309 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1528/3059] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:11.647839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:11.648818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:11.649440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:11.661603 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:11.712606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:11.714482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:11.911548 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1532/3060] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:11.926473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8cf9f-3f99-43b9-9f6d-52138275d3e3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:11.928016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8cf9f-3f99-43b9-9f6d-52138275d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:11.932854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8cf9f-3f99-43b9-9f6d-52138275d3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:11.962477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9ec8cf9f-3f99-43b9-9f6d-52138275d3e3 None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:11.963869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ec8cf9f-3f99-43b9-9f6d-52138275d3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:11.980724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1529/3061] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:12.264306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:12.279556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfaa7d-7e79-4c91-a4f7-006cee771eca None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:12.300176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:12.302010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:12.302452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:12.303075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:12.318773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:12.320750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:12.352509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1533/3062] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:13.789351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:13.789875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:13.789875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:13.842212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] MFA Rules not processed for user `0b5e62bcc8f3464ba9652f3de19634de`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:13.844262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:13.975795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:13.988232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd210c-8ac5-4e2b-8147-f23bf7375d3f service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:13.998181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:13.998397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:13.998777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:13.999191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:14.004397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:14.015142 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1530/3063] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:14.044568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:14.047200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:14.057428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:14.070716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bddb34-415e-49c7-b792-d2997849bd7f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:14.080541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:14.081537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:14.095005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:14.095005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:14.095587 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1534/3064] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:24:14.114837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:14.115662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:14.132826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1531/3065] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:24:14.714247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:14.730737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e073ece-946f-4af3-811e-8b9e84a6f6c8 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:14.737051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:14.737750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:14.737963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:14.738229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:14.749030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:14.750739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:14.762256 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1535/3066] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:23.354873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:23.356736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:23.368732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999128-724a-439b-b677-d80a6666aa3c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:23.373536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:23.374238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:23.374569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:23.374896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:23.377978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:23.389733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:23.393140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:23.400869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1532/3067] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:24.470531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:24.474971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f49c-84ed-47bb-b0d7-a38c2c77ae67 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:24.481087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:24.483548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:24.483548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:24.483548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:24.485112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:24.565424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:24.567099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86154fee-d7c2-42c8-b440-7c53010344ee service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:24.579108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1536/3068] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:27.691195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:27.715274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d1b00-d786-4236-86b4-4a348de05ff6 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:27.722777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:27.724006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:27.724287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:27.724789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:27.727013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:27.740447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:27.742097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9662ccb-9f53-4ea8-974d-91fa090aa3b2 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:27.754503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1533/3069] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:29.776796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44a2e-befc-443e-bed4-1521f37d4b5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:29.777680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44a2e-befc-443e-bed4-1521f37d4b5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:29.777981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44a2e-befc-443e-bed4-1521f37d4b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:29.799741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99c44a2e-befc-443e-bed4-1521f37d4b5e None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:29.803588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99c44a2e-befc-443e-bed4-1521f37d4b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:29.813844 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1537/3070] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:31.382450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:31.383294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:31.383969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:31.404727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:31.406191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:31.414020 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1534/3071] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:32.734837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dab29-0151-491c-af5a-626cf3f6cd12 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:32.735353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dab29-0151-491c-af5a-626cf3f6cd12 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:32.735441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dab29-0151-491c-af5a-626cf3f6cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:32.764445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6b7dab29-0151-491c-af5a-626cf3f6cd12 None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:32.766090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b7dab29-0151-491c-af5a-626cf3f6cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:32.774670 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1538/3072] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:33.151852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:33.170111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204c1b-13a3-4ced-b175-159ad5a4ad50 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:33.176257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:33.177084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:33.177567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:33.178001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:33.179906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:33.194407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:33.196237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b79d-0260-4e70-bbae-45f06aad19de service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:33.210085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1535/3073] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:34.274255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:34.275189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:34.275486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:34.298686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:34.299910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:34.307149 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1539/3074] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:34.789109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:34.789669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:34.789669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:34.815703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] MFA Rules not processed for user `6e8b2c03e5294bbe9ee8cda7468c9d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:34.817065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:34.825171 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1536/3075] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:41.067040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:41.069155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:41.092927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17da400-2327-43bb-819c-5daf3ca91b38 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:41.097995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:41.099075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:41.099501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:41.100173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] PATH_INFO: `/v3/users/a1e23e3096f740508e6fb6626a29336f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:41.101728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e23e3096f740508e6fb6626a29336f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:41.104101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:41.227190 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:41.348790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e23e3096f740508e6fb6626a29336f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:41.415040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e23e3096f740508e6fb6626a29336f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:41.415893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e23e3096f740508e6fb6626a29336f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:41.462143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e23e3096f740508e6fb6626a29336f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:41.489028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d00dd52c-95c9-4ca6-961b-d887c8c46ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e23e3096f740508e6fb6626a29336f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:41.505077 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1540/3076] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:24:41 2022] DELETE /identity/v3/users/a1e23e3096f740508e6fb6626a29336f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:42.384295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:42.390818 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:42.396974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ac30-4952-4dba-ad9c-f7b40882dbe6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:42.477146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:42.478067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:42.478346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:42.478612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] PATH_INFO: `/v3/projects/2a5e20978d1a4886b04d37eef4c23d1e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:42.479925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5e20978d1a4886b04d37eef4c23d1e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:42.483085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:42.613785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5e20978d1a4886b04d37eef4c23d1e', 'request_id': 'req-5c655ece-5422-492d-8d0e-5289bea5491c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:42.619831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5e20978d1a4886b04d37eef4c23d1e', 'request_id': 'req-5c655ece-5422-492d-8d0e-5289bea5491c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:42.688598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5e20978d1a4886b04d37eef4c23d1e', 'request_id': 'req-5c655ece-5422-492d-8d0e-5289bea5491c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:42.721740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] The token cache is being invalidate because project 2a5e20978d1a4886b04d37eef4c23d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:24:42.722089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:42.722754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5c655ece-5422-492d-8d0e-5289bea5491c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:42.728609 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1537/3077] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:42 2022] DELETE /identity/v3/projects/2a5e20978d1a4886b04d37eef4c23d1e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:42.730719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:42.731877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:42.732154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:42.766913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:42.768307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:42.857491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1541/3078] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:42.873163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:42.873658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:42.873943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:42.909293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:42.910619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:42.919880 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1538/3079] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:42.924057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:42.941970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153fb19-8f5b-4809-8504-4deb3308910c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:42.952055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:42.952980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:42.953377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:42.953813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:42.954629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:24:42.955084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:42.959968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:42.983976 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1542/3080] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:24:42.987725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.007810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a456-1dcc-40b4-a549-54075a56b89c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:43.026265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:43.027703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.028173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.028886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.030177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:43.035626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:43.153478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1539/3081] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:24:42 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:43.156763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.170795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc8bed-c307-4d5f-8e4f-427843a82a78 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:43.262966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:43.263846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.265315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.265844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.267839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:43.273917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:43.377369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1543/3082] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:24:43 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:43.382392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.390155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd371-1fbd-4299-af10-4c1686b73e2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:43.399913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:43.400753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.401169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.401675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.402882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:43.404520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:43.416335 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1540/3083] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:24:43.423224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.435818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7184e37-35cb-43b8-8335-ad305645fb71 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:43.451589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:43.452640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.452921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.453190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.453968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:43.455567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ed753-b31b-4c2b-a276-04639e3cc01e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:43.486199 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1544/3084] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:43.486880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.499057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c46a-061c-4f05-ad13-0ec3c7db0426 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:43.504580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:43.505369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.506260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.506737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] PATH_INFO: `/v3/projects/2c59bd73c7874a00b52ec7c5c4142039/users/a07f2b8c31f54c62aaba73ca2bd2edb8/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.526696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c59bd73c7874a00b52ec7c5c4142039, user_id=a07f2b8c31f54c62aaba73ca2bd2edb8, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:43.531200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:43.621566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:43.621844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:43.622265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:43.625058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1541/3085] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:24:43 2022] PUT /identity/v3/projects/2c59bd73c7874a00b52ec7c5c4142039/users/a07f2b8c31f54c62aaba73ca2bd2edb8/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:24:43.690239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:43.694290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:43.711584 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:43.861511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1545/3086] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:43.878266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:43.880503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:43.944714 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:44.003991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f560f-90fd-4ac0-84fe-77c4f5d1ee1d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:44.008520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:44.009198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:44.012216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:44.012216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:44.033299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:44.034830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:44.062441 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1542/3087] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:49.158078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:49.159511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:49.176631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e3dbc-cf3b-4c9f-96c6-60d82fce5d6b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:49.190833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:49.191474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:49.191755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:49.192019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] PATH_INFO: `/v3/users/6e8b2c03e5294bbe9ee8cda7468c9d86` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:49.194053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8b2c03e5294bbe9ee8cda7468c9d86)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:49.196821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:49.461065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8b2c03e5294bbe9ee8cda7468c9d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:49.552642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8b2c03e5294bbe9ee8cda7468c9d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:49.554327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8b2c03e5294bbe9ee8cda7468c9d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:49.598788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8b2c03e5294bbe9ee8cda7468c9d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:49.670092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-712e8ad5-bfbf-4810-b9a5-55c258fd065f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8b2c03e5294bbe9ee8cda7468c9d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:49.681596 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1546/3088] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:24:49 2022] DELETE /identity/v3/users/6e8b2c03e5294bbe9ee8cda7468c9d86 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:50.033749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:50.047674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ba8-7b9c-4972-883d-2d36f04b6899 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:50.125238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:50.126188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:50.126770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:50.127197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] PATH_INFO: `/v3/projects/ada31213f567489299af80277ee35f65` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:50.128598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada31213f567489299af80277ee35f65)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:50.130562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:50.303695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada31213f567489299af80277ee35f65', 'request_id': 'req-2651f5d7-5d57-4306-9347-853e235a7fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:50.315334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada31213f567489299af80277ee35f65', 'request_id': 'req-2651f5d7-5d57-4306-9347-853e235a7fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:50.430023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada31213f567489299af80277ee35f65', 'request_id': 'req-2651f5d7-5d57-4306-9347-853e235a7fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:50.457937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] The token cache is being invalidate because project ada31213f567489299af80277ee35f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:24:50.458246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:50.461898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2651f5d7-5d57-4306-9347-853e235a7fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:50.465702 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1543/3089] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:50 2022] DELETE /identity/v3/projects/ada31213f567489299af80277ee35f65 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:50.472141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:50.472665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:50.472814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:50.509616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:50.511156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:50.643308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:50.643627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:50.643908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:50.645591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1547/3090] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:50.686481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:50.688399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:50.715865 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1544/3091] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:50.720319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:50.735041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8982fe-604b-4fb3-a63f-dc996181f81c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:50.741743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:50.744821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:50.745431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:50.748640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:50.749654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:24:50.751040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:50.754218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:50.780435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1548/3092] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:24:50.788132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:50.803024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f050be-eb93-453f-8a37-18fd429647cb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:50.813040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:50.823862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:50.824717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:50.825476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:50.826342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:50.856756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:50.975801 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1545/3093] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:24:50 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:50.982208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:50.996780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57922fd3-941a-4195-8737-1efa5efce868 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.011211 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:51.061190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:51.064260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:51.127801 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:51.152796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.155423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.155423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.155423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.157894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.160029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.210462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f104-fe0e-49f1-8c85-c976033a4868 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.218275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.219248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.219784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.220292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] PATH_INFO: `/v3/users/e533367cf3fc4e06a96c6add0540b897` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.221774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e533367cf3fc4e06a96c6add0540b897)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.224107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.295125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1549/3094] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:24:50 2022] POST /identity/v3/users => generated 286 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:51.299479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:51.313204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b713df-c028-4b23-bd48-aad256d08855 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.319971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.321009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.321412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.325252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.325252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.326184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.347733 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1550/3095] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:24:51.348830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:51.361118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2e466-af9b-4c27-bad5-7bac4df8a15d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.375428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.376156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.376438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.376759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.378279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.379987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.410424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1551/3096] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:51.411453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:51.414673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:51.430967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c8a0-6e52-4d94-8a17-a5fdd7af780e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.436171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.436794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.437080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.437496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] PATH_INFO: `/v3/users/0b5e62bcc8f3464ba9652f3de19634de` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.440869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5e62bcc8f3464ba9652f3de19634de)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.443089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.459914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e533367cf3fc4e06a96c6add0540b897'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.460612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e533367cf3fc4e06a96c6add0540b897'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.484874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e533367cf3fc4e06a96c6add0540b897'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.484874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e533367cf3fc4e06a96c6add0540b897'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.579130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e533367cf3fc4e06a96c6add0540b897'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.630809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1546/3097] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:24:51 2022] DELETE /identity/v3/users/e533367cf3fc4e06a96c6add0540b897 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:51.631851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:51.633440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:51.742075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5e62bcc8f3464ba9652f3de19634de'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.817557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6ad9-dae2-4610-97f7-ec36f414ec64 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:51.830028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:51.830734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.831018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.831293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] PATH_INFO: `/v3/projects/13238008c06e49c3b088809143308a00/users/2ba44010e0ca4892b56886e2b1636f01/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:51.837703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5e62bcc8f3464ba9652f3de19634de'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.839403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5e62bcc8f3464ba9652f3de19634de'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.856416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13238008c06e49c3b088809143308a00, user_id=2ba44010e0ca4892b56886e2b1636f01, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:51.859897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:51.870754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5e62bcc8f3464ba9652f3de19634de'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.886397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b25c49bd-ab1c-40ed-b0c2-36c9fb335c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5e62bcc8f3464ba9652f3de19634de'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:51.898895 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1552/3098] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:24:51 2022] DELETE /identity/v3/users/0b5e62bcc8f3464ba9652f3de19634de => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:51.958998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1547/3099] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:24:51 2022] PUT /identity/v3/projects/13238008c06e49c3b088809143308a00/users/2ba44010e0ca4892b56886e2b1636f01/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:51.964332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:51.964685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:51.965649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.003005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:52.005048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.112633 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:52.141325 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1553/3100] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:52.161162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:52.164520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.214282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:52.217250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.248307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5c79-297e-432b-b0d2-70c1f19cbc4b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:52.265587 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:52.276333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:52.276989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.277868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.278425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] PATH_INFO: `/v3/projects/121fd24a0b6b4eb3aa1cac304dda16a0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.279677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121fd24a0b6b4eb3aa1cac304dda16a0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:52.284905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:52.329270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f6fa5-a1d9-4a88-84f2-763527e17060 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:52.340203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:52.340888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.343432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.343432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.363520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:52.365000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:52.402389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1548/3101] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:52.432180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:52.433365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.478720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121fd24a0b6b4eb3aa1cac304dda16a0', 'request_id': 'req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.489009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929faf7-5920-4f45-87af-ce5776a132fa service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:52.586337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121fd24a0b6b4eb3aa1cac304dda16a0', 'request_id': 'req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.597256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121fd24a0b6b4eb3aa1cac304dda16a0', 'request_id': 'req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.619259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] The token cache is being invalidate because project 121fd24a0b6b4eb3aa1cac304dda16a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:24:52.619802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.624007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35c04ebe-b0dd-4fbb-a5a7-95dc589b0118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.628530 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1554/3102] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:52 2022] DELETE /identity/v3/projects/121fd24a0b6b4eb3aa1cac304dda16a0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:52.633382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:52.634272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.634646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.634837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a886d-1752-4c12-b3cb-89669882f592 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.635113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] PATH_INFO: `/v3/projects/6b2476687fed48edb9f3c049376bfc7d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.635606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a886d-1752-4c12-b3cb-89669882f592 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.636175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a886d-1752-4c12-b3cb-89669882f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.637411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2476687fed48edb9f3c049376bfc7d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:52.639496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:52.692628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f97a886d-1752-4c12-b3cb-89669882f592 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:52.696820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f97a886d-1752-4c12-b3cb-89669882f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.716027 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1555/3103] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:52.717770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.718178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.718543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.742971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:52.744296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:52.753811 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1556/3104] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:52.758356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:52.778277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4b39-c421-45b5-af73-377fd8d7f276 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:52.807022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2476687fed48edb9f3c049376bfc7d', 'request_id': 'req-0a5c7544-49d8-40b9-bd5a-908515d0c016'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.822255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2476687fed48edb9f3c049376bfc7d', 'request_id': 'req-0a5c7544-49d8-40b9-bd5a-908515d0c016'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.921781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2476687fed48edb9f3c049376bfc7d', 'request_id': 'req-0a5c7544-49d8-40b9-bd5a-908515d0c016'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.935502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:52.936121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.936395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.936664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.937311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:24:52.937704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:52.940180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] The token cache is being invalidate because project 6b2476687fed48edb9f3c049376bfc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:24:52.940470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.941143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a5c7544-49d8-40b9-bd5a-908515d0c016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:52.944511 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1549/3105] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:52 2022] DELETE /identity/v3/projects/6b2476687fed48edb9f3c049376bfc7d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:52.944730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:52.950847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e856639-1d0e-452c-86b9-bb0f64b6e24a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:52.951156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e856639-1d0e-452c-86b9-bb0f64b6e24a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:52.951377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e856639-1d0e-452c-86b9-bb0f64b6e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:52.975895 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1557/3106] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:24:52.981417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:52.985515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:53.001241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1e856639-1d0e-452c-86b9-bb0f64b6e24a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:53.002359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1e856639-1d0e-452c-86b9-bb0f64b6e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:53.012751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87824392-3bc2-46de-9d31-49cdaad160ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.023536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1550/3107] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:53.024865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.025582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.025860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.026129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.026757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.028819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.030479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.030959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.031417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.070695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:53.075178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:53.083506 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1551/3108] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:24:53.087069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.108514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4af421-16d0-41e5-866d-d1c1a4a77368 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.150513 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1558/3109] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:24:52 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:53.150513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.153488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.154127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.154409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.154681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.160874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:24:53.162051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.174913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.203866 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1552/3110] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:24:53.207590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.216652 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:53.219777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1aba-d24e-49f4-a74d-ae8d8979418f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.263962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3245030-57cb-470e-8c9a-638c15565d28 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.270351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.271051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.271602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.271873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.272513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.274852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.300758 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:53.339048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.340456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.343367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.343878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.344821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.347339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.407705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1559/3111] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:24:53 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:53.408793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.426018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877f4d9-c539-4ade-a7ed-72d3efab9af6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.431855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.432882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.434037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.434489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.435296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.437592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.453452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1560/3112] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:53.459637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.473147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44713a03-21d8-4ec4-b96e-6430568d8826 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.489295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1553/3113] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:24:53 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:24:53.494566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.504968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.505820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.506224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.506697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.507440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.509148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.539633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1561/3114] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:53.545859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.602125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a40b5c-6469-4aa7-b3e3-91473419c924 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.619793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9763f1-7687-49be-ae04-702dea18a2d1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.622917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.623798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.624422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.624705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.625022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.625691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.626332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.626729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.627599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.628277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] PATH_INFO: `/v3/projects/127b4f4e1e4b43ed856faee3c5d9d88d/users/0dc60a96037f438ebbaaa6d25661bfc5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.670696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127b4f4e1e4b43ed856faee3c5d9d88d, user_id=0dc60a96037f438ebbaaa6d25661bfc5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.675383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb8596-ad3a-4246-a0b7-13fe65260a36 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.723861 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1554/3115] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:24:53 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:53.732672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.751236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5c79b-e17b-4649-9c2d-e270daf126a5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.759669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.760279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.760558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.762490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.762490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.763629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.767769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1562/3116] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:24:53 2022] PUT /identity/v3/projects/127b4f4e1e4b43ed856faee3c5d9d88d/users/0dc60a96037f438ebbaaa6d25661bfc5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:53.772390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.773262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.774755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.784765 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1555/3117] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:53.793388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.809856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:53.811925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:53.815984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d04e0-3363-42ef-a61c-fe147ef61bf1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.914612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.915358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.915635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.915909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.916856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:53.919080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:53.931244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1556/3118] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:24:53.939914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.964994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e79cd-fea4-4f7c-939d-5af7683409ad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:53.974831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:53.975727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:53.976084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:53.976460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] PATH_INFO: `/v3/projects/310172f2dfaf4ddcb5eace8a13939cda/users/e1e50d6775ec4d2e96ab6e839b4631f1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:53.981179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1563/3119] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:53.989064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:53.992247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:54.038859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=310172f2dfaf4ddcb5eace8a13939cda, user_id=e1e50d6775ec4d2e96ab6e839b4631f1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:54.045429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb40c4-5191-4279-9256-98791b7628cc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:54.151313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1557/3120] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:24:53 2022] PUT /identity/v3/projects/310172f2dfaf4ddcb5eace8a13939cda/users/e1e50d6775ec4d2e96ab6e839b4631f1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:54.153304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645ffb-7f33-4ca6-aa16-c9b5d7be1469 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:54.153694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645ffb-7f33-4ca6-aa16-c9b5d7be1469 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:54.154048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645ffb-7f33-4ca6-aa16-c9b5d7be1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:54.203476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c864b9b-8bdb-4f13-9bfe-3076681cf3e0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:54.258886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-66645ffb-7f33-4ca6-aa16-c9b5d7be1469 None None] MFA Rules not processed for user `e1e50d6775ec4d2e96ab6e839b4631f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:54.268099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-66645ffb-7f33-4ca6-aa16-c9b5d7be1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:54.284289 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:54.316428 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:54.374771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:54.378598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:54.378882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:54.381122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:54.471522 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1558/3121] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:54.483422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:54.484006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:54.484936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:54.531256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] MFA Rules not processed for user `e1e50d6775ec4d2e96ab6e839b4631f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:54.537322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:54.557882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1559/3122] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:24:54.576931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:54.578996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:54.580446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:54.582087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:54.594577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1564/3123] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:24:54.700800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c34b-c52f-47cc-8006-08fc873dd35f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:54.720672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:54.721293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:54.721599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:54.721868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:54.743979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:54.748388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:54.768785 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1560/3124] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:55.150946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:55.153114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:55.177858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b68aa-9c2a-46a1-9928-d4ef889db7ce service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:55.189415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:55.190435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:55.191075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:55.191688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] PATH_INFO: `/v3/users/9cb216afb20940ce9cc86b2d1faab962` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:55.193002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb216afb20940ce9cc86b2d1faab962)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:55.198302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:55.517980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb216afb20940ce9cc86b2d1faab962'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:55.652038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb216afb20940ce9cc86b2d1faab962'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:55.652038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb216afb20940ce9cc86b2d1faab962'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:55.701513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb216afb20940ce9cc86b2d1faab962'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:55.716575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-64e75498-17de-480d-b419-3d792653f7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb216afb20940ce9cc86b2d1faab962'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:55.734820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1565/3125] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:24:55 2022] DELETE /identity/v3/users/9cb216afb20940ce9cc86b2d1faab962 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:56.120548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:56.133592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11fbd-3e4e-4b4c-9db6-f2c7a6f82420 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:56.276691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:56.277143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:56.278026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:56.283078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] PATH_INFO: `/v3/projects/0e4747ca082b4a9b82bb64c9ea2ec750` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:56.283078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4747ca082b4a9b82bb64c9ea2ec750)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:56.283617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:56.453500 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:56.513055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4747ca082b4a9b82bb64c9ea2ec750', 'request_id': 'req-8609e920-57ca-41d3-a46d-2160517317fd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:56.526003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4747ca082b4a9b82bb64c9ea2ec750', 'request_id': 'req-8609e920-57ca-41d3-a46d-2160517317fd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:56.621384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4747ca082b4a9b82bb64c9ea2ec750', 'request_id': 'req-8609e920-57ca-41d3-a46d-2160517317fd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:56.639704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] The token cache is being invalidate because project 0e4747ca082b4a9b82bb64c9ea2ec750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:24:56.639994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:56.640693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8609e920-57ca-41d3-a46d-2160517317fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:24:56.643729 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1561/3126] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:24:56 2022] DELETE /identity/v3/projects/0e4747ca082b4a9b82bb64c9ea2ec750 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:56.649604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:56.650545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:56.651586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:56.693825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:56.695549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:56.795389 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:56.843252 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1566/3127] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:56.850622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:56.851169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:56.851630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:56.934317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:56.935572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:56.956067 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1562/3128] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:56.957313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:56.979296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060403b4-ebb5-49d4-8524-9e59e0660a86 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:56.993821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:56.994676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:56.995119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:56.995547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:56.996889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:24:56.997374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.000959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.029897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1567/3129] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:24:57.032656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:57.051708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d321b0-3252-440a-86b9-12e94aec88b6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:57.082091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:57.082724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.083067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.083335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.083979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.085934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.232002 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1563/3130] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:24:57 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:57.236325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:57.250990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef13a-e5a7-430f-ab46-9d3712af5054 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:57.443833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:57.443833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.443833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.443833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.444337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.444896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.578271 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1568/3131] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:24:57 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:24:57.582667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:57.597849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc5be-6622-4712-8ba9-74c494b8645c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:57.610501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:57.613669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.613669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.613669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.613669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.614150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.638132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1564/3132] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:57.642363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:57.655786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc457-37cd-4792-b680-df33d9ce9921 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:57.671016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:57.671568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.672016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.672293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.672950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.680119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa30687-229f-466a-82d4-846ae7f7e869 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.729540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1569/3133] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:24:57.734898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:57.752892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54d7c-ca53-4957-a58d-229a4cbff5b4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:57.768446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:57.769184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.769512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.769791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] PATH_INFO: `/v3/projects/5fefbf45157c46fba999d938ad42e8d7/users/26bbc8ffa7c84ae9a9b82cd61e136702/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.812545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fefbf45157c46fba999d938ad42e8d7, user_id=26bbc8ffa7c84ae9a9b82cd61e136702, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:57.816239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:57.915918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1565/3134] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:24:57 2022] PUT /identity/v3/projects/5fefbf45157c46fba999d938ad42e8d7/users/26bbc8ffa7c84ae9a9b82cd61e136702/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:24:57.928509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d073b-1ef6-4400-a80c-7006be922f95 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:57.928935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d073b-1ef6-4400-a80c-7006be922f95 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:57.929405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d073b-1ef6-4400-a80c-7006be922f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:57.999421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-111d073b-1ef6-4400-a80c-7006be922f95 None None] MFA Rules not processed for user `26bbc8ffa7c84ae9a9b82cd61e136702`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:58.001191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-111d073b-1ef6-4400-a80c-7006be922f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:58.182599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1570/3135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:58.191823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:58.194083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:58.285497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8094a5f-7d06-40f6-9083-ac46260c565f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:58.290590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:58.291516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:58.292012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:58.292507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:58.306725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:58.311488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db19ae-ee8e-4ca4-a46e-ea6f5cbfc07b service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:58.326373 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1566/3136] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:24:58.913779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:58.914922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:58.917391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:58.982774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:58.984001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:59.080947 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:59.121414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1571/3137] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:59.301506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:59.302394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:59.303455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:59.346144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] MFA Rules not processed for user `a07f2b8c31f54c62aaba73ca2bd2edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:24:59.348390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:59.352448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:59.390589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:59.541863 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:24:59.601173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbdcfb-6d20-44e4-9ffa-0d1b3f2ba110 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:59.610801 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1567/3138] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:24:59.615510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:59.616263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:59.616673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:59.617040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:59.627538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:59.629514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0802402-71d3-4a19-8101-1aa59cdb07ed service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:59.665808 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1572/3139] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:24:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:24:59.685319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:24:59.687886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:24:59.812151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef68ced-357b-44c9-853f-b3aa5d6f0ba4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:24:59.816646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:24:59.817503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:24:59.817974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:24:59.818541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:24:59.838207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:24:59.840868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:24:59.855782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1568/3140] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:03.040554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef619-3320-41e3-aaf5-e3ce09fe45a2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:03.041924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef619-3320-41e3-aaf5-e3ce09fe45a2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:03.042382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef619-3320-41e3-aaf5-e3ce09fe45a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:03.089403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2baef619-3320-41e3-aaf5-e3ce09fe45a2 None None] MFA Rules not processed for user `33691c943ec040ddb04b6648b6e945ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:03.091065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2baef619-3320-41e3-aaf5-e3ce09fe45a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:03.224704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1573/3141] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:04.323025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:04.328106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:04.351120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2f21-5354-48ab-b225-e8e661e27b3a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:04.366216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:04.366902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:04.367404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:04.367855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:04.369986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:04.397800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:04.399877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:04.437356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1569/3142] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:06.341877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6250-4ffb-492e-b5fb-78de9dd67878 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:06.342348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6250-4ffb-492e-b5fb-78de9dd67878 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:06.342616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6250-4ffb-492e-b5fb-78de9dd67878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:06.389316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-142c6250-4ffb-492e-b5fb-78de9dd67878 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:06.392304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-142c6250-4ffb-492e-b5fb-78de9dd67878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:06.430819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1574/3143] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:06.438857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:06.455527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d38985-c755-42a1-86bf-14c04f2b0487 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:06.462422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:06.462938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:06.463288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:06.463568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:06.479264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:06.482586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ac143-d4e4-4dc1-be0b-07fd50d9a562 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:06.531454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1570/3144] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:08.396320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812a8a-4d91-4bdc-b7af-3b8187eb49ac None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:08.396896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812a8a-4d91-4bdc-b7af-3b8187eb49ac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:08.396896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c812a8a-4d91-4bdc-b7af-3b8187eb49ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:08.452643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8c812a8a-4d91-4bdc-b7af-3b8187eb49ac None None] MFA Rules not processed for user `a07f2b8c31f54c62aaba73ca2bd2edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:08.453891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8c812a8a-4d91-4bdc-b7af-3b8187eb49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:08.501669 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1575/3145] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:11.647273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a86b9-2df9-492e-80f3-c3f5925643f1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:11.648270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a86b9-2df9-492e-80f3-c3f5925643f1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:11.649141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a86b9-2df9-492e-80f3-c3f5925643f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:11.730215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-745a86b9-2df9-492e-80f3-c3f5925643f1 None None] MFA Rules not processed for user `0dc60a96037f438ebbaaa6d25661bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:11.732991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-745a86b9-2df9-492e-80f3-c3f5925643f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:11.847365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1571/3146] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:11.858225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa157fc-3a73-4dbb-8efb-50dc408ef36e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:11.858714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa157fc-3a73-4dbb-8efb-50dc408ef36e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:11.858904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa157fc-3a73-4dbb-8efb-50dc408ef36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:11.924518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-daa157fc-3a73-4dbb-8efb-50dc408ef36e None None] MFA Rules not processed for user `0dc60a96037f438ebbaaa6d25661bfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:11.934762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-daa157fc-3a73-4dbb-8efb-50dc408ef36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:11.955371 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1576/3147] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:12.066055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:12.066414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:12.066903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:12.153834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] MFA Rules not processed for user `2ba44010e0ca4892b56886e2b1636f01`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:12.157799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:12.273265 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:12.361649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1572/3148] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:12.373637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:12.373924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:12.374201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:12.462479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] MFA Rules not processed for user `2ba44010e0ca4892b56886e2b1636f01`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:12.466344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:12.510638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1577/3149] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:12.970895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:12.979421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:13.130608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9a14-0c8b-4269-a880-61cbc80f7298 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:13.144426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:13.145746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:13.145746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:13.147189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:13.163400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:13.165264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87039e-9e72-4743-a264-56a12dfe4e61 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:13.178202 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1573/3150] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:15.513423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:15.555941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69184b8f-e204-4fcf-8fdc-8084b9644ec8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:15.572311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:15.573421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:15.573836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:15.574558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:15.584931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:15.587405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:15.614482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1578/3151] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:16.732713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:16.733230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:16.733983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:16.834486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:16.835728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:16.919979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1574/3152] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:16.940857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:16.978294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb944322-48a3-4bf1-b912-d2adc73edecd service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:16.994251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:16.995080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:16.995471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:16.996074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:17.025074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:17.027086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79779b-3db2-4246-b5f9-35f0d3cd9d8d service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:17.063264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1579/3153] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:17.801568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:18.058026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b5a45-02cc-43a3-9228-d776d86877ba None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:18.069813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:18.070897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:18.071545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:18.072095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] PATH_INFO: `/v3/users/26bbc8ffa7c84ae9a9b82cd61e136702` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:18.080280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bbc8ffa7c84ae9a9b82cd61e136702)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:18.081118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:18.341203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bbc8ffa7c84ae9a9b82cd61e136702'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:18.342342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bbc8ffa7c84ae9a9b82cd61e136702'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:18.366418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bbc8ffa7c84ae9a9b82cd61e136702'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:18.367925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bbc8ffa7c84ae9a9b82cd61e136702'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:18.375107 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:18.476841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bbc8ffa7c84ae9a9b82cd61e136702'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:18.524763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1575/3154] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:25:17 2022] DELETE /identity/v3/users/26bbc8ffa7c84ae9a9b82cd61e136702 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:18.529689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10187fd-e227-4772-8841-4293be260de1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:18.530189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10187fd-e227-4772-8841-4293be260de1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:18.530425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10187fd-e227-4772-8841-4293be260de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:18.578353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b10187fd-e227-4772-8841-4293be260de1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:18.579605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b10187fd-e227-4772-8841-4293be260de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:18.669050 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:18.734191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1580/3155] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:18.749251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:18.752538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:19.120522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9adbe3e-ccb4-49b9-9872-61e9381ef659 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:19.140461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:19.141115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:19.146140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:19.146426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:19.194229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:19.202145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95843c1d-a8a4-4618-ba86-9ce4f30589ac service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:19.250110 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1576/3156] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:20.196972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10187fd-e227-4772-8841-4293be260de1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:20.198441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b10187fd-e227-4772-8841-4293be260de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:20.242016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10187fd-e227-4772-8841-4293be260de1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:20.276160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:20.277162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:20.278302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:20.279917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] PATH_INFO: `/v3/projects/5fefbf45157c46fba999d938ad42e8d7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:20.295958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fefbf45157c46fba999d938ad42e8d7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:20.302470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:20.555172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fefbf45157c46fba999d938ad42e8d7', 'request_id': 'req-e1f42e0a-4544-48eb-85c5-d191d6d431c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:20.699010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fefbf45157c46fba999d938ad42e8d7', 'request_id': 'req-e1f42e0a-4544-48eb-85c5-d191d6d431c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:20.719044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fefbf45157c46fba999d938ad42e8d7', 'request_id': 'req-e1f42e0a-4544-48eb-85c5-d191d6d431c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:20.766745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] The token cache is being invalidate because project 5fefbf45157c46fba999d938ad42e8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:25:20.767122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:20.767996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1f42e0a-4544-48eb-85c5-d191d6d431c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:20.776003 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1581/3157] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:20 2022] DELETE /identity/v3/projects/5fefbf45157c46fba999d938ad42e8d7 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:20.781159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:20.781644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:20.781644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:20.846332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:20.847755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:21.018828 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1577/3158] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:21.026745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.027314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.028488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.074515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:21.079160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:21.103163 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1582/3159] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:21.107614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.132415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d911f-01be-4d0f-bf91-52ca01836bfc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.137753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.138659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.139150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.139634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.140504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:25:21.141033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:21.143034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:21.159236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1578/3160] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:25:21.163534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.177479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb5e51-989b-4c3a-81dd-7f513841c2ad None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.191821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.193044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.193571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.194047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.195270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:21.198582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:21.341856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1583/3161] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:25:21 2022] POST /identity/v3/projects => generated 395 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:25:21.346251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.358756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bfc32-2697-4de6-8bfe-00cd74f470be admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.542216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.542858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.543532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.543966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.544907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:21.548299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:21.697639 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:21.736759 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1579/3162] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:25:21 2022] POST /identity/v3/users => generated 298 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:21.739355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.774876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7f1b-3af1-41c4-a313-0e23f6504013 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.789598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.790236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.790515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.790797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.791481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:21.795445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:21.845008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1584/3163] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:21.846642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.862786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4b7ee-a5c5-48bb-9530-d9358dae5544 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.894329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.895258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:21.896604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:21.897049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:21.897947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:21.905302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f073d2b-2b53-48df-a304-86062b8a77f8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:21.950352 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1580/3164] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:21.954865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:21.968906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded7a3-67e2-4c33-b7e4-d85cc7dab65a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:21.998959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:21.999642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:22.000045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:22.000505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] PATH_INFO: `/v3/projects/4ac8019c0ff045f1a0a54f2a52479a70/users/f2720b90fc5d42bfbbb9da2f7bc83952/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:22.044107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8019c0ff045f1a0a54f2a52479a70, user_id=f2720b90fc5d42bfbbb9da2f7bc83952, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:22.048836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:22.175338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1585/3165] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:25:21 2022] PUT /identity/v3/projects/4ac8019c0ff045f1a0a54f2a52479a70/users/f2720b90fc5d42bfbbb9da2f7bc83952/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:22.186308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:22.189357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:22.189661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:22.267302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] MFA Rules not processed for user `f2720b90fc5d42bfbbb9da2f7bc83952`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:22.268779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:22.361882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1581/3166] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:23.654566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:23.656332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:23.770173 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:23.796827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662bf78-f449-4a74-9330-b9ab579952b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:23.803650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:23.804733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:23.805281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:23.805834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:23.820100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:23.822965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f9ea1-16c3-428e-84e8-15843dc15f38 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:23.849279 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1586/3167] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:28.742347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:28.847190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ffb6-a85d-4d69-8620-d72701416c54 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:28.853537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:28.854669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:28.858599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:28.859124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] PATH_INFO: `/v3/users/f2720b90fc5d42bfbbb9da2f7bc83952` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:28.862610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2720b90fc5d42bfbbb9da2f7bc83952)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:28.864931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:29.091643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2720b90fc5d42bfbbb9da2f7bc83952'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:29.092745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2720b90fc5d42bfbbb9da2f7bc83952'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:29.115451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2720b90fc5d42bfbbb9da2f7bc83952'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:29.116247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2720b90fc5d42bfbbb9da2f7bc83952'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:29.218479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2720b90fc5d42bfbbb9da2f7bc83952'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:29.258459 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:29.284226 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1582/3168] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:25:28 2022] DELETE /identity/v3/users/f2720b90fc5d42bfbbb9da2f7bc83952 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:29.285795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:29.286262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:29.286358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:29.313461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:29.315532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:29.461604 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1587/3169] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:29.518256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:29.522920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:29.760260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a6e6a-2706-4406-9bc2-47e23a65ba5b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:29.769809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:29.770620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:29.771179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:29.771682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:29.801894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:29.804054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f29c30-0cf7-42c2-a3b9-67039a7f5b33 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:29.859650 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1583/3170] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:32.474089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:32.475608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:32.504743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396277b0-b2fb-4b63-8884-e9b355c78979 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:32.513193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:32.513967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:32.514381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:32.514654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] PATH_INFO: `/v3/projects/4ac8019c0ff045f1a0a54f2a52479a70` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:32.516328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac8019c0ff045f1a0a54f2a52479a70)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:32.518262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:32.710554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac8019c0ff045f1a0a54f2a52479a70', 'request_id': 'req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:32.891029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac8019c0ff045f1a0a54f2a52479a70', 'request_id': 'req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:32.902067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac8019c0ff045f1a0a54f2a52479a70', 'request_id': 'req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:32.942783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:32.945905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] The token cache is being invalidate because project 4ac8019c0ff045f1a0a54f2a52479a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:25:32.946804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:32.947372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:32.947501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:32.948645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c74c2748-22b2-4fa2-b12c-ecc9a41db98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:32.953877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1588/3171] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:32 2022] DELETE /identity/v3/projects/4ac8019c0ff045f1a0a54f2a52479a70 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:32.959220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fd12-1f87-474d-923a-2f91ae9b7c24 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:32.962560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fd12-1f87-474d-923a-2f91ae9b7c24 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:32.962560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66fd12-1f87-474d-923a-2f91ae9b7c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:32.998641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:33.004664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:33.051838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ae66fd12-1f87-474d-923a-2f91ae9b7c24 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:33.053626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae66fd12-1f87-474d-923a-2f91ae9b7c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:33.092726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1584/3172] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:33.112499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:33.114383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:33.211351 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1589/3173] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:33.213962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.214253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.214662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.252266 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:33.252528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddfbaf-2d84-4601-b8fc-cc0a20898c3e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:33.270327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:33.271187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.271559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.271983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.275486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:33.276909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:33.292336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:33.294601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:33.303928 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1590/3174] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:33.313290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:33.316340 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1585/3175] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:25:33.328087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fca3-bf8c-4c58-a4db-ce08e28600d9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:33.337662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:33.338727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.341730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.342086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.342856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:25:33.343235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:33.347105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:33.368628 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1591/3176] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:25:33.369848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:33.394443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231347-5c75-4b9f-af89-96f0441d6834 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:33.398816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:33.399577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.399858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.400126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.400769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:33.402821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:33.573213 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1586/3177] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:25:33 2022] POST /identity/v3/projects => generated 391 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:33.577601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:33.592481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccba14-f5db-4749-b193-dcfcc726c7e6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:33.749874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:33.751414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.752004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.752528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.754388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:33.766469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:33.905414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1592/3178] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:25:33 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:33.909209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:33.940425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e48d-bc5e-4228-937d-969bc65c004e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:33.952765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:33.955138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:33.956852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:33.958203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:33.959266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:33.961294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:33.978031 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:33.992690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1587/3179] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:33.996791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:34.010957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d2c30-da94-4df0-9eff-d8b16fb61eee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:34.017759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:34.018509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:34.018888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:34.019252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:34.020093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:34.021801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3bed52-3751-4c3a-8471-8c8eaaae7f8c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:34.062705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:34.063224 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1593/3180] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:34.078894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e86b2-2a3d-411f-b04c-b25dd38af0a6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:34.098166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:34.099119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:34.099410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:34.099802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] PATH_INFO: `/v3/projects/e2f98e4ed02649349d7c9cc7594e0271/users/9089245594d14035a23f468e21099983/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:34.132479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f98e4ed02649349d7c9cc7594e0271, user_id=9089245594d14035a23f468e21099983, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:34.135446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259bf20-565a-4f0f-b086-9cbcf7125f6d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:34.218910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1588/3181] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:25:34 2022] PUT /identity/v3/projects/e2f98e4ed02649349d7c9cc7594e0271/users/9089245594d14035a23f468e21099983/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:25:34.244185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:34.244185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:34.244185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:34.282765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] MFA Rules not processed for user `9089245594d14035a23f468e21099983`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:34.284217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:34.388399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf3b8-b083-46e1-9777-494214705962 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:34.388888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf3b8-b083-46e1-9777-494214705962 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:34.389390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf3b8-b083-46e1-9777-494214705962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:34.415657 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1594/3182] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:34.443338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-249bf3b8-b083-46e1-9777-494214705962 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:34.444974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-249bf3b8-b083-46e1-9777-494214705962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:34.594916 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1589/3183] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:25:34.629861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:34.722634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab916e-3320-479f-aeaa-2984085e54af None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:34.729490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:34.730038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:34.730317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:34.730603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:34.739954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:34.741565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ccc49-3071-439b-ab2a-716baa2dd26c service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:34.755074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1595/3184] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:35.056737 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:35.271042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf3b8-b083-46e1-9777-494214705962 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:35.273016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-249bf3b8-b083-46e1-9777-494214705962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:35.402621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf3b8-b083-46e1-9777-494214705962 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:35.410544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:35.411241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:35.411626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:35.411970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:35.422501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:35.424782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:35.436430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1590/3185] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:38.483113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:38.484192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:38.484672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:38.522442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:38.524255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:38.543593 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1596/3186] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:38.560603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:38.586607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952371dc-b29c-46c8-9761-a52b9628870c service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:38.595030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:38.595646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:38.596005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:38.596893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:38.608803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:38.613166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f4371-c11e-4e5a-a770-fb79e630c933 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:38.634843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1591/3187] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:40.866654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:40.970670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8209a9-3b29-4435-b895-5f81b158718a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:40.979706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:40.980666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:40.981707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:40.981979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] PATH_INFO: `/v3/users/9089245594d14035a23f468e21099983` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:40.983554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9089245594d14035a23f468e21099983)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:40.985504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:41.076013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fdf2-d4ee-4077-a28e-e547f0db7656 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:41.082489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fdf2-d4ee-4077-a28e-e547f0db7656 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:41.082489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347fdf2-d4ee-4077-a28e-e547f0db7656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:41.105462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d347fdf2-d4ee-4077-a28e-e547f0db7656 None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:41.107620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d347fdf2-d4ee-4077-a28e-e547f0db7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:41.171749 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:41.192036 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1592/3188] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:25:41.205464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9089245594d14035a23f468e21099983'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:41.296615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9089245594d14035a23f468e21099983'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:41.297250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9089245594d14035a23f468e21099983'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:41.321813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9089245594d14035a23f468e21099983'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:41.333404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9089245594d14035a23f468e21099983'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:41.344926 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1597/3189] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:25:40 2022] DELETE /identity/v3/users/9089245594d14035a23f468e21099983 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:41.346660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:41.347127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:41.347561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:41.382097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:41.386460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:41.469728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:41.471357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:41.473437 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1593/3190] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:41.584699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa52-0f24-4cf3-accb-76031c912669 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:41.592971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:41.594764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:41.595206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:41.596097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:41.613643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:41.615588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72516-1dff-4643-b556-ceb775d54c63 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:41.624665 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:41.650485 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1598/3191] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:25:42.327056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:42.328691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:42.364741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb1fed-09b5-4ff9-8e53-a2c87066a3a2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:42.382274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:42.385168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:42.385714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:42.386220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] PATH_INFO: `/v3/projects/e2f98e4ed02649349d7c9cc7594e0271` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:42.391117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f98e4ed02649349d7c9cc7594e0271)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:42.400889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:42.728986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f98e4ed02649349d7c9cc7594e0271', 'request_id': 'req-41e43877-929f-4019-9293-f18713fbf868'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:42.743160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f98e4ed02649349d7c9cc7594e0271', 'request_id': 'req-41e43877-929f-4019-9293-f18713fbf868'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:43.132253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f98e4ed02649349d7c9cc7594e0271', 'request_id': 'req-41e43877-929f-4019-9293-f18713fbf868'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:43.166513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] The token cache is being invalidate because project e2f98e4ed02649349d7c9cc7594e0271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:25:43.166852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:43.170241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-41e43877-929f-4019-9293-f18713fbf868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:43.177436 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1594/3192] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:42 2022] DELETE /identity/v3/projects/e2f98e4ed02649349d7c9cc7594e0271 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:43.179609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:43.180061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:43.180208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:43.220151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:43.220151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:43.323860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1599/3193] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:43.332180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:43.332702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:43.332910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:43.414588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:43.416202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:43.460690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1595/3194] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:43.469316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:43.486583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6246980-83d7-4775-9305-f3a30417a107 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:43.505264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:43.505922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:43.506208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:43.506475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:43.507134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:25:43.507431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:43.514938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:43.545294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1600/3195] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:25:43.547123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:43.565793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3c7e2-fc60-461d-bcbe-e62a1734c9e8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:43.598291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:43.599016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:43.599406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:43.600185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:43.600919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:43.607544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:43.742737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1596/3196] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:25:43 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:43.747307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:43.769872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41625276-884f-45e1-b7c0-36d06b99717a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:43.934928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:43.937422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:43.937947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:43.938224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:43.940939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:43.946589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:44.083779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1601/3197] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:25:43 2022] POST /identity/v3/users => generated 286 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:44.088001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:44.120808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a4a41-b035-4fac-874c-9709d3a63a17 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:44.148168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:44.148801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:44.149094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:44.152859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:44.155915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:44.168055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:44.215141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1597/3198] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:44.219618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:44.234373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b0cae-6bfe-4ea0-837c-4aa9201adc1d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:44.250415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:44.250647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:44.250931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:44.251145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:44.251807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:44.257642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831f58-043a-4dff-807e-0a6ba02c16d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:44.287035 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1602/3199] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:44.290369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:44.307312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e6b2-0094-4375-a74f-4ebb815f3e19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:44.323724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:44.324882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:44.325935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:44.326692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] PATH_INFO: `/v3/projects/6ec2daf2c00e4a5da96640aa09f998c4/users/63c9832e3bb94fc0b4be22d4f8130ddb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:44.353057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec2daf2c00e4a5da96640aa09f998c4, user_id=63c9832e3bb94fc0b4be22d4f8130ddb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:44.356651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:44.464161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1598/3200] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:25:44 2022] PUT /identity/v3/projects/6ec2daf2c00e4a5da96640aa09f998c4/users/63c9832e3bb94fc0b4be22d4f8130ddb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:25:44.475971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391451-f781-4039-8773-b94541645ed4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:44.476247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391451-f781-4039-8773-b94541645ed4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:44.482714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3391451-f781-4039-8773-b94541645ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:44.614374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c3391451-f781-4039-8773-b94541645ed4 None None] MFA Rules not processed for user `63c9832e3bb94fc0b4be22d4f8130ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:44.617179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3391451-f781-4039-8773-b94541645ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:44.786648 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:44.832857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1603/3201] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:44.883584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:44.886204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:44.969653 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:45.148527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85789-b63e-43db-8803-5f3daeccfec7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:45.166757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:45.168339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:45.168339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:45.168339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:45.182330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:45.185275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11c47-71da-4e13-a7aa-06035ff021cc service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:45.213565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1599/3202] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:50.769314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3391451-f781-4039-8773-b94541645ed4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:50.921932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3391451-f781-4039-8773-b94541645ed4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:50.942691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:50.944450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:50.944450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:50.946078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] PATH_INFO: `/v3/users/63c9832e3bb94fc0b4be22d4f8130ddb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:50.959086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c9832e3bb94fc0b4be22d4f8130ddb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:50.966512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:51.561874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c9832e3bb94fc0b4be22d4f8130ddb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:51.731698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c9832e3bb94fc0b4be22d4f8130ddb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:51.732378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c9832e3bb94fc0b4be22d4f8130ddb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:51.776055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c9832e3bb94fc0b4be22d4f8130ddb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:51.792622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c9832e3bb94fc0b4be22d4f8130ddb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:51.805403 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1604/3203] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:25:50 2022] DELETE /identity/v3/users/63c9832e3bb94fc0b4be22d4f8130ddb => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:51.810420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:51.810921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:51.811182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:51.848755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:51.852153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:52.037080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1600/3204] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:52.058663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:52.060431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:52.213287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dd0c6-0338-4fe0-82ae-4cfd7db31c81 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:52.219202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:52.219999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:52.220459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:52.220903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:52.237494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:52.239117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:52.258546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1605/3205] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:52.716326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:52.731745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919f623-a1b7-4336-b91d-43d40cba4f42 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:52.756255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:52.759360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:52.761158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:52.764150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:52.775506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:52.836327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:52.844549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26974-3d31-41f5-9c42-be87fffc5558 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:52.879739 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1601/3206] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:54.704947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:54.706522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:54.720714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eeb042-105d-439d-8993-735c526a17ce service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:54.726899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:54.727655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:54.727999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:54.729319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] PATH_INFO: `/v3/projects/6ec2daf2c00e4a5da96640aa09f998c4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:54.730134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec2daf2c00e4a5da96640aa09f998c4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:54.732822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:54.775670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:54.901915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec2daf2c00e4a5da96640aa09f998c4', 'request_id': 'req-b89ba792-a7a6-49f1-ac06-c8c4080993fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:54.992660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec2daf2c00e4a5da96640aa09f998c4', 'request_id': 'req-b89ba792-a7a6-49f1-ac06-c8c4080993fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:55.001224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec2daf2c00e4a5da96640aa09f998c4', 'request_id': 'req-b89ba792-a7a6-49f1-ac06-c8c4080993fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:55.036409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] The token cache is being invalidate because project 6ec2daf2c00e4a5da96640aa09f998c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:25:55.037593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:55.040089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b89ba792-a7a6-49f1-ac06-c8c4080993fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:55.043109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1606/3207] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:25:54 2022] DELETE /identity/v3/projects/6ec2daf2c00e4a5da96640aa09f998c4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:25:55.048004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.048495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.048577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.083642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:55.088271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:55.175073 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1602/3208] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:25:55.188487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.188487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.188487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.247970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:55.250794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:55.286271 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1607/3209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:55.287537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.301274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cd3c4-1897-4b87-a4ec-f246aae82f2d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.316417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.317357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.317750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.318125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.318894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:25:55.326035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.328240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:55.343109 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1603/3210] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:25:55.347157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.357928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41b86-37fc-485b-a8de-ce35dae53c75 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.363185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.363825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.364061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.364322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.365013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.366958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:55.523734 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1608/3211] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:25:55 2022] POST /identity/v3/projects => generated 397 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:25:55.524397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.534840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333539cc-1be8-46ca-b4b0-770e0156d960 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.557691 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:55.663984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.664609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.664890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.665165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.665836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.681699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:55.788943 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1604/3212] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:25:55 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:25:55.790381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.811833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe903262-ea5b-4784-b688-f2a526e601dd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.823531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.827041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.827533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.828733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.830468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.833264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:55.861722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1609/3213] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:55.865911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.882092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c609d52-b409-46ab-b28b-c82b90a8f25d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.895444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.895962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.896245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.896987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.897672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.901603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769806b-1110-4110-bbe4-4802abb94e45 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:55.922027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:55.925607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1605/3214] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:25:55.936369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940b365-7a96-4233-b390-0210026ed41a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:55.941588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:55.942261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:55.942536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:55.942801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] PATH_INFO: `/v3/projects/2be9adf4469d4a5ba1206e22c7be136c/users/3e404a63b0294c66b288745079aaeaeb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:55.960140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be9adf4469d4a5ba1206e22c7be136c, user_id=3e404a63b0294c66b288745079aaeaeb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:55.963604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:56.102395 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1610/3215] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:25:55 2022] PUT /identity/v3/projects/2be9adf4469d4a5ba1206e22c7be136c/users/3e404a63b0294c66b288745079aaeaeb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:56.114237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410962f-f8ed-411b-98b7-9794c53720b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:56.114778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410962f-f8ed-411b-98b7-9794c53720b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:56.114778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410962f-f8ed-411b-98b7-9794c53720b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:56.162599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3410962f-f8ed-411b-98b7-9794c53720b9 None None] MFA Rules not processed for user `3e404a63b0294c66b288745079aaeaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:56.163817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3410962f-f8ed-411b-98b7-9794c53720b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:56.364282 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1606/3216] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:57.035993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:57.039581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:57.241935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5392fa-542c-4e47-a870-41efbcfda527 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:57.255200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:57.256203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:57.257019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:57.257552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:57.279887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:57.282228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8ce38-7e07-4295-b811-228d2d72046b service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:57.297744 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1611/3217] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:25:57.485008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:57.486449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:57.486943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:57.555410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] MFA Rules not processed for user `3e404a63b0294c66b288745079aaeaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:57.557437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:57.574315 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1607/3218] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:58.340153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:58.340720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:58.340720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:58.376917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:58.378354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:58.393767 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:58.463673 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1612/3219] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:58.482899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:58.485242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:58.593974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cb600-b622-4cb9-9ae8-c4092b9ad360 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:58.601808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:58.602668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:58.603097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:58.603574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:58.614952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:58.617472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4017c-b4ff-4c35-9de4-2eb54b9b251e service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:58.638250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1608/3220] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:25:58.717703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:58.854404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb892-c718-4ea5-8d5e-04491b2a7fce None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:58.877129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:58.878207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:58.878789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:58.879930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] PATH_INFO: `/v3/users/3e404a63b0294c66b288745079aaeaeb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:58.882699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e404a63b0294c66b288745079aaeaeb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:58.885827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:59.189127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e404a63b0294c66b288745079aaeaeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:59.269056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e404a63b0294c66b288745079aaeaeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:59.271186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e404a63b0294c66b288745079aaeaeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:59.292442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e404a63b0294c66b288745079aaeaeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:59.316905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e404a63b0294c66b288745079aaeaeb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:25:59.338541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1613/3221] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:25:58 2022] DELETE /identity/v3/users/3e404a63b0294c66b288745079aaeaeb => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:25:59.340313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:59.340597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:59.341514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:59.382481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:25:59.383759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:59.389127 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:59.560479 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1609/3222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:25:59.715212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:25:59.716839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:25:59.830672 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:25:59.888668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6560d2-9c73-4620-add3-db7b8eed02a9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:25:59.896804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:25:59.897839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:25:59.899130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:25:59.899585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:25:59.918146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:25:59.920828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:25:59.956609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1614/3223] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:02.309839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:02.311283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:02.332425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a3e3-bd6c-4424-9d46-86ad73bbd95e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:02.344221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:02.344887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:02.345167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:02.345470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] PATH_INFO: `/v3/users/0dc60a96037f438ebbaaa6d25661bfc5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:02.347998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc60a96037f438ebbaaa6d25661bfc5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:02.350107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:02.637312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc60a96037f438ebbaaa6d25661bfc5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:02.639352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc60a96037f438ebbaaa6d25661bfc5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:02.649957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc60a96037f438ebbaaa6d25661bfc5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:02.650764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc60a96037f438ebbaaa6d25661bfc5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:02.677314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:02.678914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:02.714310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278fad6-d410-48e0-9f00-bc3ac8eb49b3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:02.729838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:02.730496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:02.730778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:02.731056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] PATH_INFO: `/v3/projects/2be9adf4469d4a5ba1206e22c7be136c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:02.732674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb4e819-bdaa-4306-8db3-40f10059b5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc60a96037f438ebbaaa6d25661bfc5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:02.742248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be9adf4469d4a5ba1206e22c7be136c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:02.744897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:02.819560 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1610/3224] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:02 2022] DELETE /identity/v3/users/0dc60a96037f438ebbaaa6d25661bfc5 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:02.939323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be9adf4469d4a5ba1206e22c7be136c', 'request_id': 'req-d962cb9f-84b1-44a5-8e79-6b1468a6c103'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.201052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be9adf4469d4a5ba1206e22c7be136c', 'request_id': 'req-d962cb9f-84b1-44a5-8e79-6b1468a6c103'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.241096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be9adf4469d4a5ba1206e22c7be136c', 'request_id': 'req-d962cb9f-84b1-44a5-8e79-6b1468a6c103'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.247704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] The token cache is being invalidate because project 2be9adf4469d4a5ba1206e22c7be136c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:03.250116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.270348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d962cb9f-84b1-44a5-8e79-6b1468a6c103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.282437 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1615/3225] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:02 2022] DELETE /identity/v3/projects/2be9adf4469d4a5ba1206e22c7be136c => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:26:03.289246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:03.289585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:03.289833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:03.327761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:03.328945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:03.477396 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1611/3226] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:03.486253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:03.486798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:03.487149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:03.527575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:03.532905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:03.561432 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1616/3227] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:03.566319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:03.581057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483208-abb6-4912-8c57-835013f169f4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:03.589249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:03.589962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:03.590255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:03.590532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:03.591735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:03.592777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:03.594045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:03.615568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:03.617009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:03.650094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec28e6-150b-4f19-8589-6654998812c5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:03.650550 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1612/3228] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:03.658197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:03.659634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:03.660328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:03.660610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:03.661039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] PATH_INFO: `/v3/projects/127b4f4e1e4b43ed856faee3c5d9d88d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:03.662331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=127b4f4e1e4b43ed856faee3c5d9d88d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:03.667175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:03.685402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfade0-b457-49fc-92e1-436fbac82267 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:03.697976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:03.699110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:03.699797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:03.700105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:03.700837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:03.703045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:03.718358 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:03.835621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127b4f4e1e4b43ed856faee3c5d9d88d', 'request_id': 'req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.901266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1613/3229] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:03 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:03.902820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:03.980553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127b4f4e1e4b43ed856faee3c5d9d88d', 'request_id': 'req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:03.997134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127b4f4e1e4b43ed856faee3c5d9d88d', 'request_id': 'req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:04.080503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] The token cache is being invalidate because project 127b4f4e1e4b43ed856faee3c5d9d88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:04.081231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:04.082651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2af16fd2-10b0-42ac-93ee-986f2bd2d54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:04.083402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80ef47-b395-48ea-8fd8-528fa52d14d4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.094482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1617/3230] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:03 2022] DELETE /identity/v3/projects/127b4f4e1e4b43ed856faee3c5d9d88d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:26:04.096851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.097738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba62e1-a47a-469f-b56c-de89f40da321 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.105679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.105947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba62e1-a47a-469f-b56c-de89f40da321 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.105947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba62e1-a47a-469f-b56c-de89f40da321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.106121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.106121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.106121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.106121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.149804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-52ba62e1-a47a-469f-b56c-de89f40da321 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:04.151305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-52ba62e1-a47a-469f-b56c-de89f40da321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:04.197611 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1618/3231] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:04.199368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.199795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.200929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.222722 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1614/3232] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:03 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:04.231506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.233060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:04.241125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:04.243007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:04.251555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf56d-b2cd-4d51-8bd4-3cf14b3040d0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.256769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.263939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1619/3233] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:04.264092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.264092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.264092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.264092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.264092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.267185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.276979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1615/3234] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:26:04.277186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193ff56-b9cb-418d-a055-d9f5245290fc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.278077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.284597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.285715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.291579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf8da-fa37-4aec-9910-d834f9013eb4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.293996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.294553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.295517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:04.295974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.298019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.298159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.298781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.299166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.299445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.300146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.304057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.324998 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1620/3235] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:26:04.330226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.331745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1616/3236] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:04.335244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.349455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba643d-dbc3-4722-b26d-cdc72269dc13 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.361789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60255f-9a4d-4fdb-b79d-744ff22b36da admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.363059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.363808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.364154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.364489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] PATH_INFO: `/v3/projects/51b75ee1fcc142dd9eb8cb4e3ea631b8/users/55d02fb5fddb48e49fb66428db0f0424/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.390667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.390667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.390667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.390667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.391175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.393371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec2ec8-c639-4959-a3ee-b6b03d4ab055 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.406189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b75ee1fcc142dd9eb8cb4e3ea631b8, user_id=55d02fb5fddb48e49fb66428db0f0424, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.409684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.520078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1617/3237] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:04 2022] PUT /identity/v3/projects/51b75ee1fcc142dd9eb8cb4e3ea631b8/users/55d02fb5fddb48e49fb66428db0f0424/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:04.521138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.533117 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:04.540627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1621/3238] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:26:04.545874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.545874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.545874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.546260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:04.584614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:04.586006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:04.644765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3dce-e7ee-4cab-aba4-4b5d25b9cab0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.736654 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1622/3239] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:04.740504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.747548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.749089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.749089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.749089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] PATH_INFO: `/v3/users/33691c943ec040ddb04b6648b6e945ab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.750373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=33691c943ec040ddb04b6648b6e945ab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.752544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.776134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18443c80-cd85-477b-aacd-878b13e0142f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:04.801314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:04.801314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:04.801314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:04.801314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:04.801770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:04.801770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:04.943649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1623/3240] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:04 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:04.952450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:04.954038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.001705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33691c943ec040ddb04b6648b6e945ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:05.002765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33691c943ec040ddb04b6648b6e945ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:05.018105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33691c943ec040ddb04b6648b6e945ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:05.019086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33691c943ec040ddb04b6648b6e945ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:05.057122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3659-62c9-4ac1-89c8-0e544ebcb6f1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.062006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.062729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.063072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.063428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.065349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.080666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.082275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.090377 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:05.093032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33691c943ec040ddb04b6648b6e945ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:05.097612 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1624/3241] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:05.098739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.101917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.116901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8531-6ff7-4b4a-ba8b-4d9d10e731b4 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.137496 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1618/3242] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:04 2022] DELETE /identity/v3/users/33691c943ec040ddb04b6648b6e945ab => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:05.142232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.143647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.144100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.145201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.147478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.151564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.187465 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1625/3243] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:05.192433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.354267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8790-d580-4f0b-9ee1-38d7c2686fad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.365912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.377599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.377599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.377599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.377599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.377599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c98e55-e6b3-4e4d-9946-85babbd19bac admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.397544 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1619/3244] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:05.407682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.420341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe1178-0587-4ec5-88d1-227ffed6ac36 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.437237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.437937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.438356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.438636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] PATH_INFO: `/v3/projects/bbd28b9d6b7146f2b1c114607be83a48/users/927f79f3eab648939a30208fed465eef/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.470458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd28b9d6b7146f2b1c114607be83a48, user_id=927f79f3eab648939a30208fed465eef, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.473417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.573964 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1626/3245] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:05 2022] PUT /identity/v3/projects/bbd28b9d6b7146f2b1c114607be83a48/users/927f79f3eab648939a30208fed465eef/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:05.579117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.579408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.579714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.616062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:05.616062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.743464 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1620/3246] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:05.750092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.754412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.807877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.812258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:05.856235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4f35-3220-4032-b71a-e3e9029bdd17 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.868700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.879276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.882159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.882159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] PATH_INFO: `/v3/projects/8c95e97cd7e4461682b9028abb568dce` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.893312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c95e97cd7e4461682b9028abb568dce)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.895651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.950321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2194a0-b1de-41e3-9c73-0052fe1d1b05 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:05.963261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:05.964050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:05.964412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:05.964927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:05.979000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:05.980545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:05.994391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1627/3247] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:26:05.995332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:05.996977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.010882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272f22e-0adc-4bac-b382-4f3386fc26b6 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:06.015868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:06.016757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.017033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.017514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] PATH_INFO: `/v3/users/94448bbc2f4a4efaa86792f1511ff15c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.018669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=94448bbc2f4a4efaa86792f1511ff15c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:06.020781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:06.105702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c95e97cd7e4461682b9028abb568dce', 'request_id': 'req-faecbf35-8841-4efc-89a8-0ff4364aef91'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.114573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c95e97cd7e4461682b9028abb568dce', 'request_id': 'req-faecbf35-8841-4efc-89a8-0ff4364aef91'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.218124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c95e97cd7e4461682b9028abb568dce', 'request_id': 'req-faecbf35-8841-4efc-89a8-0ff4364aef91'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.229882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] The token cache is being invalidate because project 8c95e97cd7e4461682b9028abb568dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:06.230168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.230806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.232493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1621/3248] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:05 2022] DELETE /identity/v3/projects/8c95e97cd7e4461682b9028abb568dce => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:06.233170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:06.234474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.264400 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:06.283456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94448bbc2f4a4efaa86792f1511ff15c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.311778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecbf35-8841-4efc-89a8-0ff4364aef91 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:06.316629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:06.317252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.317585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.317860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] PATH_INFO: `/v3/users/2ba44010e0ca4892b56886e2b1636f01` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.319072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba44010e0ca4892b56886e2b1636f01)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:06.320944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:06.353016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94448bbc2f4a4efaa86792f1511ff15c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.353741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94448bbc2f4a4efaa86792f1511ff15c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.369269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94448bbc2f4a4efaa86792f1511ff15c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.377171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-21effe0d-bd21-4c47-99ce-43d1657200fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94448bbc2f4a4efaa86792f1511ff15c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.390603 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1628/3249] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:05 2022] DELETE /identity/v3/users/94448bbc2f4a4efaa86792f1511ff15c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:06.390904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f65d1-3b20-45f8-a976-d17653d6af1d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.391823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f65d1-3b20-45f8-a976-d17653d6af1d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.391823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f65d1-3b20-45f8-a976-d17653d6af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.432840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-346f65d1-3b20-45f8-a976-d17653d6af1d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:06.434191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-346f65d1-3b20-45f8-a976-d17653d6af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.527262 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:06.544469 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1629/3250] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:06.545804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.546237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.547133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.573109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:06.574383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.593766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba44010e0ca4892b56886e2b1636f01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.594553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba44010e0ca4892b56886e2b1636f01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.603381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba44010e0ca4892b56886e2b1636f01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.604214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba44010e0ca4892b56886e2b1636f01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.658468 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1630/3251] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:06.659839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:06.662425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.706817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-53b1e7a7-781d-4d67-9b6f-66486fb93deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba44010e0ca4892b56886e2b1636f01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:06.744064 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1622/3252] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:06 2022] DELETE /identity/v3/users/2ba44010e0ca4892b56886e2b1636f01 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:06.751060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.752343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.752800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.780371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:06.782478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.795661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeb0bf-832e-460c-8416-1b715b764cab None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:06.904481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1623/3253] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:06.904481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:06.904481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:06.925445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739983-ad9c-4f17-8f3c-1f42eae14164 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:06.956298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:06.961657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.962185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.962633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] PATH_INFO: `/v3/projects/d342baf2538340e292e44dfc622b86fc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.964202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d342baf2538340e292e44dfc622b86fc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:06.966604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:06.968602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:06.968740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:06.968740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:06.968740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:06.976093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:07.082228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.084275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:07.098851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1631/3254] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:26:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:07.099736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:07.131468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1fc94-60ce-4b34-93b1-190066198c41 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:07.135345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd342baf2538340e292e44dfc622b86fc', 'request_id': 'req-3782665c-f79a-4d15-9821-5d75c2c11b51'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.143687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd342baf2538340e292e44dfc622b86fc', 'request_id': 'req-3782665c-f79a-4d15-9821-5d75c2c11b51'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.232816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:07.234874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:07.235492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:07.235969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:07.237212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:07.237839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.240203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:07.257390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1632/3255] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:07.258333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:07.260697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:07.284501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bdfad-b696-4238-8470-434cda6e092e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:07.289718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:07.290357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:07.290633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:07.290914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] PATH_INFO: `/v3/projects/13238008c06e49c3b088809143308a00` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:07.292208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13238008c06e49c3b088809143308a00)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.295098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:07.304229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd342baf2538340e292e44dfc622b86fc', 'request_id': 'req-3782665c-f79a-4d15-9821-5d75c2c11b51'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.323590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] The token cache is being invalidate because project d342baf2538340e292e44dfc622b86fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:07.323891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.325123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.330783 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1624/3256] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:06 2022] DELETE /identity/v3/projects/d342baf2538340e292e44dfc622b86fc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:07.332564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:07.337096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:07.375519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782665c-f79a-4d15-9821-5d75c2c11b51 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:07.395173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:07.397409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:07.398355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:07.398861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:07.401145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.403754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:07.504501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13238008c06e49c3b088809143308a00', 'request_id': 'req-3a594c08-754b-45d1-acb9-396fa156104c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.570170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1625/3257] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:07 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:07.571925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:07.574285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:07.589673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13238008c06e49c3b088809143308a00', 'request_id': 'req-3a594c08-754b-45d1-acb9-396fa156104c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.602140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13238008c06e49c3b088809143308a00', 'request_id': 'req-3a594c08-754b-45d1-acb9-396fa156104c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.642282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] The token cache is being invalidate because project 13238008c06e49c3b088809143308a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:07.642561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.643504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:07.645777 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1633/3258] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:07 2022] DELETE /identity/v3/projects/13238008c06e49c3b088809143308a00 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:07.646540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:07.648068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:07.745772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b85b23-ee4e-4e28-ab9d-172b13f0f069 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:07.779045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:07.780072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:07.783309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:07.783779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] PATH_INFO: `/v3/users/778b68f8ac754d7689c6686f015deaa6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:07.789368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778b68f8ac754d7689c6686f015deaa6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.796447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:07.875949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a594c08-754b-45d1-acb9-396fa156104c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:07.890791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:07.891498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:07.891669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:07.891998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:07.892572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:07.894706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82015f-4756-4dd0-9407-6278ac771062 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.048985 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1634/3259] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:07 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:08.048985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.053514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.053514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.089130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:08.095867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:08.099308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778b68f8ac754d7689c6686f015deaa6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:08.100167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778b68f8ac754d7689c6686f015deaa6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:08.118364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778b68f8ac754d7689c6686f015deaa6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:08.119152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778b68f8ac754d7689c6686f015deaa6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:08.125860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1635/3260] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:08.125860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.139449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf318-2391-48ab-9148-e1f93868f88b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:08.148248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:08.148994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.149434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.149810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.150583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:08.152395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edf737-a73b-402c-854e-304c8035bb84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.164841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1636/3261] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:08.168382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.168382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.168382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.194760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:08.196987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:08.212522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1637/3262] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:08.213609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.215509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778b68f8ac754d7689c6686f015deaa6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:08.216743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:08.248760 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:08.268688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d42d4-f27c-420b-a166-25af2cab1af9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:08.276246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1626/3263] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:07 2022] DELETE /identity/v3/users/778b68f8ac754d7689c6686f015deaa6 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:08.283172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.286966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:08.287722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.287861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.288128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.289064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:08.291172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.322603 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1638/3264] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:08.324043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.354310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242cfc5-a65e-4ef4-bc79-ba41ae96d1cd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:08.447517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb3284-650d-4c26-8cb1-3d937f6bd2d2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:08.464717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:08.465363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.465658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.468596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.469879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:08.470178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:08.471819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.500594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1627/3265] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:08.502243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.511211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:08.511886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.512164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.513086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] PATH_INFO: `/v3/projects/7a746ec83df44fe4bc49cf74dcf246c1/users/b0ecc29bc51140d7923506918965ef64/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.521265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f8b6b-2aa7-462d-8e1d-40ebcc768486 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:08.536217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:08.536840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.537124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.537438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.538081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:08.540608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11021a7d-14d7-46de-8129-04ecbb1dd863 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.542246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a746ec83df44fe4bc49cf74dcf246c1, user_id=b0ecc29bc51140d7923506918965ef64, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:08.559942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:08.694727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1639/3266] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:08 2022] PUT /identity/v3/projects/7a746ec83df44fe4bc49cf74dcf246c1/users/b0ecc29bc51140d7923506918965ef64/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:08.697847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:08.706849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1628/3267] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:08 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:08.707562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:08.709076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:08.710307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:08.710593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:08.799831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] MFA Rules not processed for user `b0ecc29bc51140d7923506918965ef64`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:08.801096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:08.858811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc958-6e20-4674-b43f-2313ffae4973 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.015755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1629/3268] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:09.017299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.036220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.036884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.037161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.037538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] PATH_INFO: `/v3/projects/b2cbf0a7e18f4306a93e578827220bd3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.038714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cbf0a7e18f4306a93e578827220bd3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.040669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.060907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cbcd0-e604-4ee4-b708-e3163025a021 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.084213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.085002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.087151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.087501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.089272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.093477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee11cf-7289-4811-b2f1-3adc1da0b937 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.241148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1630/3269] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:09.242306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630e80b-2451-443f-8bb2-bfd3f864f84d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.242595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630e80b-2451-443f-8bb2-bfd3f864f84d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.242863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630e80b-2451-443f-8bb2-bfd3f864f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.275910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cbf0a7e18f4306a93e578827220bd3', 'request_id': 'req-df6cd2a3-5e20-421a-92f6-809e206cfa05'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:09.287151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8630e80b-2451-443f-8bb2-bfd3f864f84d None None] MFA Rules not processed for user `b0ecc29bc51140d7923506918965ef64`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:09.288387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8630e80b-2451-443f-8bb2-bfd3f864f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.346712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cbf0a7e18f4306a93e578827220bd3', 'request_id': 'req-df6cd2a3-5e20-421a-92f6-809e206cfa05'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:09.359902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cbf0a7e18f4306a93e578827220bd3', 'request_id': 'req-df6cd2a3-5e20-421a-92f6-809e206cfa05'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:09.394431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] The token cache is being invalidate because project b2cbf0a7e18f4306a93e578827220bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:09.394724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:09.396598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:09.402467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1640/3270] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:08 2022] DELETE /identity/v3/projects/b2cbf0a7e18f4306a93e578827220bd3 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:09.406617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.413822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.468917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1631/3271] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:09.474641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.481282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.481691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.534238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:09.535545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.555481 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:09.586020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cd2a3-5e20-421a-92f6-809e206cfa05 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.596914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.597574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.597861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.598136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.598810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.600452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.628342 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1641/3272] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:09.629323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.631184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.672741 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1632/3273] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:09.681857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.704337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9374-013f-464f-bc1a-b9be55e919af None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.721963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.722795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.723184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.723628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.724553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.728575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b7bbc-b3f5-4ae9-bfb0-1922c41a07e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.760485 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1633/3274] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:09.762308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.762750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.764915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.799670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:09.801123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.804989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eb41e-9d34-469d-8ada-cb4d6dc7f8e1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.813935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1634/3275] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:09.815258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.819915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.821085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.825710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.826286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.829884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:09.830659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6351d-7bff-4181-b3aa-f9e9cf17ea91 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.839402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.840263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.840649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.841646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] PATH_INFO: `/v3/projects/98c4b4fec5574b8abd29e56df1fdc822/users/fb8201c608b3417dafc84e520603d1c0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.855780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.861241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c4b4fec5574b8abd29e56df1fdc822, user_id=fb8201c608b3417dafc84e520603d1c0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.861788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.866166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce21c-9855-4d00-87df-9f8180dedeec admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.902712 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1642/3276] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:09.904390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.917531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7bcd-c37b-432b-a879-fb21471be6f2 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:09.923369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:09.925246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.925246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.925246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.926049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:09.926530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:09.928631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:09.946054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1643/3277] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:09.953092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:09.964788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1635/3278] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:09 2022] PUT /identity/v3/projects/98c4b4fec5574b8abd29e56df1fdc822/users/fb8201c608b3417dafc84e520603d1c0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:09.966878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8b7f-5baa-489f-8380-8c68fa49de2e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:09.967374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8b7f-5baa-489f-8380-8c68fa49de2e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:09.967747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb8b7f-5baa-489f-8380-8c68fa49de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:09.988138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d08d2a-cbb2-47de-afc1-000ee3f3a7eb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.068377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bddb8b7f-5baa-489f-8380-8c68fa49de2e None None] MFA Rules not processed for user `fb8201c608b3417dafc84e520603d1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:10.070749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bddb8b7f-5baa-489f-8380-8c68fa49de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:10.087068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.087848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.088208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.088763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.089430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.093008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:10.221672 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1644/3279] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:10.221672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:10.269039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1636/3280] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:10.281090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.281496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.281825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.329621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] MFA Rules not processed for user `fb8201c608b3417dafc84e520603d1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:10.346091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:10.396868 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:10.410620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e8b1-aa10-4d01-a8aa-451a86c48b71 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.430819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.431608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.432454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.434256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.436407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.441517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:10.588796 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1637/3281] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:26:10.599132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:10.601224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:10.642771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1645/3282] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:10 2022] POST /identity/v3/users => generated 285 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:10.646826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:10.665913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ec8c-fc5c-46b2-beba-067b0ec32d58 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.677011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.678726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.679523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.680027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.681536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.704053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:10.743312 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1646/3283] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:10.748804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:10.776977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c850391-955e-4923-9196-876729fc82d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.785290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed47ab-c07a-492e-a8b2-4232c004bd6d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.797812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.797812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.798185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.799769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.802699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.803529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.804565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.805024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.805471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.808228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:10.826598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.828949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078b433-fcdb-43f5-a87f-1750d06fb861 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:10.840036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1647/3284] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:10.843552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:10.869013 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1638/3285] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:26:10.919333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06b6b4-1746-4e07-af23-6c55ade968d2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:10.939692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:10.942841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:10.944662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:10.947053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] PATH_INFO: `/v3/projects/93f92c2329e1419ab263d2c3e2fde4df/users/cb9492d9d25e4bf7b697448e0ee66ee0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:10.995532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f92c2329e1419ab263d2c3e2fde4df, user_id=cb9492d9d25e4bf7b697448e0ee66ee0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:10.998658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:11.050092 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:11.086265 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1648/3286] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:10 2022] PUT /identity/v3/projects/93f92c2329e1419ab263d2c3e2fde4df/users/cb9492d9d25e4bf7b697448e0ee66ee0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:11.097741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb497-8bac-4d9d-8a41-6ec3575557c6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:11.099919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb497-8bac-4d9d-8a41-6ec3575557c6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:11.100294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cb497-8bac-4d9d-8a41-6ec3575557c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:11.143894 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:11.199894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d1cb497-8bac-4d9d-8a41-6ec3575557c6 None None] MFA Rules not processed for user `cb9492d9d25e4bf7b697448e0ee66ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:11.202662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d1cb497-8bac-4d9d-8a41-6ec3575557c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:11.337727 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1639/3287] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:11.349157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:11.518478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759852d-cc55-44bc-9064-2eff6a8062e3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:11.530765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:11.530765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:11.531699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:11.531923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:11.575232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:11.577522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c6e7a-7f93-48a7-9853-339e6f1b4f94 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:11.655643 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1649/3288] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:12.151566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:12.152034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:12.152170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:12.175770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] MFA Rules not processed for user `fb8201c608b3417dafc84e520603d1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:12.182269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:12.324404 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1640/3289] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:13.070462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c7f2-3501-4bfd-a072-6bccd7405cce None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:13.071012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c7f2-3501-4bfd-a072-6bccd7405cce None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:13.071012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683c7f2-3501-4bfd-a072-6bccd7405cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:13.126292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2683c7f2-3501-4bfd-a072-6bccd7405cce None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:13.138975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2683c7f2-3501-4bfd-a072-6bccd7405cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:13.468668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1650/3290] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:26:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:13.480919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:13.488805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:13.641061 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:13.723401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4af412-95d6-4199-8d54-972ace732dea None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:13.735367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:13.737773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:13.738142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:13.738553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:13.760449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:13.780285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fee61e-d955-4076-9170-f458a20f257f service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:13.798885 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:13.811007 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1641/3291] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:15.009281 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:15.082233 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:16.060754 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:16.144227 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:17.800557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:17.801109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:17.801109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:17.866553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] MFA Rules not processed for user `a07f2b8c31f54c62aaba73ca2bd2edb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:17.867812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:18.010108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1651/3292] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:22.173542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:22.174019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:22.174102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:22.255230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] MFA Rules not processed for user `55d02fb5fddb48e49fb66428db0f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:22.261589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:22.526470 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:22.550395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1642/3293] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:22.551557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:22.553306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:22.809257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98edeba-5dac-48c4-b191-fe4534edfe29 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:22.834106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:22.834813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:22.835146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:22.835416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:22.836683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:22.839682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a49ec3-cee8-4c3e-af9e-177715762c7c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:23.001714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1652/3294] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:22 2022] POST /identity/v3/projects => generated 377 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:23.004936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:23.024336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15a2e7-4fb4-40c6-a665-9102c539a28c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:23.055017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1b01-06db-4396-884d-ff70cd8df8f0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:23.055481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1b01-06db-4396-884d-ff70cd8df8f0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:23.055761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b1b01-06db-4396-884d-ff70cd8df8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:23.117146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-616b1b01-06db-4396-884d-ff70cd8df8f0 None None] MFA Rules not processed for user `927f79f3eab648939a30208fed465eef`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:23.123662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-616b1b01-06db-4396-884d-ff70cd8df8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:23.198916 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:23.219253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:23.219887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:23.220181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:23.220456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:23.229412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:23.231624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:23.305054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1653/3295] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:26:23.314970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:23.316057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:23.316639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:23.347981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] MFA Rules not processed for user `927f79f3eab648939a30208fed465eef`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:23.349756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:23.372492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1654/3296] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:23.590688 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1643/3297] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:23 2022] POST /identity/v3/users => generated 295 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:23.595787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:23.622984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf723-9a47-4fc2-91bb-6003a4cf61c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:23.640540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:23.641269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:23.641742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:23.642078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:23.643002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:23.645027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:23.669511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1655/3298] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:23.672177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:23.698218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68e9da-1faf-4025-8634-4fde2be70b4f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:23.710294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:23.711250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:23.717660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:23.717660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] PATH_INFO: `/v3/projects/2bf19d32ead440ba86472a2107547ea8/users/89216c262a8e46b4a1cb8b29dfedcfd3/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:23.762941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf19d32ead440ba86472a2107547ea8, user_id=89216c262a8e46b4a1cb8b29dfedcfd3, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:23.765935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:23.869368 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1644/3299] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:23 2022] PUT /identity/v3/projects/2bf19d32ead440ba86472a2107547ea8/users/89216c262a8e46b4a1cb8b29dfedcfd3/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:23.875437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:23.890147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ecef4-d2f2-48db-ba2a-a07d4a5d8780 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:24.020548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:24.022494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:24.023881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:24.024348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:24.029654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:24.030225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:24.059969 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1656/3300] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:24.061229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:24.076530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355ee6-34c4-44f6-be22-0cfbf33f063b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:24.087104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:24.087940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:24.088315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:24.088687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] PATH_INFO: `/v3/projects/2bf19d32ead440ba86472a2107547ea8/users/89216c262a8e46b4a1cb8b29dfedcfd3/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:24.092256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf19d32ead440ba86472a2107547ea8, user_id=89216c262a8e46b4a1cb8b29dfedcfd3, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:24.101052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:24.134690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1645/3301] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:24 2022] PUT /identity/v3/projects/2bf19d32ead440ba86472a2107547ea8/users/89216c262a8e46b4a1cb8b29dfedcfd3/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:31.589718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:31.592021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:31.870550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a69d-4b95-49b0-b442-b2dce9a1da40 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:32.102989 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:32.135176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:32.175295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:32.176134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:32.176556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:32.176956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:32.181861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:32.235980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:32.241402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b0496-fc16-4103-b3a4-1a0c16f75363 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:32.277767 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1657/3302] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:32.362692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168c127-6296-4f46-85aa-d2095a954712 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:32.370228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:32.370887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:32.371164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:32.371435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:32.507396 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:32.547785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:32.550166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:32.573839 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1646/3303] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:35.954687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c901a0-84e6-4cd5-a874-55c92ed022a4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:35.955270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c901a0-84e6-4cd5-a874-55c92ed022a4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:35.955270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c901a0-84e6-4cd5-a874-55c92ed022a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:36.010709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e1c901a0-84e6-4cd5-a874-55c92ed022a4 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:36.011931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1c901a0-84e6-4cd5-a874-55c92ed022a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:36.151958 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1658/3304] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:26:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:36.173191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:36.351108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e31a-3c99-46e2-acd2-40e1c458fed7 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:36.369521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:36.373055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:36.373055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:36.373055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:36.381217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:36.383295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:36.396853 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1647/3305] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:36.851234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231c08-6930-4682-8008-db9e07673aa6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:36.851520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231c08-6930-4682-8008-db9e07673aa6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:36.852145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231c08-6930-4682-8008-db9e07673aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:36.956738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-71231c08-6930-4682-8008-db9e07673aa6 None None] MFA Rules not processed for user `89216c262a8e46b4a1cb8b29dfedcfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:36.958745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-71231c08-6930-4682-8008-db9e07673aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:37.080356 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1659/3306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:37.094046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:37.095463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:37.176696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b6106-fa5d-4bf4-a653-e71bfd62176d service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:37.182671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:37.183386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:37.184473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:37.184897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:37.260691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:37.262232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:37.273126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1648/3307] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:37.426133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:37.426358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:37.426623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:37.448589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:37.449842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:37.458991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1660/3308] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:37.482543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:37.495300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a403057-486a-48ca-a939-367aa2e2a954 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:37.500713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:37.501542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:37.501999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:37.502275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:37.510639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:37.512316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d761d57-5fc2-4cd9-a3c4-1a2f15e86e10 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:37.520439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1649/3309] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:26:39.363241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:39.429198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0583-0d27-43dc-bc79-fd9a1aecfefd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:39.430952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0583-0d27-43dc-bc79-fd9a1aecfefd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:39.431420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f0583-0d27-43dc-bc79-fd9a1aecfefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:39.475847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c15325-c3ba-4de6-9465-47c39c974bcf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:39.484672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:39.486280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:39.486731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:39.487160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] PATH_INFO: `/v3/users/cb9492d9d25e4bf7b697448e0ee66ee0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:39.488957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9492d9d25e4bf7b697448e0ee66ee0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:39.491354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:39.502140 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:39.518235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-953f0583-0d27-43dc-bc79-fd9a1aecfefd None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:39.519545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-953f0583-0d27-43dc-bc79-fd9a1aecfefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:39.550953 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:39.625285 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1650/3310] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:26:39.735363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9492d9d25e4bf7b697448e0ee66ee0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:39.840590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9492d9d25e4bf7b697448e0ee66ee0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:39.840916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9492d9d25e4bf7b697448e0ee66ee0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:39.874691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9492d9d25e4bf7b697448e0ee66ee0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:39.903304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9492d9d25e4bf7b697448e0ee66ee0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:39.916598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1661/3311] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:39 2022] DELETE /identity/v3/users/cb9492d9d25e4bf7b697448e0ee66ee0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:39.923124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:39.924110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:39.924625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:39.961511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:39.974570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:40.058292 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1651/3312] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:40.070740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:40.072692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:40.265361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ddcd3-be75-4029-8887-6d70229772dc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:40.271466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:40.271466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:40.271466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:40.271466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:40.304936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:40.314433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff566c7-6302-4660-8101-d9417559027f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:40.337491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1662/3313] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:40.945315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:40.947336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:40.980111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82c3a-1860-438c-a306-cec0fc55fe36 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:41.001856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:41.001856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:41.001856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:41.001856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] PATH_INFO: `/v3/users/b0ecc29bc51140d7923506918965ef64` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:41.003982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ecc29bc51140d7923506918965ef64)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:41.006181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:41.238295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ecc29bc51140d7923506918965ef64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.239235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ecc29bc51140d7923506918965ef64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.265202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ecc29bc51140d7923506918965ef64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.266402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ecc29bc51140d7923506918965ef64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.353827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ecc29bc51140d7923506918965ef64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.391432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1652/3314] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:40 2022] DELETE /identity/v3/users/b0ecc29bc51140d7923506918965ef64 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:41.395758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:41.396270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:41.396373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:41.425850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:41.428950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:41.561009 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1663/3315] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:41.562960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:41.565720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:41.598353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:41.600130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:41.615430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ba06-c04e-4b40-90ef-b955ffc77259 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:41.628842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:41.629636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:41.630550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:41.631206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] PATH_INFO: `/v3/projects/93f92c2329e1419ab263d2c3e2fde4df` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:41.633298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f92c2329e1419ab263d2c3e2fde4df)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:41.636830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:41.713526 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:41.798647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7aebd-d36b-4694-b0dc-6e30d9a2dc09 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:41.798647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:41.798647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:41.798647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:41.800582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:41.814463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:41.818886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c081082-ec0d-42b5-8520-08e652161e7e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:41.854346 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:41.897542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1664/3316] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:26:41.923068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f92c2329e1419ab263d2c3e2fde4df', 'request_id': 'req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:41.947733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f92c2329e1419ab263d2c3e2fde4df', 'request_id': 'req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:42.072385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f92c2329e1419ab263d2c3e2fde4df', 'request_id': 'req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:42.119012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] The token cache is being invalidate because project 93f92c2329e1419ab263d2c3e2fde4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:42.119630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:42.121144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffe8f0e9-ccff-4c3c-b5ff-b11e53e8bdae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:42.123821 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1653/3317] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:41 2022] DELETE /identity/v3/projects/93f92c2329e1419ab263d2c3e2fde4df => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:42.128570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:42.128910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:42.129123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:42.176485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:42.177819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:42.377543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1665/3318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:42.382235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:42.382669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:42.384239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:42.470646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:42.475140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:42.502010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1654/3319] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:42.505877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:42.525264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26eb92-db56-496d-82f7-009f27d1f9fe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:42.532393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:42.534310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:42.535116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:42.535946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:42.536870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:42.537425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:42.540311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:42.560680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1666/3320] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:42.565041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:42.584789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8053b-f04b-4237-919c-e790db2189dc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:42.617424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:42.618298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:42.618584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:42.618884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:42.619723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:42.622178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:42.814649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1655/3321] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:42 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:42.817918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:42.849589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefb699-7fe6-411e-b75c-6a69cd25dcda admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:42.993233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862799-1779-4377-9485-f638088836ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:42.994056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862799-1779-4377-9485-f638088836ce admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:42.994333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862799-1779-4377-9485-f638088836ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:42.994606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab862799-1779-4377-9485-f638088836ce admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:42.995236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab862799-1779-4377-9485-f638088836ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:42.998241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab862799-1779-4377-9485-f638088836ce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:43.141529 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1667/3322] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:42 2022] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:43.145465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:43.164326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32c08-1a75-4930-8416-a4f6602cf0b9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:43.171772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:43.172843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:43.173280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:43.173878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:43.175169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:43.176991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:43.194815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1656/3323] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:26:43.198202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862799-1779-4377-9485-f638088836ce admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:43.213793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab862799-1779-4377-9485-f638088836ce admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:43.221294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:43.222197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:43.222658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:43.223085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:43.224694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:43.227535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ebe43-7939-4017-82d7-ac08dc4ed3ac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:43.245734 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1668/3324] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:43.251685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:43.277383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b46d5-23bc-4b06-91f4-26d20e299ef5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:43.286394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:43.287900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:43.288395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:43.289089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] PATH_INFO: `/v3/projects/a3f41f5c65be49aaa04853c29904bba6/users/948aaf46e1ac4c129dca02cd2dd903e0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:43.330459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f41f5c65be49aaa04853c29904bba6, user_id=948aaf46e1ac4c129dca02cd2dd903e0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:43.342852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:43.475788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1657/3325] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:43 2022] PUT /identity/v3/projects/a3f41f5c65be49aaa04853c29904bba6/users/948aaf46e1ac4c129dca02cd2dd903e0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:43.477582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:43.477784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:43.478057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:43.524064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:43.529373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:43.665130 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:43.738420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:43.743742 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1669/3326] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:43.744209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:43.774441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afabff-f48b-447e-8b2d-c6801a012153 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:43.781419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:43.782523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:43.783717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:43.784009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] PATH_INFO: `/v3/projects/7a746ec83df44fe4bc49cf74dcf246c1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:43.785428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a746ec83df44fe4bc49cf74dcf246c1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:43.787782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:43.801712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:43.803585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:43.962682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a746ec83df44fe4bc49cf74dcf246c1', 'request_id': 'req-943ff276-f37d-4152-bbf4-6c9e6493c28e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:43.988943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a746ec83df44fe4bc49cf74dcf246c1', 'request_id': 'req-943ff276-f37d-4152-bbf4-6c9e6493c28e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:44.051760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bfb85-46d4-46ee-bad5-09972dd7346e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:44.064628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a746ec83df44fe4bc49cf74dcf246c1', 'request_id': 'req-943ff276-f37d-4152-bbf4-6c9e6493c28e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:44.089308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] The token cache is being invalidate because project 7a746ec83df44fe4bc49cf74dcf246c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:44.089622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:44.105885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-943ff276-f37d-4152-bbf4-6c9e6493c28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:44.115110 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1658/3327] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:43 2022] DELETE /identity/v3/projects/7a746ec83df44fe4bc49cf74dcf246c1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:44.118678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1a6c-4694-4eb3-98d9-ae25eefa717d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.119462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1a6c-4694-4eb3-98d9-ae25eefa717d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.120321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e1a6c-4694-4eb3-98d9-ae25eefa717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.171355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-068e1a6c-4694-4eb3-98d9-ae25eefa717d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:44.173054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-068e1a6c-4694-4eb3-98d9-ae25eefa717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:44.235899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:44.236646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.236786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.237048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.240931 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:44.241635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:44.296562 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1659/3328] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:44.310283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.314145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.317151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.360436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:44.362390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:44.375001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1660/3329] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:44.389280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:44.425573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d2d5d-4555-4d9f-8489-97b403bc4840 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:44.433959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:44.435558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.436105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.436738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.437680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:44.440638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:44.441500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:44.446898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:44.449956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:44.467884 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1661/3330] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:44.469017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:44.476142 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1670/3331] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:26:44.481511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d7aa-5491-4916-bda8-0c7d09bc423a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:44.488040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:44.488429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.488781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.489112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.489813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:44.491877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:44.623965 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1662/3332] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:44 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:44.628098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:44.649781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b8ab0-da5c-45c7-b6dc-3e29281725f3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:44.769396 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:44.807386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:44.809169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.809169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.809830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.811097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:44.817459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:44.925490 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1671/3333] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:44 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:44.929909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:44.948650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf64d2c-761a-43d6-9b28-ad65cd4a0881 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:44.959861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:44.960500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:44.965541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:44.965541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:44.965541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:44.965541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:44.993381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1663/3334] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:26:44.995464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:45.021382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e247f-a2db-4d39-8301-d143ea196b15 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:45.042213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:45.042856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:45.043140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:45.043848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:45.044151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:45.045751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fed8b4-1a3f-433a-821c-19b76cdb0ef6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:45.069827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1672/3335] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:45.071802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:45.095878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861822-98e3-432c-8900-411e817a2f5b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:45.108511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:45.110140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:45.111345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:45.112599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] PATH_INFO: `/v3/projects/3465d57c005f4189afc9abd0fc0008c7/users/fb37a82d48064c8f9768ddc2feabacd5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:45.149146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3465d57c005f4189afc9abd0fc0008c7, user_id=fb37a82d48064c8f9768ddc2feabacd5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:45.152181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:45.258127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1664/3336] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:45 2022] PUT /identity/v3/projects/3465d57c005f4189afc9abd0fc0008c7/users/fb37a82d48064c8f9768ddc2feabacd5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:45.278052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:45.278584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:45.278963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:45.335240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:45.336625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:45.494557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1673/3337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:45.518989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:45.522909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:45.644300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d111bd-edee-4854-b779-21abcb10a86b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:45.663396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:45.668434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:45.668954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:45.670441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:45.706970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:45.711433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:45.761266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1665/3338] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:45.762412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:45.764141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:45.945556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8c05a-e144-4bb7-bba9-02bb1d650263 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:45.955366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:45.956452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:45.956452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:45.956642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:45.958753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:45.978807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:45.985871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba44d4-0b6a-4bee-b3c5-46dd11099575 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:46.000518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1674/3339] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:49.006742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:49.007668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:49.033074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f0d27-e608-4659-b5cb-1f8653e886fc service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:49.050297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:49.051171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:49.054593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:49.054956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] PATH_INFO: `/v3/users/e1e50d6775ec4d2e96ab6e839b4631f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:49.056744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e50d6775ec4d2e96ab6e839b4631f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:49.058996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:49.537916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e50d6775ec4d2e96ab6e839b4631f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:49.537916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e50d6775ec4d2e96ab6e839b4631f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:49.547615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e50d6775ec4d2e96ab6e839b4631f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:49.554600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e50d6775ec4d2e96ab6e839b4631f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:49.571592 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:49.723429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e50d6775ec4d2e96ab6e839b4631f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:49.817849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1666/3340] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:49 2022] DELETE /identity/v3/users/e1e50d6775ec4d2e96ab6e839b4631f1 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:49.818769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:49.819612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:49.820629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:49.923263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:49.932563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:50.088141 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:50.103459 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1675/3341] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:50.280518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:50.286991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:50.444209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122afc6b-56f8-4c40-b77b-7132543a8224 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:50.454986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:50.456723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:50.457199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:50.457932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:50.481509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:50.486061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc536-0910-4b40-a9c0-6ab9ff6b4e57 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:50.501175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1667/3342] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:52.251631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:52.253281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:52.273007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede79fd8-cd89-476f-8635-8dd83dba11d8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:52.280979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:52.282035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:52.282466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:52.282887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] PATH_INFO: `/v3/projects/310172f2dfaf4ddcb5eace8a13939cda` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:52.284248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] RBAC: Authorizing `identity:delete_project(project_id=310172f2dfaf4ddcb5eace8a13939cda)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:52.286367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:52.552097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310172f2dfaf4ddcb5eace8a13939cda', 'request_id': 'req-c492aabd-be18-46aa-ae51-7fec999e849a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:52.645447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310172f2dfaf4ddcb5eace8a13939cda', 'request_id': 'req-c492aabd-be18-46aa-ae51-7fec999e849a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:52.653287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310172f2dfaf4ddcb5eace8a13939cda', 'request_id': 'req-c492aabd-be18-46aa-ae51-7fec999e849a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:52.682555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] The token cache is being invalidate because project 310172f2dfaf4ddcb5eace8a13939cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:52.682555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:52.682555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c492aabd-be18-46aa-ae51-7fec999e849a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:52.683848 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1676/3343] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:52 2022] DELETE /identity/v3/projects/310172f2dfaf4ddcb5eace8a13939cda => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:52.690310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:52.691311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:52.691771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:52.727251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:52.728569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:52.860735 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1668/3344] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:52.868063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:52.868616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:52.869099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:52.931085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:52.932690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:52.954060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1677/3345] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:26:52.957061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:52.972167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7a93-e9fe-4500-b4dc-9964e5b85b39 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:52.989659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:52.989659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:52.989659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:52.989659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:52.990102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:52.990102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:52.996043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.023891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1669/3346] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:53.028396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.063836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb3f75-8fea-49dd-991c-c9316ae55383 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:53.063836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:53.063836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.063836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.064434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.064434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:53.066310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.179221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1678/3347] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:53.183214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.221793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bbbb3-d17d-4bdd-97e3-d4837e829211 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:53.389752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:53.392227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.392694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.393656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.398043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:53.400935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.421894 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:53.525283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1670/3348] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:53 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:26:53.526001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.542912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b43ee-d31e-4f35-97cf-7e0c07d121b8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:53.563662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:53.564289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.564564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.564827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.565511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:53.567123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.590444 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1679/3349] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:26:53.595023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.612411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08914671-a103-4a1e-854a-df9cf2d185a8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:53.625361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:53.626022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.626296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.626566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.627222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:53.628876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a8c0-a350-40a4-9587-a80f95abe096 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.660523 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1671/3350] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:26:53.664445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.679061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0b22-5e20-43bb-a73f-7a03dc039482 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:53.685308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:53.690206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.690206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.690206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] PATH_INFO: `/v3/projects/2fbfd293526648e7b758875e9465fdfb/users/a3bf509a0d7a4c098a31777eaa72b8ef/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.703262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbfd293526648e7b758875e9465fdfb, user_id=a3bf509a0d7a4c098a31777eaa72b8ef, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:53.706875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:53.766139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1680/3351] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:26:53 2022] PUT /identity/v3/projects/2fbfd293526648e7b758875e9465fdfb/users/a3bf509a0d7a4c098a31777eaa72b8ef/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:26:53.782211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:53.782719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:53.782823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:53.839255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] MFA Rules not processed for user `a3bf509a0d7a4c098a31777eaa72b8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:53.840548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:53.970989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1672/3352] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:53.987518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:53.989601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:54.116546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f8981-a92d-41ef-a2eb-7515658dfe38 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:54.132385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:54.133075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:54.133475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:54.134225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:54.150056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:54.150056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc8331-adfb-42d8-bcdc-0bc673085169 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:54.152501 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:54.168077 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1681/3353] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:56.035420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:56.213791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3ced3-bfe7-434b-ba24-7b51f71b2baf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:56.226608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:56.227266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:56.227543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:56.227812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] PATH_INFO: `/v3/users/a3bf509a0d7a4c098a31777eaa72b8ef` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:56.228939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bf509a0d7a4c098a31777eaa72b8ef)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:56.234898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:56.547266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bf509a0d7a4c098a31777eaa72b8ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:56.553759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bf509a0d7a4c098a31777eaa72b8ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:56.568269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bf509a0d7a4c098a31777eaa72b8ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:56.569972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bf509a0d7a4c098a31777eaa72b8ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:56.657550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bf509a0d7a4c098a31777eaa72b8ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:56.678491 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:56.702996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1673/3354] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:26:56 2022] DELETE /identity/v3/users/a3bf509a0d7a4c098a31777eaa72b8ef => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:56.707700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:56.708294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:56.708294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:56.747606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:56.748381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:56.911212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1682/3355] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:56.925545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:56.926987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:57.032978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cf70-f21f-4e22-b5cd-29ca3498c41c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:57.037909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:57.039146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:57.039778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:57.040159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:57.085282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:57.088493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab6bcc-51e0-413d-9e4f-7d918d98ff5d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:57.111689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1674/3356] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:26:58.794121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:58.796867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:58.838565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1aec3-4e19-4162-9ca3-94a31d46e6fd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:58.862761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:58.863417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:58.863697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:58.863975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] PATH_INFO: `/v3/projects/2fbfd293526648e7b758875e9465fdfb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:58.871470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbfd293526648e7b758875e9465fdfb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:58.879899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:59.147530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbfd293526648e7b758875e9465fdfb', 'request_id': 'req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:59.194497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.195516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.197917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.217389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbfd293526648e7b758875e9465fdfb', 'request_id': 'req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:59.225807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbfd293526648e7b758875e9465fdfb', 'request_id': 'req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:59.262419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] The token cache is being invalidate because project 2fbfd293526648e7b758875e9465fdfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:26:59.264999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:59.267595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] MFA Rules not processed for user `fb37a82d48064c8f9768ddc2feabacd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:59.270260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83056d6-3266-4fdf-bd41-6eb00e7d9a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:26:59.272198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:59.279502 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1683/3357] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:26:58 2022] DELETE /identity/v3/projects/2fbfd293526648e7b758875e9465fdfb => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:26:59.284413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c727500-8a4c-4e14-9139-81716fab6f7e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.284413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c727500-8a4c-4e14-9139-81716fab6f7e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.286545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c727500-8a4c-4e14-9139-81716fab6f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.361343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1c727500-8a4c-4e14-9139-81716fab6f7e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:59.362569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c727500-8a4c-4e14-9139-81716fab6f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:59.521433 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1675/3358] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:26:59.533261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:59.537112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:59.539467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1684/3359] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:59.549125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.549514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.549704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.609674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:26:59.618756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:26:59.637389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1685/3360] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:26:59.644242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:59.657128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd9043-52eb-40c7-a316-4d574e97483e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:59.665475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:59.666465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.666877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.667254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.668267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:26:59.668677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:59.670545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:59.686923 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1686/3361] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:26:59.692134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:26:59.710006 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:26:59.722246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e40b1-4ad3-4e07-8ed4-7b3f096edd19 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:59.740430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35f533-b9ea-42b5-94f5-48b082c39a7c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:26:59.740607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:59.741082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.747731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.747731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.747731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:59.747731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444522e-b08f-485d-8ea4-268c4a7efc88 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:59.749216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:26:59.749877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:26:59.750208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:26:59.750485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:26:59.790940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:26:59.798834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:26:59.832997 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1676/3362] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:00.019771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1687/3363] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:26:59 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:00.021557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:00.021557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35b438-be84-461c-9509-fe99dc7ac952 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:00.021557 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:00.107359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:00.107683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.107972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.109867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.112090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:00.114106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:00.189067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.190867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.190867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.256055 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1677/3364] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:26:59 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:00.257123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:00.257269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] MFA Rules not processed for user `948aaf46e1ac4c129dca02cd2dd903e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:00.258795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:00.285780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec19171-763f-4001-a251-804682c71d73 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:00.319024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:00.319024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.319024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.319024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.320420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:00.327598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:00.376789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1678/3365] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:00.379557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:00.404713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532bd5-f568-456a-bb3a-8ecb5a2fbc8d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:00.419344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:00.422453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.422905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.423281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.426205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:00.428561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20f89b-f57a-48ff-982a-f6a49de9c53c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:00.469402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1688/3366] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:00.474756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1679/3367] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:00.479880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:00.483413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.484590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.485141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.514803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed70b6-3e51-4d1b-9453-26271e081617 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:00.547104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:00.601849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.601849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.601849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] PATH_INFO: `/v3/projects/18d153e6d2944b498a2661bf5ffc083a/users/420b2bfe45184cd8960e1037e232e935/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.603394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] MFA Rules not processed for user `948aaf46e1ac4c129dca02cd2dd903e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:00.603394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:00.603394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1680/3368] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:00.603677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d153e6d2944b498a2661bf5ffc083a, user_id=420b2bfe45184cd8960e1037e232e935, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:00.609117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4bdd5-77f1-4598-8319-248fc8fd3196 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:00.723957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:00.752828 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1689/3369] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:00 2022] PUT /identity/v3/projects/18d153e6d2944b498a2661bf5ffc083a/users/420b2bfe45184cd8960e1037e232e935/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:00.763545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.763545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.763545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:00.838303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] MFA Rules not processed for user `420b2bfe45184cd8960e1037e232e935`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:00.840192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:00.888808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bb833-1c98-46bc-b4de-fccddbdd1678 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:00.978235 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1690/3370] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:00.988255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:00.989151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:00.989520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:00.989880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:01.000089 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:01.090872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:01.094564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:01.109126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1681/3371] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:27:01.807245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:01.809512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:01.854129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a8fd1-2b5d-4590-9a95-ca6e8a765fe0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:01.867264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:01.868149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:01.868601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:01.869084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:01.931395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:01.933419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cfd2a-4732-43a9-8d10-6d98df2b042b service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:01.971465 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1691/3372] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:02.076312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:02.271597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df514565-d0a1-4511-afed-6e080ae107c6 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:02.282249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:02.282249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:02.282249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:02.282249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] PATH_INFO: `/v3/users/420b2bfe45184cd8960e1037e232e935` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:02.282638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420b2bfe45184cd8960e1037e232e935)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:02.283520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:02.527057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420b2bfe45184cd8960e1037e232e935'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:02.533121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420b2bfe45184cd8960e1037e232e935'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:02.566212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420b2bfe45184cd8960e1037e232e935'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:02.567581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420b2bfe45184cd8960e1037e232e935'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:02.727334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420b2bfe45184cd8960e1037e232e935'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:02.782701 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1682/3373] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:02 2022] DELETE /identity/v3/users/420b2bfe45184cd8960e1037e232e935 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:02.787180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:02.787582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:02.787984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:02.822501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:02.825720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:02.879718 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:02.933379 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1692/3374] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:02.964445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:02.965309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:03.020841 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:03.058565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79eb4d-41c8-4742-8cc5-73ee7c2826e3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:03.064869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:03.066258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:03.066622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:03.066972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:03.081732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:03.083250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7dece-1857-4617-a413-207c51ca6f4a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:03.104740 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1683/3375] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:05.127222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:05.128883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:05.151995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8c258-b2c0-4de4-95aa-6aa7fce4f3d6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:05.174754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:05.175553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:05.175836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:05.176108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] PATH_INFO: `/v3/projects/18d153e6d2944b498a2661bf5ffc083a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:05.177429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d153e6d2944b498a2661bf5ffc083a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:05.179524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:05.311845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d153e6d2944b498a2661bf5ffc083a', 'request_id': 'req-25b9a3fd-1036-4cee-9217-dfb2725da228'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:05.418578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d153e6d2944b498a2661bf5ffc083a', 'request_id': 'req-25b9a3fd-1036-4cee-9217-dfb2725da228'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:05.427350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d153e6d2944b498a2661bf5ffc083a', 'request_id': 'req-25b9a3fd-1036-4cee-9217-dfb2725da228'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:05.448400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] The token cache is being invalidate because project 18d153e6d2944b498a2661bf5ffc083a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:05.449388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:05.451986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25b9a3fd-1036-4cee-9217-dfb2725da228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:05.456019 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1693/3376] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:05 2022] DELETE /identity/v3/projects/18d153e6d2944b498a2661bf5ffc083a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:05.461091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:05.461638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:05.461638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:05.526116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:05.526116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:05.656972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1684/3377] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:05.658472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:05.659105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:05.659558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:05.689550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:05.691271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:05.723676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1694/3378] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:27:05.727528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:05.740425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e2b46-2ca7-44f9-ade7-76ef46f86a9e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:05.745519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:05.746412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:05.746859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:05.747138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:05.747824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:05.748129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:05.750113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:05.788987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:05.803330 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1685/3379] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:27:05.816866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c98fc-8637-426f-92a8-b5757e002e7a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:05.842220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:05.849138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:05.849505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:05.849786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:05.863204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:05.864631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:06.016068 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1695/3380] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:05 2022] POST /identity/v3/projects => generated 389 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:06.020053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:06.037923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a61c42-5a9f-479b-a456-2783b3391a1d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:06.181538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:06.182174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:06.182463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:06.182741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:06.190492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:06.196761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:06.365044 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1686/3381] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:06 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:06.366347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:06.391313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d77f9-4035-4301-a4f0-a7df1c3431ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:06.403034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:06.405061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:06.405601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:06.406030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:06.408943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:06.411239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:06.433630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1696/3382] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:27:06.439382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:06.457750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7458c-1b64-401e-8c35-1577c80fb4ee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:06.464004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:06.465568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:06.466016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:06.466473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:06.467678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:06.469719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f8a48-e488-4f3d-b7a1-64a98dd50cb5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:06.496570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:06.504282 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1687/3383] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:06.509777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4509-bdec-4e5d-be81-6d3a653b73da admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:06.518023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:06.519302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:06.520021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:06.521235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] PATH_INFO: `/v3/projects/e712a6f1f1de4d4a99ccdb924693cd03/users/b26f4a23e4674cc3b24ec6e67f1c860d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:06.573569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e712a6f1f1de4d4a99ccdb924693cd03, user_id=b26f4a23e4674cc3b24ec6e67f1c860d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:06.579219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:06.736481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:06.737242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:06.737705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:06.743063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1697/3384] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:06 2022] PUT /identity/v3/projects/e712a6f1f1de4d4a99ccdb924693cd03/users/b26f4a23e4674cc3b24ec6e67f1c860d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:06.784751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:06.786924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:06.846310 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:06.948735 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1688/3385] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:27:06.954424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:06.962366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:07.138735 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:07.167014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc20d74-03d8-4eb0-9b3d-a6a8cf850e96 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:07.177974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:07.178588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:07.178862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:07.182024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:07.208365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:07.209956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8870d-5bf6-4f15-a932-9bf90c972f52 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:07.247719 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1698/3386] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:13.765958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:13.767543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:13.790076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba19bfb-ad5b-48e6-a675-aa28658d2a7c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:13.797745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:13.800905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:13.800905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:13.801656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] PATH_INFO: `/v3/users/fb37a82d48064c8f9768ddc2feabacd5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:13.805251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb37a82d48064c8f9768ddc2feabacd5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:13.807685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:14.137729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb37a82d48064c8f9768ddc2feabacd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:14.139773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb37a82d48064c8f9768ddc2feabacd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:14.169544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb37a82d48064c8f9768ddc2feabacd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:14.169544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb37a82d48064c8f9768ddc2feabacd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:14.293947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb37a82d48064c8f9768ddc2feabacd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:14.385248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1689/3387] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:13 2022] DELETE /identity/v3/users/fb37a82d48064c8f9768ddc2feabacd5 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:15.245608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:15.246525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:15.247055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:15.278290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:15.279538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:15.476206 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1699/3388] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:15.491589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:15.493156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:15.638610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fafd11-79a5-44c7-9010-3d32d009d771 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:15.666146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:15.671605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:15.674332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:15.677142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:15.710711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:15.713622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc7646-ae5e-4931-8a21-7fcaa07e25b7 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:15.727458 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1690/3389] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:15.805400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:15.806992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:16.017278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27591147-4e0c-433f-bfe4-487753adc52a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:16.036142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:16.037302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.037940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.038426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] PATH_INFO: `/v3/projects/3465d57c005f4189afc9abd0fc0008c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.046339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3465d57c005f4189afc9abd0fc0008c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:16.050638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:16.304059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3465d57c005f4189afc9abd0fc0008c7', 'request_id': 'req-4572676a-6a4c-44fd-9117-d581320bb484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:16.448853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3465d57c005f4189afc9abd0fc0008c7', 'request_id': 'req-4572676a-6a4c-44fd-9117-d581320bb484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:16.462052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3465d57c005f4189afc9abd0fc0008c7', 'request_id': 'req-4572676a-6a4c-44fd-9117-d581320bb484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:16.480213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] The token cache is being invalidate because project 3465d57c005f4189afc9abd0fc0008c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:16.480505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:16.481722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4572676a-6a4c-44fd-9117-d581320bb484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:16.489041 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1700/3390] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:15 2022] DELETE /identity/v3/projects/3465d57c005f4189afc9abd0fc0008c7 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:16.495589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.496126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.501262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.551406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:16.552834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:16.642378 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:16.711646 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1691/3391] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:16.714795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.715084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.715363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.746637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:16.748598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:16.771489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1701/3392] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:16.772212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:16.786203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512d7df-220b-4c6f-a72e-cc6be1e1bd75 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:16.798862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:16.799591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.799768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.800045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.800706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:16.801011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:16.802715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:16.830152 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1692/3393] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:27:16.834273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:16.849946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ff6b8-af97-4c44-bfde-8ee133962b22 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:16.865684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:16.866630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.867064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.867488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.868312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:16.870450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:16.922379 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:16.944339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:16.946304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:16.974476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b0e52-b801-443c-ac2e-20a12fc0e54b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:16.985227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:16.986130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:16.986652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:16.987081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] PATH_INFO: `/v3/users/fb8201c608b3417dafc84e520603d1c0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:16.989756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8201c608b3417dafc84e520603d1c0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:16.991929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:17.087474 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1702/3394] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:17.093406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:17.209246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1193-fb54-4e4a-a754-4730b59af4c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:17.233412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:17.234313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:17.234751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:17.235178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:17.235997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:17.238112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:17.368574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8201c608b3417dafc84e520603d1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:17.369460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8201c608b3417dafc84e520603d1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:17.383963 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1703/3395] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:17 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:27:17.387793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:17.404710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8201c608b3417dafc84e520603d1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:17.407111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8201c608b3417dafc84e520603d1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:17.417367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c391e3-f3a9-4138-a485-d4b62a93c867 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:17.434573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:17.453955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:17.470697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:17.471259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:17.472122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:17.474088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:17.510966 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1704/3396] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:17.513137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:17.519469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:17.548889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f2f85-dd51-4981-9514-806202695a70 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:17.562314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:17.563386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:17.565686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:17.566195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:17.567050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:17.571158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:17.602207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1705/3397] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:17.606013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:17.632358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238ecd2-fa39-46a7-9189-1967244eb925 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:17.673308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:17.673308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:17.673308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:17.673308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] PATH_INFO: `/v3/projects/fdedb3257fe94513bd5c51de0ae1d737/users/a4fff27847f74c39b425dba724cf847f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:17.687104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdedb3257fe94513bd5c51de0ae1d737, user_id=a4fff27847f74c39b425dba724cf847f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:17.689939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:17.947953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca775f9f-206a-4e91-82e6-da57af9c7204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8201c608b3417dafc84e520603d1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:17.961819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1706/3398] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:17 2022] PUT /identity/v3/projects/fdedb3257fe94513bd5c51de0ae1d737/users/a4fff27847f74c39b425dba724cf847f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:17.963446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:17.970066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.003312 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1693/3399] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:16 2022] DELETE /identity/v3/users/fb8201c608b3417dafc84e520603d1c0 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:18.014914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126a24-e944-4478-a119-d8571be4ba63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.014914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126a24-e944-4478-a119-d8571be4ba63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.014914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4126a24-e944-4478-a119-d8571be4ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.054416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a4126a24-e944-4478-a119-d8571be4ba63 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:18.057103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a4126a24-e944-4478-a119-d8571be4ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.167192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba9f55-7902-4768-a10e-a02bea2d70ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:18.228386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1694/3400] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:18.229848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.230132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.230405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.268832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:18.270036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.293600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1695/3401] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:18.307533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:18.308349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.308709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.308984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.316461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.344957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:18.349617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:18.372139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1707/3402] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:18.375152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:18.376619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.402949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:18.404558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.544016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54526182-b6b6-44f9-a964-cfbdb7faa50b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:18.554369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:18.554674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.554957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.555228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.563375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cddba-f50d-4a0f-8e71-2e9930c16183 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:18.572646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:18.573381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.574498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.575279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.586144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:18.588876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:18.605509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:18.607185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:18.614756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1696/3403] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:18.623925 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1708/3404] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:27:18.813262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:18.818558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:18.847107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9ab4e-f91b-48c9-be1d-eba9128ffca7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:18.861280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:18.876850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:18.876850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:18.876850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] PATH_INFO: `/v3/users/927f79f3eab648939a30208fed465eef` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:18.876850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=927f79f3eab648939a30208fed465eef)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:18.876850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:19.206059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927f79f3eab648939a30208fed465eef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:19.208058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927f79f3eab648939a30208fed465eef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:19.237190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927f79f3eab648939a30208fed465eef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:19.239145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927f79f3eab648939a30208fed465eef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:19.417932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927f79f3eab648939a30208fed465eef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:19.455835 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1697/3405] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:18 2022] DELETE /identity/v3/users/927f79f3eab648939a30208fed465eef => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:20.015352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:20.031211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63459e0e-2963-4942-9b1f-0b81e71bac5d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:20.194356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:20.195976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:20.249154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:20.249856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:20.250139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:20.250413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] PATH_INFO: `/v3/projects/bbd28b9d6b7146f2b1c114607be83a48` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:20.262637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd28b9d6b7146f2b1c114607be83a48)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:20.272014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:20.395518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2797-e75c-4341-bdb0-df10e1711fae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:20.406506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:20.407686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:20.408134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:20.408571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] PATH_INFO: `/v3/projects/98c4b4fec5574b8abd29e56df1fdc822` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:20.410779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c4b4fec5574b8abd29e56df1fdc822)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:20.413383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:20.540898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd28b9d6b7146f2b1c114607be83a48', 'request_id': 'req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.581785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c4b4fec5574b8abd29e56df1fdc822', 'request_id': 'req-edbb53a6-7df6-4cfc-bddd-433536ab4659'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.600680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c4b4fec5574b8abd29e56df1fdc822', 'request_id': 'req-edbb53a6-7df6-4cfc-bddd-433536ab4659'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.658416 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:20.689213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd28b9d6b7146f2b1c114607be83a48', 'request_id': 'req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.702021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd28b9d6b7146f2b1c114607be83a48', 'request_id': 'req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.727875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] The token cache is being invalidate because project bbd28b9d6b7146f2b1c114607be83a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:20.727875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.728829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f5fd815-61bc-42bc-971e-dbb0ddc75f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.730686 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1709/3406] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:20 2022] DELETE /identity/v3/projects/bbd28b9d6b7146f2b1c114607be83a48 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:20.742754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322abc5-f609-42c1-9860-efede9bdbca5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:20.743283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322abc5-f609-42c1-9860-efede9bdbca5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:20.743712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322abc5-f609-42c1-9860-efede9bdbca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:20.780710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c4b4fec5574b8abd29e56df1fdc822', 'request_id': 'req-edbb53a6-7df6-4cfc-bddd-433536ab4659'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.805070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7322abc5-f609-42c1-9860-efede9bdbca5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:20.816288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] The token cache is being invalidate because project 98c4b4fec5574b8abd29e56df1fdc822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:20.816288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.816502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7322abc5-f609-42c1-9860-efede9bdbca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:20.816735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-edbb53a6-7df6-4cfc-bddd-433536ab4659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:20.819733 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1698/3407] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:20 2022] DELETE /identity/v3/projects/98c4b4fec5574b8abd29e56df1fdc822 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:20.824871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272268ae-64c0-4f54-9ada-dc058c9baf2a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:20.827544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272268ae-64c0-4f54-9ada-dc058c9baf2a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:20.827820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272268ae-64c0-4f54-9ada-dc058c9baf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:20.866264 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:20.896764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-272268ae-64c0-4f54-9ada-dc058c9baf2a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:20.898439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-272268ae-64c0-4f54-9ada-dc058c9baf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:20.998531 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1710/3408] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:21.000095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.000377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.000647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.082968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:21.084577 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1699/3409] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:21.085561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:21.086118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.086412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.086689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.106882 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1711/3410] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:21.110135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.132185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a91c15-af23-4f8d-a4b5-8b3c7fedc18c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.139713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:21.142331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:21.145111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.146127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.146582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.147014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.147838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:21.148299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.151434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.162338 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1700/3411] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:21.163852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.182175 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1712/3412] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:27:21.187288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.192600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3292-e2d9-497f-9eda-00569935a17a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.205010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca9a4c-5911-4717-9184-8104be804662 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.208434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.209443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.209914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.210197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.211044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:21.211519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.218115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.218379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.219151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.219596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.220827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.221661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.226991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.257225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1701/3413] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:27:21.262107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.283506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9710a4-8a82-47e9-9956-bf261007660a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.298668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.299655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.300342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.300939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.301779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.303845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.342897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1713/3414] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:21.347343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.449037 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1702/3415] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:27:21.453530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.538339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652e8e5-d2e5-4d1b-a0f6-7634360f8591 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.626983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0efb92-7211-4404-98fc-b6ff77303a0a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.641085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.642164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.642562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.643490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.645090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.645240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.645742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.646027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.646302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.646984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.648566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.649769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.800573 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1714/3416] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:21 2022] POST /identity/v3/users => generated 291 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:21.803458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.803713 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1703/3417] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:21 2022] POST /identity/v3/users => generated 287 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:21.807753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.836438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da1be7-ffa4-4c16-a23a-eafab1de5174 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.842642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.842918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294c72-33af-4c8e-abd1-93c4fc3ea170 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.843477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.843908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.844268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.845083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.847768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.870214 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1715/3418] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:21.881103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.886474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.888209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.888504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.894530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4aea2-53b6-4cc8-b6ab-507caaedb8c0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.899873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.900658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.901043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.901447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.902193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.903479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.904919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.905809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.911885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:21.927744 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1716/3419] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:21.928936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.940646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f213fa-791c-4e10-b55c-c148b745c482 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.949642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.949892 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1704/3420] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:27:21.950002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.950002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.950002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] PATH_INFO: `/v3/projects/87c92264dc354f548697879f5db3c70c/users/3478222ab7f24587a53f4deb83753957/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.956602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:21.977551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba6a0e-c2d0-49b7-9c12-54eb491a9eee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:21.989102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c92264dc354f548697879f5db3c70c, user_id=3478222ab7f24587a53f4deb83753957, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:21.994285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:21.994909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:21.995234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:21.995461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:21.996168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:22.001028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50f655-92a5-4d67-8ebc-a39ebc43522e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:22.001258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:22.033315 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1705/3421] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:22.038458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:22.043564 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:22.062938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d965e05-d93e-4a9e-852a-3f9a4e748b94 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:22.084576 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1717/3422] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:21 2022] PUT /identity/v3/projects/87c92264dc354f548697879f5db3c70c/users/3478222ab7f24587a53f4deb83753957/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:22.086071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.086352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.086800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.094924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:22.095618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.095894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.096165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] PATH_INFO: `/v3/projects/34952fd2cb6b407f9ccf8dded67139dd/users/abb5b433d3f9405d84e9df692a310b1c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.146535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34952fd2cb6b407f9ccf8dded67139dd, user_id=abb5b433d3f9405d84e9df692a310b1c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:22.154029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:22.156286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873056b8-ba76-49a2-887d-2ac2b9177124 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:22.161135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:22.261803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1706/3423] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:22 2022] PUT /identity/v3/projects/34952fd2cb6b407f9ccf8dded67139dd/users/abb5b433d3f9405d84e9df692a310b1c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:22.272998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f026-4d18-47df-ad0e-c61c3cc9a55c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.274649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f026-4d18-47df-ad0e-c61c3cc9a55c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.275116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f026-4d18-47df-ad0e-c61c3cc9a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.327036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1718/3424] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:22.349609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5185f026-4d18-47df-ad0e-c61c3cc9a55c None None] MFA Rules not processed for user `abb5b433d3f9405d84e9df692a310b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:22.351377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5185f026-4d18-47df-ad0e-c61c3cc9a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:22.355682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:22.357979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:22.490566 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:22.501769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b554d2a-c2dc-4eab-8bbd-61fe5edd199e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:22.537072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1707/3425] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:22.546712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.547290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.547793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.588595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] MFA Rules not processed for user `abb5b433d3f9405d84e9df692a310b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:22.594360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:22.614931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1708/3426] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:22.621026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:22.621815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.622198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.622572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.668335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:22.670332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:22.836475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:22.838573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2a628-efe9-4a1f-b32a-b88dea9a24f4 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:22.843424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73211066-bc5e-4698-bf56-483d712dc242 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:22.855781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:22.863712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.863712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.863712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.869591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1719/3427] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:22.871891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:22.872341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:22.872484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:22.906596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:22.908714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:22.943870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1709/3428] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:27:22.948865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] MFA Rules not processed for user `b26f4a23e4674cc3b24ec6e67f1c860d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:22.953283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:23.186443 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1720/3429] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:23.196082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:23.197897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:23.222233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf85c2e-e7be-4a87-9aac-5f7e094a640e service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:23.236908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:23.237705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:23.237985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:23.238269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:23.297827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:23.299565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a4c0e-4f67-4ed1-ac67-0dd39d096a22 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:23.322878 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1710/3430] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:23.672636 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:23.904018 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:25.156376 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:36.633995 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:37.156900 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=52 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:38.660378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:38.679307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dc8ee-6321-4639-bc95-b594d76a51c3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:38.685817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:38.687030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:38.687545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:38.688307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:38.692371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:38.792099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:38.795328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c044d-9c9d-4856-a3f6-6263588c60d4 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:38.811795 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1721/3431] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:40.287275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7ddf-dd76-455a-8132-76aa191fc9df None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:40.287945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7ddf-dd76-455a-8132-76aa191fc9df None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:40.287945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7ddf-dd76-455a-8132-76aa191fc9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:40.351170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-69bd7ddf-dd76-455a-8132-76aa191fc9df None None] MFA Rules not processed for user `3478222ab7f24587a53f4deb83753957`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:40.353376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-69bd7ddf-dd76-455a-8132-76aa191fc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:40.613815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1711/3432] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:40.718177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:40.718687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:40.719131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:40.733923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187628c-445e-4252-a6c8-1afd5b48c64a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:40.734222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187628c-445e-4252-a6c8-1afd5b48c64a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:40.735275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187628c-445e-4252-a6c8-1afd5b48c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:40.810088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] MFA Rules not processed for user `3478222ab7f24587a53f4deb83753957`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:40.811332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:40.830943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9187628c-445e-4252-a6c8-1afd5b48c64a None None] MFA Rules not processed for user `a4fff27847f74c39b425dba724cf847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:40.832455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9187628c-445e-4252-a6c8-1afd5b48c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:40.838427 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1722/3433] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:41.036399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:41.046806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1712/3434] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:27:41.060032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:41.060373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:41.060587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:41.068279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3c798-6410-42bf-8ac6-9b1dbc3aba6d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:41.094454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] MFA Rules not processed for user `a4fff27847f74c39b425dba724cf847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:41.094638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:41.095264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:41.095549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:41.095817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:41.096803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:41.116097 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1713/3435] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:27:41.126249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:41.127882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:41.167577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1723/3436] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:27:41.566215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:41.605076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015efe5-a0f4-413c-96d8-2e751c744885 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:41.632055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:41.632677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:41.632953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:41.633219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:41.671120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:41.673192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:41.724124 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1714/3437] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:43.053856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:43.055465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:43.272180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0673d-6461-4e05-84f4-ab9ddfd0c473 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:43.294311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:43.296826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:43.299175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:43.299175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:43.307357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:43.374382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:43.376018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f80c1d-5c40-4ad5-b354-1ee03fc34a4b service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:43.430621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1724/3438] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:44.193228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:44.195255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:44.216571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944affc5-b29c-4e8b-be10-1bb56468dd9f service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:44.223661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:44.225983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:44.226431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:44.226859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] PATH_INFO: `/v3/users/a07f2b8c31f54c62aaba73ca2bd2edb8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:44.228482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07f2b8c31f54c62aaba73ca2bd2edb8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:44.230630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:44.540183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07f2b8c31f54c62aaba73ca2bd2edb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:44.542032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07f2b8c31f54c62aaba73ca2bd2edb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:44.562075 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:44.567002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07f2b8c31f54c62aaba73ca2bd2edb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:44.567820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07f2b8c31f54c62aaba73ca2bd2edb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:44.830015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07f2b8c31f54c62aaba73ca2bd2edb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:44.874781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1715/3439] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:44 2022] DELETE /identity/v3/users/a07f2b8c31f54c62aaba73ca2bd2edb8 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:46.200345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eda9-3a04-4d30-9298-d5de59ed1174 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:46.200909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eda9-3a04-4d30-9298-d5de59ed1174 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:46.203143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37eda9-3a04-4d30-9298-d5de59ed1174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:46.248254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3c37eda9-3a04-4d30-9298-d5de59ed1174 None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:46.252045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c37eda9-3a04-4d30-9298-d5de59ed1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:46.406060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1725/3440] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:46.501323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:46.503156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:46.672412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2814c46-09e6-437f-9544-e5d06195b843 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:46.689056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:46.694500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:46.694500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:46.694500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] PATH_INFO: `/v3/projects/2c59bd73c7874a00b52ec7c5c4142039` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:46.698052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c59bd73c7874a00b52ec7c5c4142039)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:46.700256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:46.914384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c59bd73c7874a00b52ec7c5c4142039', 'request_id': 'req-065777e4-ffc8-47ae-8308-7d1ac123114d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:46.925940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c59bd73c7874a00b52ec7c5c4142039', 'request_id': 'req-065777e4-ffc8-47ae-8308-7d1ac123114d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:47.000808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c59bd73c7874a00b52ec7c5c4142039', 'request_id': 'req-065777e4-ffc8-47ae-8308-7d1ac123114d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:47.027452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] The token cache is being invalidate because project 2c59bd73c7874a00b52ec7c5c4142039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:47.027650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:47.032317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-065777e4-ffc8-47ae-8308-7d1ac123114d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:47.056268 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1716/3441] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:46 2022] DELETE /identity/v3/projects/2c59bd73c7874a00b52ec7c5c4142039 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:47.067496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.068027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.068672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.108312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:47.110158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:47.143093 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:47.245597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.248050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1726/3442] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:27:47.251162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.253415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.331487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:47.332722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:47.363438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1717/3443] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:47.364738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.401615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13594f-3588-4c0e-b80b-bfad3e0ad587 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:47.429441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:47.431762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.433100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.434429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.436289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:47.437135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:47.443083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:47.464563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1727/3444] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:27:47.469883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.482281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f702f3c-84a1-4547-99bc-4dbbaf6fd893 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:47.492888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:47.492888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.492888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.492888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.493298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:47.496030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:47.649876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1718/3445] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:47 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:47.654167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.668353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25968-700a-4588-8f0b-7a8cd64598fa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:47.750283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:47.751708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.752189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.752705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.753651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:47.756011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:47.903605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1728/3446] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:47 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:47.907636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.920697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25912e32-25cb-47e8-b66d-2884bf791925 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:47.929552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:47.930229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.930518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.930967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.931774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:47.933638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:47.948132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1719/3447] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:47.952012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.968874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f48a6-8df0-47b6-bf9f-21bcc64cf03b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:47.982135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:47.985257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:47.985257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:47.985257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:47.985257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:47.986511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:47.987431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:47.989343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:48.017729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040adb-d8d3-426e-a61f-007f2f47c59b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:48.026463 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1729/3448] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:27:48.034464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:48.041920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:48.042272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:48.047374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:48.048909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] PATH_INFO: `/v3/users/948aaf46e1ac4c129dca02cd2dd903e0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:48.051981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948aaf46e1ac4c129dca02cd2dd903e0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:48.054276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:48.060944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa750bd6-a373-4e1b-8643-ef81e00db0ea admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:48.068096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:48.069217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:48.069217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:48.070136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] PATH_INFO: `/v3/projects/470e235fb35840828d9a86028b72f5de/users/6134c05549f14bc19962acea9c913f53/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:48.094354 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:48.097578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470e235fb35840828d9a86028b72f5de, user_id=6134c05549f14bc19962acea9c913f53, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:48.102446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371732ab-dbd1-4948-a622-4735f8fe8d00 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:48.210845 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1730/3449] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:48 2022] PUT /identity/v3/projects/470e235fb35840828d9a86028b72f5de/users/6134c05549f14bc19962acea9c913f53/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:48.216872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:48.217457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:48.217944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:48.243354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:48.245018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:48.320524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948aaf46e1ac4c129dca02cd2dd903e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:48.321540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948aaf46e1ac4c129dca02cd2dd903e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:48.357636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948aaf46e1ac4c129dca02cd2dd903e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:48.362214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948aaf46e1ac4c129dca02cd2dd903e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:48.460789 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:48.460789 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1731/3450] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:48.467317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:48.470797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:48.573867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422b6dd-27d2-422a-a2f4-2be4ca2d61d6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:48.578573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:48.579972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:48.580278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:48.581089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:48.622511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:48.624121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:48.654893 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1732/3451] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:27:48.691118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cd4bd442-0d82-4763-beea-922814e55546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948aaf46e1ac4c129dca02cd2dd903e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:48.716673 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1720/3452] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:27:47 2022] DELETE /identity/v3/users/948aaf46e1ac4c129dca02cd2dd903e0 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:49.780646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:49.784372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:49.803324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cba5b2-6903-4d11-a2db-47762c34577c service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:49.939383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:49.940374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:49.940804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:49.941522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] PATH_INFO: `/v3/projects/a3f41f5c65be49aaa04853c29904bba6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:49.943549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f41f5c65be49aaa04853c29904bba6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:49.946421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:50.171518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f41f5c65be49aaa04853c29904bba6', 'request_id': 'req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:50.298977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f41f5c65be49aaa04853c29904bba6', 'request_id': 'req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:50.310132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f41f5c65be49aaa04853c29904bba6', 'request_id': 'req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:50.366738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] The token cache is being invalidate because project a3f41f5c65be49aaa04853c29904bba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:27:50.367288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:50.368189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cd17961-d6c1-49be-8c0d-68a3aa5d1fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:27:50.370577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1733/3453] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:27:49 2022] DELETE /identity/v3/projects/a3f41f5c65be49aaa04853c29904bba6 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:50.377214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:50.377884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:50.378041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:50.438023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:50.439802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:50.625617 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1721/3454] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:50.634219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:50.634544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:50.634751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:50.674811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:50.679647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:50.717048 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1734/3455] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:50.721628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:50.748462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674dafe-06b5-4ceb-b931-2caf1e471162 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:50.763991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:50.765979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:50.766465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:50.766972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:50.769238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:27:50.770507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:50.779739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:50.810546 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1722/3456] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:27:50.812175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:50.829438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbde31-54f5-4b7b-966a-533424ae486f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:50.845569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:50.846815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:50.847316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:50.847751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:50.848911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:50.856054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:51.050477 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:51.072091 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1735/3457] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:27:50 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:27:51.075761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:51.095491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b94fd-0603-448b-b709-67b3a171da49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:51.273767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:51.274885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:51.275412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:51.275890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:51.276777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:51.279363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:51.383356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1723/3458] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:27:51 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:27:51.389077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:51.411113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4a15f-569f-4b1b-af5a-75608d6866b3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:51.420228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:51.421122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:51.424162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:51.424547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:51.425445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:51.427184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:51.457384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1736/3459] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:51.462594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:51.490233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0dcc4-2533-4db5-bb25-274345e11b71 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:51.496329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:51.497888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:51.498362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:51.498848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:51.499735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:51.501807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477368f8-e8e7-4803-ba86-15c1b98da0a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:51.523129 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:27:51.542690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1724/3460] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:27:51.546936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:51.564992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375d4b-a73d-40be-bc9e-da4b71b37e2b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:51.573205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:51.573992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:51.574523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:51.575010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] PATH_INFO: `/v3/projects/0eba4d14f2004498850092bff100b757/users/2fd2e319840c4a8aab90b495374aa1d2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:51.599158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eba4d14f2004498850092bff100b757, user_id=2fd2e319840c4a8aab90b495374aa1d2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:51.601873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:51.704676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1737/3461] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:27:51 2022] PUT /identity/v3/projects/0eba4d14f2004498850092bff100b757/users/2fd2e319840c4a8aab90b495374aa1d2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:27:51.710078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5390c5-d050-445a-b62b-5525e7a1aeb6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:51.710693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5390c5-d050-445a-b62b-5525e7a1aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:51.711203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5390c5-d050-445a-b62b-5525e7a1aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:51.747853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4d5390c5-d050-445a-b62b-5525e7a1aeb6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:51.749798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d5390c5-d050-445a-b62b-5525e7a1aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:51.875891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1725/3462] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:51.908274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:51.911817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:52.001242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031494-d15e-4ec3-8bc0-16acc97adb5d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:52.006240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:52.006870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:52.007200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:52.007506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:52.019328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:52.021323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:52.034296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1738/3463] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:27:53.031950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168487d-0db4-403c-b845-f497b1f5cfd2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:53.032512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168487d-0db4-403c-b845-f497b1f5cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:53.032786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168487d-0db4-403c-b845-f497b1f5cfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:53.058099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5168487d-0db4-403c-b845-f497b1f5cfd2 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:53.060361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5168487d-0db4-403c-b845-f497b1f5cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:53.131544 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1726/3464] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:27:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:53.148635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:27:53.150800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:53.296566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fe1-3771-43f4-ac98-0fbd5649cd9d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:27:53.312684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:27:53.313502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:53.313886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:53.314276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:53.331105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:27:53.333035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5f9c8-7705-48e0-a52d-6e85fa2b054f service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:27:53.344713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1739/3465] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:27:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:27:57.744563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8664c1-8028-4192-8805-918f2ee19642 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:57.746634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8664c1-8028-4192-8805-918f2ee19642 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:57.751131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8664c1-8028-4192-8805-918f2ee19642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:57.822174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2b8664c1-8028-4192-8805-918f2ee19642 None None] MFA Rules not processed for user `55d02fb5fddb48e49fb66428db0f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:57.823443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b8664c1-8028-4192-8805-918f2ee19642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:58.022554 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1727/3466] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:27:58.033027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5379a-9628-4610-b762-ec2bb8c236ac None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:27:58.033943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5379a-9628-4610-b762-ec2bb8c236ac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:27:58.034395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5379a-9628-4610-b762-ec2bb8c236ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:27:58.086394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a6d5379a-9628-4610-b762-ec2bb8c236ac None None] MFA Rules not processed for user `55d02fb5fddb48e49fb66428db0f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:27:58.087946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a6d5379a-9628-4610-b762-ec2bb8c236ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:27:58.115214 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1740/3467] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:27:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:08.001231 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=77 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:08.076355 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=76,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:08.216220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:08.216787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:08.218256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:08.258649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] MFA Rules not processed for user `2fd2e319840c4a8aab90b495374aa1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:08.260223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:08.364795 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1728/3468] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:09.402110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9694c0-be1a-4428-a973-68aef8c49a3a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:09.402597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9694c0-be1a-4428-a973-68aef8c49a3a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:09.403706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9694c0-be1a-4428-a973-68aef8c49a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:09.530952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:09.533471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:09.558570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cc9694c0-be1a-4428-a973-68aef8c49a3a None None] MFA Rules not processed for user `6134c05549f14bc19962acea9c913f53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:09.560946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc9694c0-be1a-4428-a973-68aef8c49a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:09.703399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a13e8-eadd-472f-9658-ea4ba58dc3b1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:09.716873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:09.717555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:09.717941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:09.718228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:09.730336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:09.732685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:09.735441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1741/3469] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:09.746691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:09.747267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:09.747709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:09.771194 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1729/3470] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:28:09.781371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] MFA Rules not processed for user `6134c05549f14bc19962acea9c913f53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:09.782599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:09.807096 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1742/3471] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:28:10.058079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:10.074076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e54e-06e1-4beb-b007-312a1d3b88b4 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:10.078501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:10.079117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:10.079402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:10.079724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:10.081696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:10.100088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:10.105963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:10.125070 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1730/3472] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:10.373881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:10.374949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:10.413904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74d0b9-a952-447c-8b6c-08a404977119 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:10.443456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:10.445059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:10.447447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:10.448657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:10.483169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:10.489461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:10.533211 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1743/3473] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:10.632691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:10.634308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:10.681611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f368a09-d014-492e-a514-c8b4e503fa67 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:10.698313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:10.701230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:10.701543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:10.703093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] PATH_INFO: `/v3/users/b26f4a23e4674cc3b24ec6e67f1c860d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:10.706108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26f4a23e4674cc3b24ec6e67f1c860d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:10.713111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:10.996692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26f4a23e4674cc3b24ec6e67f1c860d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:10.996692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26f4a23e4674cc3b24ec6e67f1c860d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.013444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26f4a23e4674cc3b24ec6e67f1c860d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.015147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26f4a23e4674cc3b24ec6e67f1c860d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.019700 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:11.132316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cec0c0f7-4cb4-4370-8b51-1c87b1878d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26f4a23e4674cc3b24ec6e67f1c860d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.184972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1731/3474] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:10 2022] DELETE /identity/v3/users/b26f4a23e4674cc3b24ec6e67f1c860d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:11.494167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:11.512928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a65076-5a4f-4c10-b232-0c769ede8167 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:11.656665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:11.657386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:11.657677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:11.660764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] PATH_INFO: `/v3/projects/e712a6f1f1de4d4a99ccdb924693cd03` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:11.660764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e712a6f1f1de4d4a99ccdb924693cd03)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:11.662962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:11.866697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e712a6f1f1de4d4a99ccdb924693cd03', 'request_id': 'req-d84dcfcd-8230-493f-ac89-29c26a2e97eb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.983604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e712a6f1f1de4d4a99ccdb924693cd03', 'request_id': 'req-d84dcfcd-8230-493f-ac89-29c26a2e97eb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:11.995050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e712a6f1f1de4d4a99ccdb924693cd03', 'request_id': 'req-d84dcfcd-8230-493f-ac89-29c26a2e97eb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:12.026736 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:12.042848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] The token cache is being invalidate because project e712a6f1f1de4d4a99ccdb924693cd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:12.043412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:12.060021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d84dcfcd-8230-493f-ac89-29c26a2e97eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:12.062765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1744/3475] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:11 2022] DELETE /identity/v3/projects/e712a6f1f1de4d4a99ccdb924693cd03 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:12.070463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:12.071361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:12.071799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:12.104254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:12.106341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:12.253985 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1732/3476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:12.263882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:12.264173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:12.264451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:12.296692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:12.298001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:12.311817 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1745/3477] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:12.316013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:12.326548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f3f2-e600-40e1-9f80-318977e69488 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:12.332350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:12.333062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:12.335499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:12.335499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:12.335499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:12.335499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:12.336834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:12.358303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:12.364795 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1733/3478] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:12.366395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8b3eb-b1ce-46b2-90db-cf7b9e773b29 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:12.378701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:12.398953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:12.398953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:12.398953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:12.398953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:12.398953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eb36a-e67c-4a18-854e-c5bdd92eee3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:12.453211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:12.455683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:12.509839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd30926-375e-45d6-a2dc-92c5195c9f08 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:12.526306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:12.526953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:12.527238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:12.527509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] PATH_INFO: `/v3/users/abb5b433d3f9405d84e9df692a310b1c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:12.534163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb5b433d3f9405d84e9df692a310b1c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:12.536101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:13.286094 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1746/3479] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:12 2022] POST /identity/v3/projects => generated 365 bytes in 931 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:13.290034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.290330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.290601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:13.319637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] MFA Rules not processed for user `6134c05549f14bc19962acea9c913f53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:13.320937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:13.419897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1747/3480] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:13.419897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:13.504733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb5b433d3f9405d84e9df692a310b1c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:13.505758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb5b433d3f9405d84e9df692a310b1c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:13.538317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb5b433d3f9405d84e9df692a310b1c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:13.539071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb5b433d3f9405d84e9df692a310b1c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:13.564939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57defb3f-86ab-46c0-847a-eb7ded57aeb2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:13.571588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:13.572370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.572713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.573074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:13.573805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:13.576902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:13.604118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-258ee761-6cbb-4ae6-81a2-4e52ea043c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb5b433d3f9405d84e9df692a310b1c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:13.633697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1734/3481] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:12 2022] DELETE /identity/v3/users/abb5b433d3f9405d84e9df692a310b1c => generated 0 bytes in 1179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:13.636298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.636656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.637156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:13.665145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:13.667535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:13.696531 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1748/3482] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:13 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:13.700638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:13.704472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:13.733073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e54833-4378-4ea3-942f-465ab35bdab6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:13.764537 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:13.824778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1735/3483] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:13.843116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:13.845190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:13.845323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.845599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.845873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:13.846542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:13.848161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:13.870282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:13.912921 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1749/3484] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:13.916874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:13.930901 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:13.939795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d138700-aa91-43a9-8703-f975d3106ffd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:13.948750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:13.949438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.949719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.949986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:13.950628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:13.952813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:13.972327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637919-481e-4410-a941-2e1f771dc21a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:13.985757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:13.986912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1750/3485] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:13.991288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:13.991654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:13.993129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:13.993646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:14.013833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:14.014942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023cf7-986f-40d0-9ab5-a7a3cf5f6dd1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:14.025385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bf43a-e2cd-4977-8b23-1c4b6c0e56c1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:14.038383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:14.038542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:14.038821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:14.039208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] PATH_INFO: `/v3/projects/9d1e9b74043548e48a5bb8fb4d054803/users/6b3394f28c4f444f8cd8bda6bacc9fc8/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:14.042849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1736/3486] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:14.079142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1e9b74043548e48a5bb8fb4d054803, user_id=6b3394f28c4f444f8cd8bda6bacc9fc8, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:14.081875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:14.167140 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1751/3487] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:13 2022] PUT /identity/v3/projects/9d1e9b74043548e48a5bb8fb4d054803/users/6b3394f28c4f444f8cd8bda6bacc9fc8/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:14.261232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:14.261554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:14.261833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:14.298892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:14.300849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:14.451310 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1737/3488] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:14.499058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:14.501101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:14.596695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8e36b-9d7a-4956-9a69-dc1f01b57ed6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:14.601854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:14.602529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:14.602802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:14.603067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:14.618435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:14.619526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd41d61-cd86-412f-b1d3-ba573ad15810 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:14.633976 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1752/3489] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:14.741111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:14.742827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:14.764474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceb188-0364-4447-9a4b-3a9e908c9cc3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:14.770534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:14.771340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:14.771634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:14.771906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] PATH_INFO: `/v3/projects/34952fd2cb6b407f9ccf8dded67139dd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:14.773839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34952fd2cb6b407f9ccf8dded67139dd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:14.777208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:14.908835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34952fd2cb6b407f9ccf8dded67139dd', 'request_id': 'req-fd25773e-3f09-4733-92a6-897d7224b8a0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:14.916826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34952fd2cb6b407f9ccf8dded67139dd', 'request_id': 'req-fd25773e-3f09-4733-92a6-897d7224b8a0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:14.994343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34952fd2cb6b407f9ccf8dded67139dd', 'request_id': 'req-fd25773e-3f09-4733-92a6-897d7224b8a0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:15.016164 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:15.021542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] The token cache is being invalidate because project 34952fd2cb6b407f9ccf8dded67139dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:15.021966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:15.023063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd25773e-3f09-4733-92a6-897d7224b8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:15.025552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1738/3490] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:14 2022] DELETE /identity/v3/projects/34952fd2cb6b407f9ccf8dded67139dd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:15.031642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.032966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.032966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.067312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:15.067585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:15.147605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1753/3491] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:15.157969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.158307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.158597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.211691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:15.211691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:15.244322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1739/3492] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:15.249428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.263831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782120-5eb5-4b3c-9f3a-6bf6e0c00907 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.286046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:15.286046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.286046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.286046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.286454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:15.286454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:15.286640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:15.311892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.318073 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1754/3493] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:15.322077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320131a-c027-4a7f-9c97-a066778b5de0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.346107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:15.347099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.347625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.348976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.349833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:15.352105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:15.500727 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1740/3494] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:15 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:15.505246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.569775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28241657-f929-4b9e-b77b-0f9ba2c865ed admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.689114 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:15.709029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:15.709723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.710442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.710715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.711426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:15.713505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:15.834621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1755/3495] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:15 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:15.838588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.856030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb5c5a-3b5b-4ecc-ac3a-ec2314d976d7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.870827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:15.870827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.870827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.870827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.872352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:15.876537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:15.916989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1741/3496] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:15.919359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.935314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bba23-0195-42d9-91d8-f4e19eb56db8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.947127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:15.948015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:15.948582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:15.949055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:15.949819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:15.951611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b6fc-ac86-469f-a19f-bfbede5af894 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:15.964353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1756/3497] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:15.970162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:15.991885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b591c-daf0-4cc2-a574-60e14638f918 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:15.998369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:16.002432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:16.002432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:16.002432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:16.012822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:16.013249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:16.013661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] PATH_INFO: `/v3/projects/05838823b66b4ee18f111f30e4f8df12/users/8031b9bd49474f5496b4ebe7870a4e98/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:16.044892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] MFA Rules not processed for user `2fd2e319840c4a8aab90b495374aa1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:16.048103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05838823b66b4ee18f111f30e4f8df12, user_id=8031b9bd49474f5496b4ebe7870a4e98, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:16.048650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:16.053690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6a8ff-dc10-4d20-8efb-71a5cfe878d2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:16.139045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1742/3498] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:15 2022] PUT /identity/v3/projects/05838823b66b4ee18f111f30e4f8df12/users/8031b9bd49474f5496b4ebe7870a4e98/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:16.149085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:16.149529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:16.150754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:16.199030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1757/3499] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:16.223894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] MFA Rules not processed for user `8031b9bd49474f5496b4ebe7870a4e98`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:16.226601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:16.404423 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1743/3500] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:28:16.408962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:16.427767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e6f1-004f-4710-a4f9-0d6a2b51d32f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:16.556528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:16.557214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:16.557423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:16.557907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:16.558701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:16.561304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:16.687566 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1758/3501] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:16 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:16.691879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:16.708156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4ae1-f328-4857-8372-64ab9652e159 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:16.842041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:16.842709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:16.842988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:16.843492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:16.844331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:16.846715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:16.993166 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1744/3502] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:16 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:16.994771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.009528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76fb2a-b13e-4eb4-ae7e-7fa07b9e2e53 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:17.025887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:17.026937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.027496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.027988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.028843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:17.030977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:17.058333 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1759/3503] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:17.062049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.077870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b5e2-7673-4dd2-8da0-8467f8d0a4f5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:17.084572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:17.085713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.087792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.088370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] PATH_INFO: `/v3/projects/6f3cc175bd684ded8ef300955e410b8f/users/5d1de2d4724e4119ac0e35cfb7800c2a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.115571 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:17.124993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3cc175bd684ded8ef300955e410b8f, user_id=5d1de2d4724e4119ac0e35cfb7800c2a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:17.131027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:17.257160 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1745/3504] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:17 2022] PUT /identity/v3/projects/6f3cc175bd684ded8ef300955e410b8f/users/5d1de2d4724e4119ac0e35cfb7800c2a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:17.261175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.290069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbc9d-5d32-491a-8eff-7b76fe3922bb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:17.496591 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:17.513511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:17.514511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.514955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.515384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.516185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:17.518199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21413a-49ff-4765-af2d-e439df18120d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:17.544014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1760/3505] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:17.547341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.578176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f8963-a773-4738-9c67-bc365b45ea3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:17.586495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:17.587607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.587717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.587950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] PATH_INFO: `/v3/projects/6f3cc175bd684ded8ef300955e410b8f/users/5d1de2d4724e4119ac0e35cfb7800c2a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.590103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3cc175bd684ded8ef300955e410b8f, user_id=5d1de2d4724e4119ac0e35cfb7800c2a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:17.593242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:17.606629 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1746/3506] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:17 2022] PUT /identity/v3/projects/6f3cc175bd684ded8ef300955e410b8f/users/5d1de2d4724e4119ac0e35cfb7800c2a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:17.619141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.619630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.619750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.669823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] MFA Rules not processed for user `5d1de2d4724e4119ac0e35cfb7800c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:17.671218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:17.764291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1761/3507] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:17.768942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.786123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544be76-f334-4dfa-b395-ab5d03c28a41 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:17.792469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:17.793577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:17.793938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:17.794334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:17.795159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:17.797762 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:17.797762 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:17.797762 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:17.798809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:17.929583 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1747/3508] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:28:17 2022] POST /identity/v3/domains => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:17.935331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:17.947360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f0c2-b5dd-4db9-a602-7f7e6e9795ee None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:18.136383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:18.138339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:18.142004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:18.143362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:18.145011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:18.147284 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:18.147284 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:18.147284 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:18.148590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:18.312932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1762/3509] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:17 2022] POST /identity/v3/groups => generated 280 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:18.316729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:18.333884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961b7cc-1970-4fcd-b25b-54abb13d9461 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:18.356987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:18.357669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:18.357952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:18.358230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/4c1425d4175e40999d16bb5ae510fbe0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:18.378267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:update_group(group_id=4c1425d4175e40999d16bb5ae510fbe0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:18.379298 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:18.379298 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:18.379298 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:18.380531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:18.509054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1748/3510] 10.222.0.13 () {60 vars in 1247 bytes} [Sun Oct 30 01:28:18 2022] PATCH /identity/v3/groups/4c1425d4175e40999d16bb5ae510fbe0 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:18.515014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:18.526292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78955-90ef-43d0-bb6f-9accf2762d23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:18.558498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:18.559245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:18.559557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:18.560760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/4c1425d4175e40999d16bb5ae510fbe0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:18.577614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:get_group(group_id=4c1425d4175e40999d16bb5ae510fbe0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:18.590566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:18.595486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1763/3511] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:18 2022] GET /identity/v3/groups/4c1425d4175e40999d16bb5ae510fbe0 => generated 293 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:18.597102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:18.621267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1eda9-f9b4-494d-8089-c4eea051ab0b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:18.634154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:18.634670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:18.635010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:18.635303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/4c1425d4175e40999d16bb5ae510fbe0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:18.637781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:update_group(group_id=4c1425d4175e40999d16bb5ae510fbe0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:18.641295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:18.735785 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1749/3512] 10.222.0.13 () {60 vars in 1246 bytes} [Sun Oct 30 01:28:18 2022] PATCH /identity/v3/groups/4c1425d4175e40999d16bb5ae510fbe0 => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:18.739718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:18.759917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdc5e3-4f6f-46f0-a9c5-320349f38fcd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:18.786924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:18.796800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:18.797398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:18.799788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/4c1425d4175e40999d16bb5ae510fbe0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:18.814436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4c1425d4175e40999d16bb5ae510fbe0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:18.816891 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:18.816891 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:18.816891 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:18.819299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:19.040046 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1764/3513] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:18 2022] DELETE /identity/v3/groups/4c1425d4175e40999d16bb5ae510fbe0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:19.045260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:19.061554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce2e2-5866-433f-ba2a-ed23cdbb4e87 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:19.269314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:19.270445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:19.270896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:19.272670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:19.273532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:19.274726 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:19.274726 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:19.274726 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:19.276605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:19.281422 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:19.375889 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1750/3514] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:19 2022] POST /identity/v3/groups => generated 325 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:19.378302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:19.401965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff76682-d9db-4e41-98db-05b7b04a8d8a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:19.418290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:19.420093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:19.420543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:19.437620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:19.439034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:19.444134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:19.447561 n-d-master-1 devstack@keystone.service[82035]: WARNING keystone.server.flask.common [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 30 01:28:19.642344 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1765/3515] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:19 2022] POST /identity/v3/users => generated 323 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:19.644335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:19.661056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c8f61-8212-4768-a7ac-24fdbebc6467 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:19.677726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:19.679599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:19.680777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:19.681294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:19.737026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=9fc5f5ed872649a09e4d4ead09b7e357)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:19.742280 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:19.742280 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:19.742280 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:19.747709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:19.894893 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1751/3516] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:28:19 2022] PUT /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:19.899082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:19.919311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7c81d-386d-4373-9d43-cae7d950d6a3 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:20.104723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:20.105864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:20.106349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:20.106824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:20.114081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:20.119989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:20.305250 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1766/3517] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:19 2022] POST /identity/v3/users => generated 323 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:20.306571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:20.324526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2456b-4e8d-4c86-b414-ba206220be5c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:20.353676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:20.354214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:20.354527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:20.354806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:20.406354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=55d92e1d9e8746bb80b4af70831c6f00)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:20.414757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:20.566062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1752/3518] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:28:20 2022] PUT /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:20.571371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:20.590905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093298-8da1-422e-aa3e-e3446f46d278 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:20.792142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:20.793626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:20.798786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:20.798786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:20.801835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:20.807794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:21.266617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1767/3519] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:20 2022] POST /identity/v3/users => generated 321 bytes in 696 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:21.270979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:21.298215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321bfe-5eb2-4832-874f-055bd414226c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:21.312671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:21.332335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:21.332335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:21.332335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:21.366314 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:21.379140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=0d97e9f470ac4aadab92608cdf8e7d10)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:21.390221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:21.801321 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1753/3520] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:28:21 2022] PUT /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:21.805893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:21.841263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c73e9-3efb-4c51-b66e-20792b20cdbd tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:22.046937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:22.047613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:22.047901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:22.048213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:22.052800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=8b196491ad66476dbb46103cdffdab98)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:22.060128 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:22.060128 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:22.060128 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:22.060128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:22.060128 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:22.113961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1768/3521] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:28:21 2022] GET /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users => generated 1083 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:22.118058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:22.148190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f2e1-18c0-40f9-bdc0-577c82c5bf2e tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:22.161518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:22.162721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:22.163768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:22.164303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:22.166620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=9fc5f5ed872649a09e4d4ead09b7e357)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:22.168027 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:22.168027 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:22.168027 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:22.169847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:22.194669 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1754/3522] 10.222.0.13 () {58 vars in 1342 bytes} [Sun Oct 30 01:28:22 2022] HEAD /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:22.198254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:22.213420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df867a-aea8-48cd-b262-b3f840f80d6b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:22.227943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:22.230193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:22.230193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:22.230193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:22.232612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=9fc5f5ed872649a09e4d4ead09b7e357)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:22.237025 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:22.237025 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:22.237025 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:22.238470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:22.395696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:22.495787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1769/3523] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:28:22 2022] DELETE /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/9fc5f5ed872649a09e4d4ead09b7e357 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:22.500825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:22.529749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5979d2-5eee-4de2-a3d1-2b4a10c16132 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:22.702159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:22.703540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:22.704051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:22.705089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:22.708977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=55d92e1d9e8746bb80b4af70831c6f00)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:22.712368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:22.736723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1755/3524] 10.222.0.13 () {58 vars in 1342 bytes} [Sun Oct 30 01:28:22 2022] HEAD /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:22.740462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:22.759642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64f76-e717-4cc4-b6ff-a648a65f015c tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:22.783714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:22.784395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:22.784673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:22.784945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:22.795120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=55d92e1d9e8746bb80b4af70831c6f00)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:22.798550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:22.870128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:22.989024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1770/3525] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:28:22 2022] DELETE /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/55d92e1d9e8746bb80b4af70831c6f00 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:22.989252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:23.007082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a41d1-b531-40ea-9963-e09949d2c537 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:23.181913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:23.182096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:23.182385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:23.182679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:23.196856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=0d97e9f470ac4aadab92608cdf8e7d10)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:23.214546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:23.295856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1756/3526] 10.222.0.13 () {58 vars in 1342 bytes} [Sun Oct 30 01:28:22 2022] HEAD /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:23.305463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:23.316031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bcd9e-a56f-4b99-8195-9a6892817f66 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:23.330979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:23.331808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:23.332212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:23.332590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:23.335241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8b196491ad66476dbb46103cdffdab98, user_id=0d97e9f470ac4aadab92608cdf8e7d10)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:23.343232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:23.424256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:23.551328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:23.553411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1771/3527] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:28:23 2022] DELETE /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users/0d97e9f470ac4aadab92608cdf8e7d10 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:23.580527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ce764-195c-49d9-92ca-29203ec4c2c1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:23.733098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:23.734373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:23.734828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:23.735313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:23.737840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=8b196491ad66476dbb46103cdffdab98)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:23.744060 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:23.744060 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:23.744060 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:23.746622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:23.804417 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1757/3528] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:28:23 2022] GET /identity/v3/groups/8b196491ad66476dbb46103cdffdab98/users => generated 145 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:23.808179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:23.821558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abe495-3ede-4cc0-b382-00a0db8d349a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:23.832298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:23.835391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:23.838107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:23.838698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users/0d97e9f470ac4aadab92608cdf8e7d10` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:23.841930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0d97e9f470ac4aadab92608cdf8e7d10)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:23.845398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:24.018931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.104304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.105042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.148143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.158998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d97e9f470ac4aadab92608cdf8e7d10'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.171669 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1772/3529] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:23 2022] DELETE /identity/v3/users/0d97e9f470ac4aadab92608cdf8e7d10 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:24.173694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:24.183085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:24.198990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734cca-eb86-4acf-b9d9-c2a0e9e02c55 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:24.350427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:24.351623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:24.352862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:24.353944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users/55d92e1d9e8746bb80b4af70831c6f00` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:24.358566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_user(user_id=55d92e1d9e8746bb80b4af70831c6f00)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:24.364352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:24.444633 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:24.555932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.558531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.571456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.572702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.678705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d92e1d9e8746bb80b4af70831c6f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:24.707264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1758/3530] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:24 2022] DELETE /identity/v3/users/55d92e1d9e8746bb80b4af70831c6f00 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:24.712163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:24.732278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721364e2-4dae-4dbd-bed1-4e59e21012d6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:24.939586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:24.946236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:24.947469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:24.949779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users/9fc5f5ed872649a09e4d4ead09b7e357` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:24.955081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9fc5f5ed872649a09e4d4ead09b7e357)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:24.960425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:24.969934 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:25.161798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:25.249718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:25.251879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:25.278278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:25.291562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc5f5ed872649a09e4d4ead09b7e357'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:25.305031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:25.305603 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1773/3531] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:24 2022] DELETE /identity/v3/users/9fc5f5ed872649a09e4d4ead09b7e357 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:25.306510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:25.320962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f35d5-7a64-4953-af4a-134282ed4570 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:25.387147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:25.387713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:25.388095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:25.388402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8b196491ad66476dbb46103cdffdab98` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:25.389724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8b196491ad66476dbb46103cdffdab98)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:25.390903 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:25.390903 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:25.390903 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:25.392451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:25.519307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:25.519454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1759/3532] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:25 2022] DELETE /identity/v3/groups/8b196491ad66476dbb46103cdffdab98 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:25.520556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:25.543206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671dea1-4d2a-47ff-be68-e91ec613fc9b tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:25.698669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:25.700409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:25.705538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:25.705538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:25.705538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:25.705538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:25.828590 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1774/3533] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:25 2022] POST /identity/v3/groups => generated 326 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:25.833304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:25.845875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd6f1c-0f62-41bf-977e-1f05ec761863 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:25.853146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:25.854259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:25.854984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:25.855483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:25.856532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:25.858999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:25.972114 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1760/3534] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:25 2022] POST /identity/v3/groups => generated 325 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:25.972246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:25.999946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fe8b5-a078-4bd1-bf3a-83c0599c2ce0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:26.019786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:26.022125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:26.022653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:26.023275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:26.025546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:26.033833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:26.201573 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1775/3535] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:25 2022] POST /identity/v3/groups => generated 326 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:26.202199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:26.214857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc152f-0969-4c82-af1f-4508b83ca8c6 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:26.221679 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:26.223986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:26.225232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:26.226338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:26.227116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:26.227955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:26.229825 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:26.229825 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:26.229825 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:26.231068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:26.243728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1761/3536] 10.222.0.13 () {58 vars in 1125 bytes} [Sun Oct 30 01:28:26 2022] GET /identity/v3/groups => generated 1487 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:26.247147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:26.265045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5d89-ffef-4288-9394-2b0227b6f29a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:26.281213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:26.283394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:26.284514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:26.285570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/8f39dfa4ed96479c8d733615c0270ccb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:26.300233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8f39dfa4ed96479c8d733615c0270ccb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:26.306748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:26.524554 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1776/3537] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:26 2022] DELETE /identity/v3/groups/8f39dfa4ed96479c8d733615c0270ccb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:26.528413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:26.543757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18465fc9-c4ec-47f1-920c-f1eea079b83a tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:26.746307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:26.747287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:26.747733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:26.748567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/cd8952254cfc4e7193d6bb62d1095673` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:26.770112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cd8952254cfc4e7193d6bb62d1095673)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:26.772072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:26.988313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1762/3538] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:26 2022] DELETE /identity/v3/groups/cd8952254cfc4e7193d6bb62d1095673 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:26.989504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:27.012981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d17072-90ce-4d4f-8285-a7de847daf51 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:27.218607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:27.222296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:27.222904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:27.223312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/b1a1755732cf4683a186ba9cfba1155c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:27.251925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b1a1755732cf4683a186ba9cfba1155c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:27.254252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:27.383778 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:27.493993 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1777/3539] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:26 2022] DELETE /identity/v3/groups/b1a1755732cf4683a186ba9cfba1155c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:27.499977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:27.524012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5bf99-3b1e-4019-a3ae-8fa064858d30 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:27.670562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:27.672275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:27.672812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:27.673300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:27.674186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:27.679956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:27.798878 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1763/3540] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:27 2022] POST /identity/v3/users => generated 321 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:27.801273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:27.838303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b66059-80cf-4a36-a83b-0b5023e8f298 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:27.873101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:27.873322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:27.876886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:27.877597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:27.883022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:27.888971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201635f-53ae-4607-8f52-80da5a3cba46 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:28.007656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1778/3541] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:27 2022] POST /identity/v3/groups => generated 325 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:28.011505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:28.039302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbe27-3773-4075-84f1-3ecd678faae0 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:28.054494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:28.055179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:28.055469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:28.055747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/feb32540589a4cd5bf0b720a42c63445/users/165a212f241740d2b07fdb38794173e5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:28.125665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=feb32540589a4cd5bf0b720a42c63445, user_id=165a212f241740d2b07fdb38794173e5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:28.127329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:28.281485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:28.293975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:28.293975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:28.334595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1764/3542] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:28:28 2022] PUT /identity/v3/groups/feb32540589a4cd5bf0b720a42c63445/users/165a212f241740d2b07fdb38794173e5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:28.337038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:28.408660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:28.410414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:28.565846 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:28.585519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a88b9-e57c-49b4-86fa-25c66c9e4227 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:28.597147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:28.599330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:28.599791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:28.600815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:28.602416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:28.606412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:28.609868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1779/3543] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:28.647677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:28.649379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:28.773535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1765/3544] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:28:28 2022] POST /identity/v3/groups => generated 327 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:28.774727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:28.820770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd906586-d8ee-4d6c-8ed4-fc0fe5903b82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:28.842163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:28.847982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:28.847982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:28.847982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/fbfc11d46dcb463695a8f4bc90629b02/users/165a212f241740d2b07fdb38794173e5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:28.852528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57742f20-1be8-4e28-bf6e-b7dd87e28b92 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:28.856265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fbfc11d46dcb463695a8f4bc90629b02, user_id=165a212f241740d2b07fdb38794173e5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:28.861549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:28.878175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:28.884479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:28.884479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:28.884479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:28.917722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:28.927140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:28.964886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1780/3545] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:28:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:28:29.066011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1766/3546] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:28:28 2022] PUT /identity/v3/groups/fbfc11d46dcb463695a8f4bc90629b02/users/165a212f241740d2b07fdb38794173e5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:29.066732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:29.084688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bed08-8b77-4d81-88bf-43061ddfdf67 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:29.269981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:29.271201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:29.271671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:29.271952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users/165a212f241740d2b07fdb38794173e5/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:29.273884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=165a212f241740d2b07fdb38794173e5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:29.277345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:29.321757 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1781/3547] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:28:29 2022] GET /identity/v3/users/165a212f241740d2b07fdb38794173e5/groups => generated 838 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:29.325916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:29.370829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc1fba-5c84-4254-b1a0-860957b320d1 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:29.392472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:29.394125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:29.395214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:29.396374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/fbfc11d46dcb463695a8f4bc90629b02` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:29.399419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fbfc11d46dcb463695a8f4bc90629b02)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:29.425435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:29.628515 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:29.666809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1767/3548] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:29 2022] DELETE /identity/v3/groups/fbfc11d46dcb463695a8f4bc90629b02 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:29.671496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:29.684320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c99407-5720-4c1f-8291-952ebbcbaec5 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:29.909861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:29.910824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:29.912738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:29.913273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/groups/feb32540589a4cd5bf0b720a42c63445` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:29.916623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_group(group_id=feb32540589a4cd5bf0b720a42c63445)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:29.926660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:30.100014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1782/3549] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:28:29 2022] DELETE /identity/v3/groups/feb32540589a4cd5bf0b720a42c63445 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:30.104802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:30.117205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e096f-c75b-4438-b86e-5ae44e3f1f82 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:30.294585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:30.297599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:30.297883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:30.301067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/users/165a212f241740d2b07fdb38794173e5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:30.318294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_user(user_id=165a212f241740d2b07fdb38794173e5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:30.331403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:30.496970 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:30.639751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165a212f241740d2b07fdb38794173e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:30.641994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165a212f241740d2b07fdb38794173e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:30.667931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165a212f241740d2b07fdb38794173e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:30.669615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165a212f241740d2b07fdb38794173e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:30.760816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165a212f241740d2b07fdb38794173e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:30.807918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:30.808105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1768/3550] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:30 2022] DELETE /identity/v3/users/165a212f241740d2b07fdb38794173e5 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:30.811320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:30.853598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22bace-d937-4547-9ebf-6043a548cdff tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:31.018393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:31.018393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:31.018393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:31.018708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/domains/1379b30efd7f42b4bfaa5b998104e3c0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:31.019463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1379b30efd7f42b4bfaa5b998104e3c0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:31.020619 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:31.020619 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:31.020619 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:31.024697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:31.080554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.083108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.151880 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:31.206750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.208140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5d636e77-956d-405c-bea8-9d44b687bab7 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.215723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1783/3551] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:28:30 2022] PATCH /identity/v3/domains/1379b30efd7f42b4bfaa5b998104e3c0 => generated 276 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:31.219385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:31.234050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca898b02-4a66-4213-9a31-2b4abc5f5b23 tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:31.249778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:31.250493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:31.250918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:31.310589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] MFA Rules not processed for user `f857d6b0826e47c6875a307e7ccfb104`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:31.311811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:31.470578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1de2d4724e4119ac0e35cfb7800c2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f3cc175bd684ded8ef300955e410b8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:31.472107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:31.473829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:31.474104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] PATH_INFO: `/v3/domains/1379b30efd7f42b4bfaa5b998104e3c0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:31.569685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1379b30efd7f42b4bfaa5b998104e3c0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:31.573433 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:31.573433 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:31.573433 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:31.576379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:31.591905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1784/3552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:28:31.629416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.638540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.720156 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:31.850601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.860517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:31.984644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.005774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] The token cache is being invalidate because project 1379b30efd7f42b4bfaa5b998104e3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:32.006078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.007494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.073468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.095086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.096325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2474e72-c109-4efb-95a1-ebe8628a49ba tempest-GroupsV3TestJSON-1987281385 tempest-GroupsV3TestJSON-1987281385-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1379b30efd7f42b4bfaa5b998104e3c0', 'request_id': 'req-a2474e72-c109-4efb-95a1-ebe8628a49ba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.119599 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1769/3553] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:28:31 2022] DELETE /identity/v3/domains/1379b30efd7f42b4bfaa5b998104e3c0 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:32.121132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:32.125460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:32.329033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbb0e3-8db6-4ff1-a3dc-9d85014106d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:32.461305 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:32.488416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:32.489142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:32.489358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:32.489633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] PATH_INFO: `/v3/users/8031b9bd49474f5496b4ebe7870a4e98` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:32.493757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8031b9bd49474f5496b4ebe7870a4e98)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:32.506580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:32.844553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8031b9bd49474f5496b4ebe7870a4e98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.944667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8031b9bd49474f5496b4ebe7870a4e98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.945515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8031b9bd49474f5496b4ebe7870a4e98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.969139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8031b9bd49474f5496b4ebe7870a4e98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.985232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8031b9bd49474f5496b4ebe7870a4e98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:32.999950 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1785/3554] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:32 2022] DELETE /identity/v3/users/8031b9bd49474f5496b4ebe7870a4e98 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:33.004682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:33.005188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:33.005461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:33.080756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:33.089623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:33.221464 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1770/3555] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:33.338134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:33.340791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:33.503688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dc5d6-a935-4466-9c57-a77b5d72e7fc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:33.514361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:33.515188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:33.516521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:33.516521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:33.553100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:33.568001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:33.622584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1786/3556] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:35.373327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:35.376790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:35.427185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f24a9-51d3-4231-b2f9-52c0c00a219f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:35.459470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:35.461757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:35.462486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:35.465490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] PATH_INFO: `/v3/projects/05838823b66b4ee18f111f30e4f8df12` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:35.470190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05838823b66b4ee18f111f30e4f8df12)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:35.488564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:35.765895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05838823b66b4ee18f111f30e4f8df12', 'request_id': 'req-05a708c9-6e55-44ab-bdda-2a52d0a92443'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:35.782520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05838823b66b4ee18f111f30e4f8df12', 'request_id': 'req-05a708c9-6e55-44ab-bdda-2a52d0a92443'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:35.894153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05838823b66b4ee18f111f30e4f8df12', 'request_id': 'req-05a708c9-6e55-44ab-bdda-2a52d0a92443'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:35.946920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] The token cache is being invalidate because project 05838823b66b4ee18f111f30e4f8df12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:35.947223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:35.950715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:35.958242 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1771/3557] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:35 2022] DELETE /identity/v3/projects/05838823b66b4ee18f111f30e4f8df12 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:35.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:35.976990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f203504-6c32-46ee-ba5e-57acf7e12a91 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:36.284247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:36.285197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:36.285706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:36.286141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] PATH_INFO: `/v3/users/5d1de2d4724e4119ac0e35cfb7800c2a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:36.303296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1de2d4724e4119ac0e35cfb7800c2a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:36.307192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:36.391157 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:36.630715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:36.632951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:36.644281 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:36.672632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1de2d4724e4119ac0e35cfb7800c2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:36.806754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a708c9-6e55-44ab-bdda-2a52d0a92443 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:36.815759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:36.816817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:36.816941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1de2d4724e4119ac0e35cfb7800c2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:36.817493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:36.817635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1de2d4724e4119ac0e35cfb7800c2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:36.827570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:36.834756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:36.859446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1de2d4724e4119ac0e35cfb7800c2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:36.919742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1c7f945-a124-4f06-8331-d5fdba1fbcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1de2d4724e4119ac0e35cfb7800c2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:36.944390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1787/3558] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:35 2022] DELETE /identity/v3/users/5d1de2d4724e4119ac0e35cfb7800c2a => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:37.037594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:37.039564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:37.059432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1772/3559] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:28:37.265964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:37.266485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:37.266595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:37.327321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] MFA Rules not processed for user `6b3394f28c4f444f8cd8bda6bacc9fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:37.328592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:37.499197 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1788/3560] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:37.550150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:37.551801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:37.583999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530af3-eb37-4697-a0ac-a9c94d597686 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:37.760644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:37.760644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:37.866441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:37.867127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:37.867409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:37.867677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] PATH_INFO: `/v3/users/3478222ab7f24587a53f4deb83753957` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:37.874231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3478222ab7f24587a53f4deb83753957)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:37.885826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:38.043208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7692729-d95b-4e99-aab1-2ba0e1f555eb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:38.068714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:38.070675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:38.073724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:38.073994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:38.108150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:38.126609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:38.170933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1789/3561] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:38.195857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3478222ab7f24587a53f4deb83753957'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:38.206034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3478222ab7f24587a53f4deb83753957'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:38.231979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3478222ab7f24587a53f4deb83753957'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:38.243332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3478222ab7f24587a53f4deb83753957'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:38.348775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9eee02c9-c457-41d2-858f-1231911c6e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3478222ab7f24587a53f4deb83753957'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:38.418569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1773/3562] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:37 2022] DELETE /identity/v3/users/3478222ab7f24587a53f4deb83753957 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:38.571480 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:39.041506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:39.043096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:39.071576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef4d17-1856-4fd9-8c8a-43da75145371 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:39.071576 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:39.222355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:39.223010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:39.223288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:39.223549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] PATH_INFO: `/v3/projects/6f3cc175bd684ded8ef300955e410b8f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:39.227037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3cc175bd684ded8ef300955e410b8f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:39.230191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:39.397663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3cc175bd684ded8ef300955e410b8f', 'request_id': 'req-6338fa07-5370-4212-99bf-e4c05e692596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:39.475310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3cc175bd684ded8ef300955e410b8f', 'request_id': 'req-6338fa07-5370-4212-99bf-e4c05e692596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:39.486289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3cc175bd684ded8ef300955e410b8f', 'request_id': 'req-6338fa07-5370-4212-99bf-e4c05e692596'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:39.507520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] The token cache is being invalidate because project 6f3cc175bd684ded8ef300955e410b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:39.509160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:39.509160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6338fa07-5370-4212-99bf-e4c05e692596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:39.512150 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1790/3563] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:39 2022] DELETE /identity/v3/projects/6f3cc175bd684ded8ef300955e410b8f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:39.517564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:39.518392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:39.518672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:39.558678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:39.560148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:39.646041 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1774/3564] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:39.654752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:39.654752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:39.654752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:39.698693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:39.702712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:39.724803 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1791/3565] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:39.728854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:39.750984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0144e-981e-4552-9b23-6c4f141aa53a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:39.765134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:39.765886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:39.766274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:39.766673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:39.767763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:39.768021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:39.772775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:39.825386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1775/3566] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:39.828326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:39.844913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb323c-f025-4f2b-9529-6815886cc7ac None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:39.865017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:39.865801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:39.866083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:39.866354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:39.866996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:39.872004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:39.912388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:39.915768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:39.962410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019f8e2-d1c7-45e9-b4e1-95c4418a81ad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:39.999679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:40.000347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:40.000749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:40.000866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] PATH_INFO: `/v3/projects/87c92264dc354f548697879f5db3c70c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:40.002682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c92264dc354f548697879f5db3c70c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:40.004618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:40.404959 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1792/3567] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:39 2022] POST /identity/v3/projects => generated 377 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:40.408828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:40.639407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b67f2-a730-4a32-bcc3-81e4b1c9a799 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:40.659782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:40.660408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:40.663278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:40.663278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:40.663278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:40.663561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:40.857641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c92264dc354f548697879f5db3c70c', 'request_id': 'req-0f01eb64-6b34-423c-86aa-147edc360808'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:40.882470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c92264dc354f548697879f5db3c70c', 'request_id': 'req-0f01eb64-6b34-423c-86aa-147edc360808'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:40.914223 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1793/3568] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:40 2022] POST /identity/v3/users => generated 289 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:40.923611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:40.956642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505c9f7-b0ea-41e7-a020-e3509e453eee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.085836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c92264dc354f548697879f5db3c70c', 'request_id': 'req-0f01eb64-6b34-423c-86aa-147edc360808'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:41.124129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.125696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.129950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.129950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.129950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.129950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:41.147257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] The token cache is being invalidate because project 87c92264dc354f548697879f5db3c70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:41.157838 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1794/3569] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:41.161712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:41.161712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f01eb64-6b34-423c-86aa-147edc360808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:41.163510 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1776/3570] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:39 2022] DELETE /identity/v3/projects/87c92264dc354f548697879f5db3c70c => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:41.164584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.170471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2324-3bc9-4a5f-a788-aca8d80198fe None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.171362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2324-3bc9-4a5f-a788-aca8d80198fe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.171742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2324-3bc9-4a5f-a788-aca8d80198fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.174325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:41.207502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-afbc2324-3bc9-4a5f-a788-aca8d80198fe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:41.209885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afbc2324-3bc9-4a5f-a788-aca8d80198fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:41.231985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740d382-8d58-436e-8ae4-eecb7da87197 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.237547 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1777/3571] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:41.239223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.242949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.243543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.255942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.256635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.256915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.265854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.270905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.277093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:41.301525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:41.314727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:41.318842 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1795/3572] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:41.323514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.346843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1778/3573] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:41.347880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.361285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b258b6-5ae6-4d0b-87cd-208963de2d42 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.363740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6aa79-4e1e-4aeb-8f8e-fb11d18e80bf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.382373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.383000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.383278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.383552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.384206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:41.388434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.391352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:41.391475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.391665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.391922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.392221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] PATH_INFO: `/v3/projects/63ebf1181a934857a14c221122e13c6d/users/fb2dc8d25ae74b50a13c07fc7dbd652f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.453761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ebf1181a934857a14c221122e13c6d, user_id=fb2dc8d25ae74b50a13c07fc7dbd652f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.455725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1779/3574] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:41.460131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aabe52-bc60-4a04-9827-2166452fb854 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:41.461273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.507301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8e65-fd6d-43e1-ad48-be1bb0d1c1c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.531607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.532277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.538221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.544881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.544881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.544881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:41.568496 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:41.591135 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1796/3575] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:41 2022] PUT /identity/v3/projects/63ebf1181a934857a14c221122e13c6d/users/fb2dc8d25ae74b50a13c07fc7dbd652f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:41.592680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.592966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.593236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.686948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] MFA Rules not processed for user `fb2dc8d25ae74b50a13c07fc7dbd652f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:41.686948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:41.742962 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1780/3576] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:41.747737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.889022 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:41.928337 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1797/3577] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:41.934513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:41.956157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609863a1-e2f1-4169-ac5c-d4d284ce191d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:41.963550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:41.964179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:41.964458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:41.964740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:41.965391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:41.967385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.109026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1781/3578] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/users => generated 284 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:42.114195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:42.140846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27081e-dced-489c-9b48-03ceb3d3d78f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.141094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45f3c-9d42-4c4f-9ec9-d2bb6b19ec85 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.154419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.155055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.155338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.155612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.156829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.162950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.164148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.166744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.168458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.169127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.173211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.185555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.188976 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1782/3579] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:42.190469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:42.226805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05227-319a-4dd3-80d6-0064eb2e50fd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.251134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.251765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.252043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.252319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.252968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.254606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.290171 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1783/3580] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:42.297376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:42.318181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7454c-638a-4e0c-9aad-55cf34ed6da0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.326553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1798/3581] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:41 2022] POST /identity/v3/projects => generated 377 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:42.330633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:42.332799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.332799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.332799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.332799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] PATH_INFO: `/v3/projects/45fe1c50eaee40249b6c20cc91e52586/users/ef5f8a3e6fef4d6393603575479b16a2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.379910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe1c50eaee40249b6c20cc91e52586, user_id=ef5f8a3e6fef4d6393603575479b16a2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.382718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3d872-5952-42e5-a5af-e1074b357de9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.461558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6860f-ec9e-41be-8053-d3325aad38e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.475197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.475835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.476898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.477178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.478152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.483127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.498733 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1784/3582] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:42 2022] PUT /identity/v3/projects/45fe1c50eaee40249b6c20cc91e52586/users/ef5f8a3e6fef4d6393603575479b16a2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:42.503869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.504148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.504425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.568211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:42.569805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:42.724048 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1785/3583] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:28:42.750820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:42.761217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:42.916541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5301d-2fdb-4ca6-b4eb-0be6b76e797e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:42.922103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:42.922730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:42.923007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:42.923279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:42.947398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:42.948835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:42.968961 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1786/3584] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:43.373224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:43.380466 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1799/3585] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:42 2022] POST /identity/v3/users => generated 295 bytes in 1048 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:43.385667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56b2d-5dd1-499b-9a71-d1341278b943 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:43.391234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:43.391912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:43.392341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:43.392718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:43.393605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:43.395431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:43.430684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:43.431802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1787/3586] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:43.445496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739b6a-fe51-4f5d-9024-de77fb21e60c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:43.457662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:43.458837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:43.461987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:43.463478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] PATH_INFO: `/v3/projects/43fa81be4e534d04844846905ae11122/users/0cedf9324a1a4b4b8129de1bc0695be9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:43.501549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fa81be4e534d04844846905ae11122, user_id=0cedf9324a1a4b4b8129de1bc0695be9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:43.510913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:43.630317 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1800/3587] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:43 2022] PUT /identity/v3/projects/43fa81be4e534d04844846905ae11122/users/0cedf9324a1a4b4b8129de1bc0695be9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:43.634023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:43.652863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc728d-e370-4a63-9d74-6e3b086340df admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:43.694969 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:43.833005 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:43.860111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:43.860732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:43.861006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:43.861276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:43.861951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:43.863609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82958-9795-4d42-aabc-1dd52a7cfa1e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:43.918189 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1788/3588] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:43.922860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:43.939573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c78d2-6a5a-42bb-b519-e720030ee1f9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:43.952939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:43.954339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:43.954907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:43.955366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] PATH_INFO: `/v3/projects/43fa81be4e534d04844846905ae11122/users/0cedf9324a1a4b4b8129de1bc0695be9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:43.961312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fa81be4e534d04844846905ae11122, user_id=0cedf9324a1a4b4b8129de1bc0695be9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:43.965261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:43.998140 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1801/3589] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:43 2022] PUT /identity/v3/projects/43fa81be4e534d04844846905ae11122/users/0cedf9324a1a4b4b8129de1bc0695be9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:44.010205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.011181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.011609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.066770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] MFA Rules not processed for user `0cedf9324a1a4b4b8129de1bc0695be9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:44.068340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:44.168122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1789/3590] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:44.169207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.185806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b14e5e-4380-42d0-a4b8-846dc2805921 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.194149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.195176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.195667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.196185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.198165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.199647 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.199647 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:44.199647 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:44.200965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.319373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1802/3591] 10.222.0.13 () {60 vars in 1185 bytes} [Sun Oct 30 01:28:44 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:44.324293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.338468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb436248-3515-481d-b04a-59cf1e88ee8d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.344642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.357558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.357890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.358174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87f3734080b74dc99503325dfbc28f50` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.360515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=87f3734080b74dc99503325dfbc28f50)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.362311 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.362311 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:44.362311 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:44.367376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.382332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1790/3592] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:28:44 2022] GET /identity/v3/OS-OAUTH1/consumers/87f3734080b74dc99503325dfbc28f50 => generated 219 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:44.386427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.397830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e112f8-93e4-42fa-a401-5fc370a8b21d tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.405604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.407317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.407801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.408367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87f3734080b74dc99503325dfbc28f50` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.409165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=87f3734080b74dc99503325dfbc28f50)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.410578 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.410578 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:44.410578 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:44.411905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.412453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer 87f3734080b74dc99503325dfbc28f50 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:44.412933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:44.413915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:44.540827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '87f3734080b74dc99503325dfbc28f50', 'request_id': 'req-070a0094-9ddd-47a3-afb9-e065c35808ad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:44.700603 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1803/3593] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:44 2022] DELETE /identity/v3/OS-OAUTH1/consumers/87f3734080b74dc99503325dfbc28f50 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:44.705699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.707523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:44.731806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6869a-6e67-4eaa-b6e7-95aeef8d93fd tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.752089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.752480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.752767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.753044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.753729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.754802 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.754802 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:44.754802 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:44.755725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.856490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1791/3594] 10.222.0.13 () {60 vars in 1185 bytes} [Sun Oct 30 01:28:44 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:44.857866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.876065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a0094-9ddd-47a3-afb9-e065c35808ad tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.881858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.885345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.885345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.885345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.885345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=57723d2da2294095a04af2a574a098c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.894599 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.894599 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:28:44.894599 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:28:44.896060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.903795 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1804/3595] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:28:44 2022] GET /identity/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2 => generated 221 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:44.907960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:44.924174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45ccf5-9196-4747-976c-4413862363ec tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:44.934758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:44.935671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:44.936139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:44.936586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:44.937412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=57723d2da2294095a04af2a574a098c2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:44.938605 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:44.938605 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:44.938605 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:44.941599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:44.942492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer 57723d2da2294095a04af2a574a098c2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:44.948299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:44.949262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.061829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '57723d2da2294095a04af2a574a098c2', 'request_id': 'req-ea5def63-f977-4527-b7bd-acd4e4b00aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.067077 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:45.166779 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1792/3596] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:44 2022] DELETE /identity/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:45.170952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.173003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:45.195890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fc5cd-15e8-4449-aa23-08c6bdf4435f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.206002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.206993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.207860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.208380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.209207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=57723d2da2294095a04af2a574a098c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.211074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 30 01:28:45.232290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 30 01:28:45.233532 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:28:45.239994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1805/3597] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:28:45 2022] GET /identity/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2 => generated 74 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 01:28:45.245072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.266245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5def63-f977-4527-b7bd-acd4e4b00aca tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.281593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.281593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.281593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.281913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.283127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=57723d2da2294095a04af2a574a098c2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.286799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.288137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer 57723d2da2294095a04af2a574a098c2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:45.289077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.293139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 30 01:28:45.326535 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 30 01:28:45.327965 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:28:45.333552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1793/3598] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:45 2022] DELETE /identity/v3/OS-OAUTH1/consumers/57723d2da2294095a04af2a574a098c2 => generated 74 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 01:28:45.338645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.338645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:45.362428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5612a9a-68c8-43de-abcc-8f32cd9d7e99 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.373472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.374192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.374564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.375370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.375469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.380930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.409100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.410800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:45.470095 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1806/3599] 10.222.0.13 () {60 vars in 1185 bytes} [Sun Oct 30 01:28:45 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:45.471002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.491020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407e908-3e57-4b13-8f6d-b3440f839565 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.503301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.504456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.506119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.506782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.508019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.512305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.557834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e9206-cc12-40b3-aee5-e0d4c8aa61a3 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.563407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.564577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.565056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.565618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.567906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:45.596523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.598201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.619485 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1794/3600] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:28:45.655893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.656472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1807/3601] 10.222.0.13 () {60 vars in 1185 bytes} [Sun Oct 30 01:28:45 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:45.686545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c69d1-c3f7-41af-a0d5-c5cf93b7ecf4 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.704266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.705947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.707098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.707870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.711221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.715624 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:45.715624 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:45.715624 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:45.718569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.749699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:45.755435 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=10,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:45.761262 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1795/3602] 10.222.0.13 () {58 vars in 1164 bytes} [Sun Oct 30 01:28:45 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:45.766438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427cbe2-b8cd-4eaf-9bc9-b2bedf11a808 tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:45.779269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:45.779941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:45.780223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:45.780498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e68d836041d246cc99c24dc7ac7d0cb2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:45.786133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e68d836041d246cc99c24dc7ac7d0cb2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:45.787780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:45.788048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer e68d836041d246cc99c24dc7ac7d0cb2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:45.788342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.793409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:45.900361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e68d836041d246cc99c24dc7ac7d0cb2', 'request_id': 'req-517ce531-744e-445e-9598-2664be431a2e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.027925 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1808/3603] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:45 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e68d836041d246cc99c24dc7ac7d0cb2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:46.032206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:46.034844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:46.068283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decb55e-f38d-43e4-afcf-a29c3d26e68f tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:46.085059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:46.088994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.091716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.092212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/48e8c058a04e4df8b2a9fbdda6760536` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.094204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=48e8c058a04e4df8b2a9fbdda6760536)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:46.100394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:46.101044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer 48e8c058a04e4df8b2a9fbdda6760536 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:46.102169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.104896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.219215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '48e8c058a04e4df8b2a9fbdda6760536', 'request_id': 'req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.384963 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1796/3604] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:46 2022] DELETE /identity/v3/OS-OAUTH1/consumers/48e8c058a04e4df8b2a9fbdda6760536 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:46.392021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:46.422601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ce531-744e-445e-9598-2664be431a2e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:46.439800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:46.440900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.441735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.442293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.443087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:46.448812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:46.558771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1809/3605] 10.222.0.13 () {60 vars in 1185 bytes} [Sun Oct 30 01:28:46 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:46.562541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:46.564011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:46.602115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c47b72-2e9d-46ab-a401-bb25103bd5dc tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:46.616612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:46.617855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.618149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.618430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.619106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=e438ac7f87d54bed9943d4a9d85e5831)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:46.620121 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:28:46.620121 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:28:46.620121 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:28:46.621031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:46.792215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1797/3606] 10.222.0.13 () {60 vars in 1285 bytes} [Sun Oct 30 01:28:46 2022] PATCH /identity/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831 => generated 220 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:46.793535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:46.814205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6db5-5814-495d-ae95-8d583f399a9e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:46.822665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:46.823605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.824056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.824494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.825525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=e438ac7f87d54bed9943d4a9d85e5831)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:46.830699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1fd82-fac2-48f6-8b3d-0fbb2ed4bcfb tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:46.837279 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1810/3607] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:28:46 2022] GET /identity/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831 => generated 220 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:28:46.841187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:46.854934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e7dbe-397a-43aa-af88-07ec9087c98e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:46.862469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cedf9324a1a4b4b8129de1bc0695be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fa81be4e534d04844846905ae11122', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:46.863853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.864309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.864844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.865664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e438ac7f87d54bed9943d4a9d85e5831)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:46.868938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:46.869515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invalidating token cache because consumer e438ac7f87d54bed9943d4a9d85e5831 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:46.870008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.876772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:46.877172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:46.877879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:46.882068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:46.908356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] MFA Rules not processed for user `6b3394f28c4f444f8cd8bda6bacc9fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:46.909645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:46.965251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e tempest-OAUTHConsumersV3Test-1203544662 tempest-OAUTHConsumersV3Test-1203544662-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e438ac7f87d54bed9943d4a9d85e5831', 'request_id': 'req-f0ecebe4-7f7c-4ef2-aea5-3faca818d20e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.005049 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1811/3608] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:47.063082 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1798/3609] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:28:46 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e438ac7f87d54bed9943d4a9d85e5831 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:47.068694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:47.070355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:47.261267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ee214-23fd-4749-9d53-529bc1e6e87e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:47.267230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:47.268062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:47.268577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:47.269009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] PATH_INFO: `/v3/users/fb2dc8d25ae74b50a13c07fc7dbd652f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:47.271458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2dc8d25ae74b50a13c07fc7dbd652f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:47.282296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:47.322873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9e2d-79ea-44d5-afda-c79bd1cecb46 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:47.323419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9e2d-79ea-44d5-afda-c79bd1cecb46 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:47.323419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca9e2d-79ea-44d5-afda-c79bd1cecb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:47.388869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4bca9e2d-79ea-44d5-afda-c79bd1cecb46 None None] MFA Rules not processed for user `a4fff27847f74c39b425dba724cf847f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:47.392185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4bca9e2d-79ea-44d5-afda-c79bd1cecb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:47.545478 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1799/3610] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:47.558704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2dc8d25ae74b50a13c07fc7dbd652f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.696127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2dc8d25ae74b50a13c07fc7dbd652f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.696968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2dc8d25ae74b50a13c07fc7dbd652f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.720039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2dc8d25ae74b50a13c07fc7dbd652f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.736424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2dc8d25ae74b50a13c07fc7dbd652f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:47.747834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1812/3611] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:47 2022] DELETE /identity/v3/users/fb2dc8d25ae74b50a13c07fc7dbd652f => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:47.752065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:47.752604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:47.753047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:47.792997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:47.794537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:47.818639 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:47.950850 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1800/3612] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:48.017536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:48.019253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:48.152671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582cb9-0bf6-4d31-897c-91040cc6af9c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:48.161239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:48.162178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:48.165751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:48.165751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:48.177126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:48.179397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:48.191234 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1813/3613] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:48.294332 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:49.431029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:49.439376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:49.441374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:49.475418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422c42-eb3b-439a-8970-46b27250fff8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:49.505290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:49.507969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:49.519556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:49.519837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:49.520526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d929704-d8a7-496e-a118-c86fe9b90a6e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:49.531418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:49.550944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:49.551670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:49.551952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:49.552225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] PATH_INFO: `/v3/projects/63ebf1181a934857a14c221122e13c6d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:49.558121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ebf1181a934857a14c221122e13c6d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:49.561598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:49.804338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ebf1181a934857a14c221122e13c6d', 'request_id': 'req-b3366b6a-1e25-4306-9988-d2817abf1aef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:49.821459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:49.826613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:49.864647 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1801/3614] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:49.898338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ebf1181a934857a14c221122e13c6d', 'request_id': 'req-b3366b6a-1e25-4306-9988-d2817abf1aef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:49.908698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ebf1181a934857a14c221122e13c6d', 'request_id': 'req-b3366b6a-1e25-4306-9988-d2817abf1aef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:49.927826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] The token cache is being invalidate because project 63ebf1181a934857a14c221122e13c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:49.930123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:49.932124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:49.937099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1814/3615] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:49 2022] DELETE /identity/v3/projects/63ebf1181a934857a14c221122e13c6d => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:49.941429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:49.973215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96929a4e-b0b5-4349-9dd0-4a18aa0245d3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:50.230920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:50.232163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:50.233625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:50.233898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] PATH_INFO: `/v3/users/0cedf9324a1a4b4b8129de1bc0695be9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:50.240338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cedf9324a1a4b4b8129de1bc0695be9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:50.260226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:50.575855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cedf9324a1a4b4b8129de1bc0695be9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:50.577327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cedf9324a1a4b4b8129de1bc0695be9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:50.596833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cedf9324a1a4b4b8129de1bc0695be9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:50.599636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cedf9324a1a4b4b8129de1bc0695be9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:50.709990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccb79805-84ea-4543-9995-a0d06c4df0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cedf9324a1a4b4b8129de1bc0695be9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:50.749781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1802/3616] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:49 2022] DELETE /identity/v3/users/0cedf9324a1a4b4b8129de1bc0695be9 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:50.801484 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:52.311768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:52.313518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:52.338988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366b6a-1e25-4306-9988-d2817abf1aef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:52.442220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:52.442917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:52.443266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:52.443602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] PATH_INFO: `/v3/projects/43fa81be4e534d04844846905ae11122` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:52.445127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fa81be4e534d04844846905ae11122)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:52.447381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:52.454754 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:52.594156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fa81be4e534d04844846905ae11122', 'request_id': 'req-097991d8-5250-42ee-8d6e-5a1f3b056a6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:52.725675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fa81be4e534d04844846905ae11122', 'request_id': 'req-097991d8-5250-42ee-8d6e-5a1f3b056a6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:52.737310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fa81be4e534d04844846905ae11122', 'request_id': 'req-097991d8-5250-42ee-8d6e-5a1f3b056a6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:52.809210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] The token cache is being invalidate because project 43fa81be4e534d04844846905ae11122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:52.809976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:52.812635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-097991d8-5250-42ee-8d6e-5a1f3b056a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:52.817948 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1815/3617] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:52 2022] DELETE /identity/v3/projects/43fa81be4e534d04844846905ae11122 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:52.824095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:52.825458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:52.825938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:52.852492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:52.855121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:53.010921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1803/3618] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:53.013745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.016189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.016782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.047539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:53.049148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:53.059519 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1816/3619] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:28:53.064201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.082077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a508f0-fd75-49d0-b3e2-bab1fec51b5e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.093699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.094829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.095549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.096312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.098266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:53.099075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.100914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.124389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1804/3620] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:53.125146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.142459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b4a52-8231-4995-be2f-d84f4dcc72f5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.156785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.157823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.158331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.158841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.159711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.163221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.280543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1817/3621] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:53.284428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.317281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d2e02-c12e-48a7-b812-43a40415570d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.507389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.508826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.508826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.509225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.510045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.512242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.680936 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1805/3622] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:53 2022] POST /identity/v3/users => generated 287 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:53.685024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.698799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e6fb2-07d2-4157-a91b-29af72e5c4f1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.716520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.717256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.717558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.717831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.718485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.720086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.747449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1818/3623] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:53.751177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.764611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a9955-3359-4ec2-a6cb-615512deeae2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.772149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.773942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.773942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.773942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.774803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.776231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d1c65-b860-4632-9b25-7c6183b9a9e3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.794967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1806/3624] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:53.799204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:53.811772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715737-f1c9-46d8-b826-6539961755f5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:53.817776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:53.819434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.820599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.821086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] PATH_INFO: `/v3/projects/6a9e80d4100948a490cba2775394e42b/users/74d9c7ab8f4d470aa4018d2736b9f09b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:53.839426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9e80d4100948a490cba2775394e42b, user_id=74d9c7ab8f4d470aa4018d2736b9f09b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:53.842858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:53.971968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1819/3625] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:53 2022] PUT /identity/v3/projects/6a9e80d4100948a490cba2775394e42b/users/74d9c7ab8f4d470aa4018d2736b9f09b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:53.983238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:53.983783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:53.983783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:54.017316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] MFA Rules not processed for user `74d9c7ab8f4d470aa4018d2736b9f09b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:54.017316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:54.033521 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:54.104761 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1807/3626] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:54.109687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:54.137918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed158-5219-4f22-8472-6143db704b03 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:54.143381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:54.144811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:54.145287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:54.145751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:54.148064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:54.151356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:54.380814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1820/3627] 10.222.0.13 () {60 vars in 1299 bytes} [Sun Oct 30 01:28:54 2022] POST /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 367 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:54.382076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:54.398753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08527aa5-bcab-46fe-b52d-ace847f29434 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:54.405510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:54.406416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:54.406900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:54.407376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/1bb0985a9d5040759392802c37d84ddb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:54.409976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=1bb0985a9d5040759392802c37d84ddb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:54.411669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:54.515049 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1808/3628] 10.222.0.13 () {58 vars in 1380 bytes} [Sun Oct 30 01:28:54 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/1bb0985a9d5040759392802c37d84ddb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:54.518789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:54.536059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f1761-6d18-4565-b229-9d2c33a54042 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:54.548957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:54.549654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:54.549939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:54.550227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:54.550839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:54.552918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:54.791764 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1821/3629] 10.222.0.13 () {60 vars in 1299 bytes} [Sun Oct 30 01:28:54 2022] POST /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 367 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:54.796793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:54.812497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb773c0-fea1-4288-8df3-a408db7c2ac2 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:54.821727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:54.823305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:54.824977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:54.826450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/caa0d58d65224327b83007c4c634df39` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:54.832433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=caa0d58d65224327b83007c4c634df39)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:54.836554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.019025 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1809/3630] 10.222.0.13 () {58 vars in 1380 bytes} [Sun Oct 30 01:28:54 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/caa0d58d65224327b83007c4c634df39 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:55.024230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.034759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece561c-36ea-4dda-8129-77c0ff3e555d tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.040696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.042174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.042453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.042730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/caa0d58d65224327b83007c4c634df39` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Could not find credential: df30720208908334d7d654e389ab63b7ca8dd0c6af1cf01ff59bd795202b08a8.: keystone.exception.CredentialNotFound: Could not find credential: df30720208908334d7d654e389ab63b7ca8dd0c6af1cf01ff59bd795202b08a8. Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 30 01:28:55.079581 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:28:55.080703 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: df30720208908334d7d654e389ab63b7ca8dd0c6af1cf01ff59bd795202b08a8. Oct 30 01:28:55.082003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:28:55.082917 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1822/3631] 10.222.0.13 () {58 vars in 1377 bytes} [Sun Oct 30 01:28:55 2022] GET /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/caa0d58d65224327b83007c4c634df39 => generated 148 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:28:55.087013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.097556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8157047-20d4-4c3d-8ac4-02dc32bc353f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.102439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.103083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.103366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.103645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.104321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.106551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.273838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1810/3632] 10.222.0.13 () {60 vars in 1299 bytes} [Sun Oct 30 01:28:55 2022] POST /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:55.273949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.287065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d549a18-b78c-4c24-9dab-a1bd9f1b126c tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.302488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.303160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.303442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.303718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.304349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.305925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.430623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1823/3633] 10.222.0.13 () {60 vars in 1299 bytes} [Sun Oct 30 01:28:55 2022] POST /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:55.434837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.458315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11633c64-fd50-4c06-8912-6ff1196c0836 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.468501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.470634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.470926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.471385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.472185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.474094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.492227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1811/3634] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:28:55 2022] GET /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 865 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:55.507901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.528261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb8e7-0aba-4d8d-b1cf-de994ae48ada tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.541440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.541440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.541440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.541842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/09e0f153bfd64b12baf21b5c526e0486` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.541842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=09e0f153bfd64b12baf21b5c526e0486)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.541842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.669122 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1824/3635] 10.222.0.13 () {58 vars in 1380 bytes} [Sun Oct 30 01:28:55 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/09e0f153bfd64b12baf21b5c526e0486 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:55.673429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.700580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60dc2-8438-41b6-8707-e62d73770e4b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.710750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.711713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.712289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.712805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/8db0cff779544b16af714b2cf4393bf4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.716865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=8db0cff779544b16af714b2cf4393bf4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.729737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:55.839572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1812/3636] 10.222.0.13 () {58 vars in 1380 bytes} [Sun Oct 30 01:28:55 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/8db0cff779544b16af714b2cf4393bf4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:28:55.844829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:55.863176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe900d-b373-465c-9ad1-c4a0d230cb5b tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:55.876251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:55.877356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:55.878518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:55.879110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:55.879955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:55.913494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:56.040355 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1825/3637] 10.222.0.13 () {60 vars in 1299 bytes} [Sun Oct 30 01:28:55 2022] POST /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2 => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:56.045084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:56.061198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dbca-4e72-4444-976c-b411ad704f4f tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:56.075620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:56.077273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:56.077990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:56.078510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/23fc307f57a641aab579076a1fe2ee35` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:56.085746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=23fc307f57a641aab579076a1fe2ee35)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:56.087843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:56.097207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1813/3638] 10.222.0.13 () {58 vars in 1377 bytes} [Sun Oct 30 01:28:56 2022] GET /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/23fc307f57a641aab579076a1fe2ee35 => generated 367 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:56.097586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:56.111798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3200-0d52-4c1b-bfd5-455462b4462e tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:56.120007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74d9c7ab8f4d470aa4018d2736b9f09b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a9e80d4100948a490cba2775394e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:56.120975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:56.121840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:56.122282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/23fc307f57a641aab579076a1fe2ee35` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:56.125448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=74d9c7ab8f4d470aa4018d2736b9f09b, credential_id=23fc307f57a641aab579076a1fe2ee35)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:56.127239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9533f-0fbd-4e62-a71d-92b76083f9db tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:56.288702 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=9,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:56.299794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:56.300341 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1826/3639] 10.222.0.13 () {58 vars in 1380 bytes} [Sun Oct 30 01:28:56 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b/credentials/OS-EC2/23fc307f57a641aab579076a1fe2ee35 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:56.436626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8beb44-252a-45fd-bce8-dfc96196bb87 tempest-EC2CredentialsTest-1444276161 tempest-EC2CredentialsTest-1444276161-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:56.442090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:56.444603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:56.448756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:56.448756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] PATH_INFO: `/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:56.448756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d9c7ab8f4d470aa4018d2736b9f09b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:56.450716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:56.730197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d9c7ab8f4d470aa4018d2736b9f09b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:56.732968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d9c7ab8f4d470aa4018d2736b9f09b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:56.746116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d9c7ab8f4d470aa4018d2736b9f09b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:56.747777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d9c7ab8f4d470aa4018d2736b9f09b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:56.814405 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:28:56.863186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d9c7ab8f4d470aa4018d2736b9f09b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:56.919092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1814/3640] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:28:56 2022] DELETE /identity/v3/users/74d9c7ab8f4d470aa4018d2736b9f09b => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:56.921426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10732-6c02-488f-b3cf-8a12a6cd751e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:56.922320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10732-6c02-488f-b3cf-8a12a6cd751e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:56.922750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced10732-6c02-488f-b3cf-8a12a6cd751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:56.950493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ced10732-6c02-488f-b3cf-8a12a6cd751e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:56.952343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ced10732-6c02-488f-b3cf-8a12a6cd751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:57.053625 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1827/3641] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:57.113558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:57.116134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:57.232636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30494688-cfc4-4a53-b1f0-e04d1c16f7de admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:57.237123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:57.237951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:57.238985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:57.239272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:57.252216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:57.254967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de095ac-51be-4018-8b7b-89df2b859331 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:57.268222 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1815/3642] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:28:57.537446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:57.537730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:57.538192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:57.633457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:57.640380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:57.807362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1828/3643] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:57.818322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:57.818610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:57.818876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:57.843482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:57.843984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:57.853378 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1816/3644] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:58.053747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:58.056465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:58.162222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606357a-9f4d-46ee-ad7c-5d230e086c0b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:58.171081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:58.172561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:58.174011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:58.174474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:58.187154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:58.189036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482374-c081-45e7-b1ed-c479207ad5c3 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:58.199152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1829/3645] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:28:58.423566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:58.426025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:58.473987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726d58b-892d-490a-9758-17284c2b6c4f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:58.484282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:58.485402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:58.486424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:58.486960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] PATH_INFO: `/v3/projects/6a9e80d4100948a490cba2775394e42b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:58.503565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9e80d4100948a490cba2775394e42b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:58.506234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:58.733976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9e80d4100948a490cba2775394e42b', 'request_id': 'req-35d93d00-1415-4b59-9573-42b8f0fedb87'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:58.742231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9e80d4100948a490cba2775394e42b', 'request_id': 'req-35d93d00-1415-4b59-9573-42b8f0fedb87'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:58.918744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9e80d4100948a490cba2775394e42b', 'request_id': 'req-35d93d00-1415-4b59-9573-42b8f0fedb87'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:58.933871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] The token cache is being invalidate because project 6a9e80d4100948a490cba2775394e42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:28:58.934561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:58.935490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35d93d00-1415-4b59-9573-42b8f0fedb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:28:58.943778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1817/3646] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:28:58 2022] DELETE /identity/v3/projects/6a9e80d4100948a490cba2775394e42b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:28:58.944502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:58.944790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:58.945059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:58.972228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:58.976309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:59.119406 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1830/3647] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:59.129483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.129781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.130173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.156605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:28:59.158179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:59.182636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.193201 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1818/3648] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:28:59.195994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b099c-aada-45d7-b39f-37415432d81a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.202469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.203344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.203775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.204184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.205031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:28:59.205512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.207490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.225312 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1831/3649] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:28:59.229820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.244510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dba64-ccb4-4b7a-89a0-2a068530a436 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.251082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.252642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.253536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.254806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.255530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.259083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.429183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1819/3650] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:28:59 2022] POST /identity/v3/projects => generated 397 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:28:59.430938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.442865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20be13f-d5af-437d-b9af-88eb58a7e5c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.559071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.559883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.560008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.560254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.560877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.562821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.599657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.602046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:59.726928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9b756-e8f8-4dc7-95a5-556bd77be187 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.736846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.736846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.736846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.736846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.737679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:28:59.752209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.753865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.771532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1820/3651] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:28:59.775970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1832/3652] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:28:59 2022] POST /identity/v3/users => generated 305 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:28:59.780466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.798553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3547-7e4d-4576-9050-ca4354e7cd82 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.804040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.805694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.805694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.811683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.811683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.815672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.829782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1821/3653] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:28:59.835356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.847091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5be570-a27e-4ac1-98cc-6f3dc7727c51 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:28:59.857596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:28:59.858451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:28:59.858729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:28:59.858996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] PATH_INFO: `/v3/projects/96ba6530518b4133964a5809b56d1f8e/users/389b2da1e2ef40f4af04bfe4e8a7de27/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:28:59.918112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ba6530518b4133964a5809b56d1f8e, user_id=389b2da1e2ef40f4af04bfe4e8a7de27, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:28:59.922124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:28:59.923949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:28:59.927853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:00.041938 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1833/3654] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:28:59 2022] PUT /identity/v3/projects/96ba6530518b4133964a5809b56d1f8e/users/389b2da1e2ef40f4af04bfe4e8a7de27/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:00.042655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d708fa7-b5e6-4e66-82e1-365da2d657fe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:00.046057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:00.071819 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:00.122440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:00.123267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.123680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.124102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.127798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:00.140250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c16ecd-8412-4460-be06-77bc480d61c6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:00.147725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:00.149391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:00.160921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:00.163921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.163921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.163921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.164230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1822/3655] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:29:00.164329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:00.165675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271a86a-9301-4e0b-bb3c-2445f31f1327 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:00.178228 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1834/3656] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:00.182563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:00.195685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a277-32d8-4a5c-8086-e88f82dfb02e service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:00.200804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:00.201573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.202452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.202848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] PATH_INFO: `/v3/projects/96ba6530518b4133964a5809b56d1f8e/users/389b2da1e2ef40f4af04bfe4e8a7de27/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.204958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ba6530518b4133964a5809b56d1f8e, user_id=389b2da1e2ef40f4af04bfe4e8a7de27, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:00.209450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:00.235881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.236201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.236542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.237578 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1823/3657] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:00 2022] PUT /identity/v3/projects/96ba6530518b4133964a5809b56d1f8e/users/389b2da1e2ef40f4af04bfe4e8a7de27/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:00.273120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] MFA Rules not processed for user `389b2da1e2ef40f4af04bfe4e8a7de27`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:00.274603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:00.349744 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:00.378148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1835/3658] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:00.382755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:00.489722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38ca3-34db-4e81-83b5-b30d4b2c609f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:00.496649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:00.497833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.498334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.498846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.499713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:00.502425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:00.679232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1824/3659] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:00 2022] POST /identity/v3/projects => generated 395 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:00.682810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:00.713033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63bbec-4373-4729-bf2e-c23c12ef0acf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:00.849667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:00.849667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:00.849667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:00.849667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:00.850106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:00.857130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:00.991260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:00.996855 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1836/3660] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:00 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:01.005984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052008e9-a5e5-4cc2-b2aa-3a17583beab0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:01.011494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:01.012246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:01.012588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:01.012930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:01.013720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:01.015414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:01.038507 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1825/3661] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:01.043175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:01.055781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6218b-25fb-4ad2-9067-7079d1bcd7ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:01.062049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:01.062619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:01.062978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:01.063320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:01.064101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:01.066226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f881252-0150-481d-8ae8-226f173bee0f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:01.079115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1837/3662] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:01.083354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:01.095446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca68bf-773c-498b-bf8b-c3161c243981 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:01.101718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:01.102394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:01.102668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:01.103085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] PATH_INFO: `/v3/projects/8d07882eac824f3e8e009c96f9012986/users/936e0e9bb2994cd8aefb10ad942a8130/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:01.120223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d07882eac824f3e8e009c96f9012986, user_id=936e0e9bb2994cd8aefb10ad942a8130, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:01.123157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:01.335594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1826/3663] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:01 2022] PUT /identity/v3/projects/8d07882eac824f3e8e009c96f9012986/users/936e0e9bb2994cd8aefb10ad942a8130/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:01.345831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:01.346711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:01.347820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:01.377879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] MFA Rules not processed for user `936e0e9bb2994cd8aefb10ad942a8130`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:01.379166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:01.402272 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:01.469151 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1838/3664] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:01.483199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:01.485300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:01.578418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b9d63-8d43-41d5-98b5-efdec26c18bd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:01.582651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:01.583484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:01.583762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:01.584470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:01.683957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:01.688692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1487-afab-45ba-b535-a9dbb2acf863 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:01.701228 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1827/3665] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:03.255350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:03.353810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710744e1-4ae5-4489-a1b7-46468c1c18a9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:03.365947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:03.366837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:03.367294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:03.367736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] PATH_INFO: `/v3/users/389b2da1e2ef40f4af04bfe4e8a7de27` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:03.369095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389b2da1e2ef40f4af04bfe4e8a7de27)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:03.371253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:03.552135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389b2da1e2ef40f4af04bfe4e8a7de27'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:03.660348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389b2da1e2ef40f4af04bfe4e8a7de27'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:03.661230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389b2da1e2ef40f4af04bfe4e8a7de27'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:03.680217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389b2da1e2ef40f4af04bfe4e8a7de27'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:03.688882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389b2da1e2ef40f4af04bfe4e8a7de27'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:03.696329 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1839/3666] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:03 2022] DELETE /identity/v3/users/389b2da1e2ef40f4af04bfe4e8a7de27 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:03.700876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:03.701427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:03.701553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:03.751194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:03.752663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:03.787247 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:03.902846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1828/3667] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:03.916530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:03.919324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:04.012510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11fd02-0526-48ca-85e8-af585511a215 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:04.016496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:04.017166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:04.017476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:04.017748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:04.036967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:04.038348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:04.064692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1840/3668] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:04.119751 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:05.192771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:05.194296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:05.206301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcef764-635d-496e-aefc-be0beb63e523 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:05.212103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:05.212858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:05.213167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:05.213490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] PATH_INFO: `/v3/projects/96ba6530518b4133964a5809b56d1f8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:05.214620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ba6530518b4133964a5809b56d1f8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:05.216530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:05.342194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ba6530518b4133964a5809b56d1f8e', 'request_id': 'req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.347849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ba6530518b4133964a5809b56d1f8e', 'request_id': 'req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.417215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ba6530518b4133964a5809b56d1f8e', 'request_id': 'req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.438763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] The token cache is being invalidate because project 96ba6530518b4133964a5809b56d1f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:05.439030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.439789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.441672 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1829/3669] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:05 2022] DELETE /identity/v3/projects/96ba6530518b4133964a5809b56d1f8e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:05.445769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:05.458350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d770ae-ddc8-4ae7-81e4-7f3feaa89ff2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:05.475975 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:05.545265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:05.553359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:05.553359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:05.553359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] PATH_INFO: `/v3/users/936e0e9bb2994cd8aefb10ad942a8130` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:05.553359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=936e0e9bb2994cd8aefb10ad942a8130)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:05.553359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:05.571728 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:05.752992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936e0e9bb2994cd8aefb10ad942a8130'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.840350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936e0e9bb2994cd8aefb10ad942a8130'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.842243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936e0e9bb2994cd8aefb10ad942a8130'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.868871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936e0e9bb2994cd8aefb10ad942a8130'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.892261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-26dd43a3-3a43-43eb-9118-cfa824efb92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936e0e9bb2994cd8aefb10ad942a8130'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:05.900677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1841/3670] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:05 2022] DELETE /identity/v3/users/936e0e9bb2994cd8aefb10ad942a8130 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:06.991625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:06.993200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:07.040248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a3ab-ecb7-4025-abd2-3be7db88d4fb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:07.190590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:07.192172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:07.193369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:07.193831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] PATH_INFO: `/v3/projects/8d07882eac824f3e8e009c96f9012986` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:07.195801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d07882eac824f3e8e009c96f9012986)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:07.218691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:07.397932 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:07.413243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d07882eac824f3e8e009c96f9012986', 'request_id': 'req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:07.423312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d07882eac824f3e8e009c96f9012986', 'request_id': 'req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:07.517597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d07882eac824f3e8e009c96f9012986', 'request_id': 'req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:07.527569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] The token cache is being invalidate because project 8d07882eac824f3e8e009c96f9012986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:07.527933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:07.528727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15f08d3b-6e5c-4fe5-99cd-ebbd3988a699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:07.530777 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1830/3671] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:06 2022] DELETE /identity/v3/projects/8d07882eac824f3e8e009c96f9012986 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:07.536959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:07.540604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:07.540604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:07.561091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:07.562650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:07.655467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1842/3672] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:07.667523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:07.667810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:07.668087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:07.694082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:07.703013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:07.713493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1831/3673] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:07.718013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:07.728737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558db72-3813-493b-8fbf-660d8ba10017 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:07.736505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:07.737123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:07.737571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:07.738176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:07.738922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:29:07.739679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:07.741145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:07.759827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1843/3674] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:29:07.760656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:07.773081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25adde8-8e6b-4481-8dae-77840c8900b9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:07.781357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:07.781975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:07.782252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:07.782612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:07.783249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:07.786345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:07.933376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1832/3675] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:07 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:07.935434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:07.948892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650817d-2b3d-4884-8126-4eb6abebe0eb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:07.971235 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:08.017767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:08.017904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.018200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.018531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.019381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:08.021751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:08.131705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1844/3676] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:07 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:08.132361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:08.146200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c2829-493b-49d3-b9d3-80614785951f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:08.179344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:08.179964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.180244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.180508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.181151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:08.182794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:08.195250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1833/3677] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:08.199389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:08.212249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39733451-c59d-4045-a34f-539b975db2c7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:08.222835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:08.222835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.222835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.222835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.223269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:08.225759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280f92-c3a7-4c7e-b90e-2a3696a3260b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:08.245852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:08.253680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1845/3678] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:08.262540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2370a9-1477-469a-92a9-b9e60e00d270 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:08.267909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:08.269544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.270059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.270675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] PATH_INFO: `/v3/projects/15a870c3e893437a9be646366285dd07/users/3de76759c07b40f7a2c3694bd1228cb8/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.290928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a870c3e893437a9be646366285dd07, user_id=3de76759c07b40f7a2c3694bd1228cb8, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:08.294166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:08.390596 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1834/3679] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:08 2022] PUT /identity/v3/projects/15a870c3e893437a9be646366285dd07/users/3de76759c07b40f7a2c3694bd1228cb8/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:08.400892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f663-d072-4377-b04d-018306845620 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.401173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f663-d072-4377-b04d-018306845620 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.401480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438f663-d072-4377-b04d-018306845620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.434313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9438f663-d072-4377-b04d-018306845620 None None] MFA Rules not processed for user `3de76759c07b40f7a2c3694bd1228cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:08.435521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9438f663-d072-4377-b04d-018306845620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:08.523923 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1846/3680] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:08.551719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:08.554064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:08.639950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433191e-28ae-4877-a89b-216b73c7b1da admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:08.645469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:08.646114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:08.646441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:08.646881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:08.656910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:08.658058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:08.668739 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1835/3681] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:10.511607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f663-d072-4377-b04d-018306845620 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:10.515230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9438f663-d072-4377-b04d-018306845620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:10.559610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:10.608551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438f663-d072-4377-b04d-018306845620 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:10.614671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:10.615451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:10.615876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:10.616246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:10.618976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:10.702927 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:10.720149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19ac2-4ef9-4ef9-84c5-96d92c0be8e4 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:10.728112 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:10.749308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:10.751554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:10.752363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55001cf-437e-475e-b78a-b1372233c9c4 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:10.754431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:10.754739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:10.757687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] PATH_INFO: `/v3/users/3de76759c07b40f7a2c3694bd1228cb8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:10.765454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de76759c07b40f7a2c3694bd1228cb8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:10.767990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:10.768393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1847/3682] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:11.077630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de76759c07b40f7a2c3694bd1228cb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:11.078768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de76759c07b40f7a2c3694bd1228cb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:11.108008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de76759c07b40f7a2c3694bd1228cb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:11.117079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de76759c07b40f7a2c3694bd1228cb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:11.208580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de76759c07b40f7a2c3694bd1228cb8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:11.252865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:11.254324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:11.254810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:11.257724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1836/3683] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:10 2022] DELETE /identity/v3/users/3de76759c07b40f7a2c3694bd1228cb8 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:29:11.291921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:11.293254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:11.469619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1848/3684] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:11.537044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:11.538680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:11.660053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b97c4-3593-49a5-ae9f-e52d3899a177 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:11.675200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:11.676867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:11.677152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:11.677459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:11.696570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:11.699977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:11.727265 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1837/3685] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:13.681721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:13.684136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:13.716004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a214909-fe4e-45f2-970e-59e0db708c0c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:13.730809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:13.733880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:13.733880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:13.733880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] PATH_INFO: `/v3/projects/15a870c3e893437a9be646366285dd07` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:13.733880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a870c3e893437a9be646366285dd07)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:13.735416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:13.803543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:13.805191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:13.821513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e215f-fc40-4a99-a372-2939be0be249 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:13.825626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:13.826425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:13.826922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:13.827379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:13.829397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:13.841029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:13.842801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79ac3f-ff93-42bd-ad11-c5182d4be78a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:13.865317 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1838/3686] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:13.917042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a870c3e893437a9be646366285dd07', 'request_id': 'req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:14.024190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a870c3e893437a9be646366285dd07', 'request_id': 'req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:14.036505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a870c3e893437a9be646366285dd07', 'request_id': 'req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:14.052820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] The token cache is being invalidate because project 15a870c3e893437a9be646366285dd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:14.054042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:14.055341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c5a0aeb-3245-405a-ba05-dec3f231e6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:14.057442 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1849/3687] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:13 2022] DELETE /identity/v3/projects/15a870c3e893437a9be646366285dd07 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:14.063423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.066833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.066833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.094571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:14.095914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:14.215252 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1839/3688] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:14.223545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.224036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.224513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.274987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:14.278342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:14.300213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1850/3689] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:14.315458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.320390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac1514-bfa4-428a-a823-56b6111d20b8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.326794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.328408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.329497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.330166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.331222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:29:14.331769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.334293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:14.336656 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:14.350715 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1840/3690] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:29:14.354697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.371374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efba364-0b41-4e39-9ac6-d13a880b213d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.392046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.392831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.393860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.394245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.395129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.398890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:14.504543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1851/3691] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:14 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:14.508207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.523683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a149-44e7-47ec-9da7-28443eb0df21 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.644030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.645091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.645531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.645949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.646696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.649075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:14.784102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1841/3692] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:14 2022] POST /identity/v3/users => generated 280 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:14.785884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.798904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fb4a2-0f46-4471-b03c-b165fddeb981 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.812965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.813693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.813974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.814250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.814896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.816592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:14.832943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.834087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1852/3693] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:29:14.846135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce40c1-e7de-480f-89fd-e1a1ce1a01f4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.853607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.854231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.854513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.854786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.855436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.857747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e397db-1272-4677-bdd6-59094d93db93 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:14.881442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:14.886075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1842/3694] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:14.903969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea79247-0568-4ad1-bdcf-e7e7bff6515e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:14.911397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:14.913272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:14.913775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:14.914377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] PATH_INFO: `/v3/projects/12a1c308ecc048b7a8321a0b355b50e3/users/1fe3a1b1776f44569585ee989e6bec56/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:14.933182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a1c308ecc048b7a8321a0b355b50e3, user_id=1fe3a1b1776f44569585ee989e6bec56, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:14.936240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:15.041933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1853/3695] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:14 2022] PUT /identity/v3/projects/12a1c308ecc048b7a8321a0b355b50e3/users/1fe3a1b1776f44569585ee989e6bec56/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:15.052554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8475f-2538-4e3b-9ff7-75c374b2e640 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:15.053153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8475f-2538-4e3b-9ff7-75c374b2e640 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:15.053479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8475f-2538-4e3b-9ff7-75c374b2e640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:15.094509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c6f8475f-2538-4e3b-9ff7-75c374b2e640 None None] MFA Rules not processed for user `1fe3a1b1776f44569585ee989e6bec56`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:15.096408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c6f8475f-2538-4e3b-9ff7-75c374b2e640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:15.198753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1843/3696] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:15.206728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:15.211445 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:15.344817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4105a-509f-456f-8abd-2fc8be26baca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:15.350303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:15.351188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:15.351996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:15.352458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] PATH_INFO: `/v3/users/1fe3a1b1776f44569585ee989e6bec56` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:15.354822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe3a1b1776f44569585ee989e6bec56)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:15.356947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:15.601653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe3a1b1776f44569585ee989e6bec56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:15.744601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe3a1b1776f44569585ee989e6bec56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:15.748349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe3a1b1776f44569585ee989e6bec56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:15.769296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe3a1b1776f44569585ee989e6bec56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:15.783340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe3a1b1776f44569585ee989e6bec56'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:15.794868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1854/3697] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:15 2022] DELETE /identity/v3/users/1fe3a1b1776f44569585ee989e6bec56 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:15.799805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:15.800328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:15.800780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:15.830909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:15.832901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:15.940209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1844/3698] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:16.015980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:16.016976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:16.112400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b691d5-c760-4792-8a9f-08a4929e0900 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:16.118258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:16.120458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:16.120751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:16.121023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:16.148247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:16.149830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44c26-2a51-4f7a-89d4-8b3d21b49911 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:16.174569 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1855/3699] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:17.421893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:17.423355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:17.430570 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:17.437210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78c092-a83c-404e-b214-d56d93a5b653 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:17.442839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:17.444009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.444217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.444497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] PATH_INFO: `/v3/projects/12a1c308ecc048b7a8321a0b355b50e3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.445690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a1c308ecc048b7a8321a0b355b50e3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:17.447819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:17.588832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a1c308ecc048b7a8321a0b355b50e3', 'request_id': 'req-5a7b2381-85aa-4017-8ef4-0fb63962f944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:17.608459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a1c308ecc048b7a8321a0b355b50e3', 'request_id': 'req-5a7b2381-85aa-4017-8ef4-0fb63962f944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:17.681518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a1c308ecc048b7a8321a0b355b50e3', 'request_id': 'req-5a7b2381-85aa-4017-8ef4-0fb63962f944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:17.695844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] The token cache is being invalidate because project 12a1c308ecc048b7a8321a0b355b50e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:17.696135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:17.697021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a7b2381-85aa-4017-8ef4-0fb63962f944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:17.698556 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1845/3700] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:17 2022] DELETE /identity/v3/projects/12a1c308ecc048b7a8321a0b355b50e3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:17.704094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063765-371c-4f73-84b8-67313e81b616 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.704587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063765-371c-4f73-84b8-67313e81b616 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.704698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58063765-371c-4f73-84b8-67313e81b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.730819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-58063765-371c-4f73-84b8-67313e81b616 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:17.733096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58063765-371c-4f73-84b8-67313e81b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:17.757318 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:17.804972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1856/3701] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:17.813259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120c57-d33b-4bf0-96fa-04c0ebfe54e7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.813583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120c57-d33b-4bf0-96fa-04c0ebfe54e7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.813854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8120c57-d33b-4bf0-96fa-04c0ebfe54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.833369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b8120c57-d33b-4bf0-96fa-04c0ebfe54e7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:17.834577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8120c57-d33b-4bf0-96fa-04c0ebfe54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:17.854691 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1846/3702] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:17.855795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063765-371c-4f73-84b8-67313e81b616 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:17.872365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58063765-371c-4f73-84b8-67313e81b616 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:17.884744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.885300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.885663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.901596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:17.902293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.902638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.903155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.904454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:29:17.904855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:17.907215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:17.907488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:17.908767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:17.932762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1857/3703] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:29:17.937694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:17.948704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9d8f-bd17-40ab-a515-604533aeada9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:17.954346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:17.954962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:17.955327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:17.955665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:17.956367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:17.958402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:17.982286 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1847/3704] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:18.071010 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1858/3705] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:17 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:18.075204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:18.090611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acaa4f-45a5-44fe-b609-6594b3e4d82d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:18.160293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:18.160915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.161200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.161522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.162159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:18.164077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:18.303716 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1848/3706] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:18 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:18.305106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:18.321300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac70335-c0b7-4789-aaef-7718d955be0d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:18.329655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:18.329655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.329655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.329655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.330117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:18.333415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:18.358410 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1859/3707] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:18.359849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:18.372033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce67dc-5ce4-4b0d-b0d9-8ddb3461e85c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:18.378938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:18.379563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.379845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.380120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.380772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:18.382533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb6b69-2cec-4d0e-afa1-8a0c1173df88 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:18.421751 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1849/3708] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:18.425252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:18.440871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093ab1-1857-4c81-b69d-0c32ec9543ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:18.447545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:18.448974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.449263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.449594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] PATH_INFO: `/v3/projects/6346d68f5e42487fb45417638392074b/users/8cac4bb6a8294228ae7e8284795cd223/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.481403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346d68f5e42487fb45417638392074b, user_id=8cac4bb6a8294228ae7e8284795cd223, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:18.486069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:18.619662 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1860/3709] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:18 2022] PUT /identity/v3/projects/6346d68f5e42487fb45417638392074b/users/8cac4bb6a8294228ae7e8284795cd223/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:18.631372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.631939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.631939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.641021 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:18.673316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] MFA Rules not processed for user `8cac4bb6a8294228ae7e8284795cd223`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:18.674879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:18.822809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1850/3710] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:18.832206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:18.954735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ccfe-1741-44eb-8499-f7fbb9a785ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:18.967679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:18.968385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:18.968616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:18.969256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:18.970120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:18.972549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.137295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1861/3711] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:18 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:19.141843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.162510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327bab6-fd00-40d2-bf6a-a37c249faf95 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:19.306209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:19.306834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.307119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.307397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.308564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:19.311262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.374678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.378589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:19.438196 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1851/3712] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:19 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:19.439192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.476004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555879-7189-45e5-9524-606d5273c7ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:19.504141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:19.504777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.505062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.505763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.506519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:19.511816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.530072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1852/3713] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:19.538209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.559619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a6f8-dbc6-4e1b-abaa-5931e7507988 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:19.571811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:19.572834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.573289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.573763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.574574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:19.576809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.585424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c8288-035d-4fde-9ad9-15ae304ca0ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:19.592455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:19.593293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.593853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.594311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.598227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:19.629951 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1853/3714] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:29:19.631202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.641646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:19.643347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5b8d4-053c-40ab-92c2-72555ac5ec81 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.658431 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:19.671870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1862/3715] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:19.684485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e9889-6ccc-4a15-8bd4-fd36fb010c65 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:19.708515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:19.710294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.710943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.711445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] PATH_INFO: `/v3/projects/ee54f145a5394631a0917d532e687829/users/0572c6921fca48a58b98c9b770b281bb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.731394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee54f145a5394631a0917d532e687829, user_id=0572c6921fca48a58b98c9b770b281bb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:19.735183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd74a-7267-4e8e-b8d7-677ce1de24dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:19.842001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1854/3716] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:19 2022] PUT /identity/v3/projects/ee54f145a5394631a0917d532e687829/users/0572c6921fca48a58b98c9b770b281bb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:19.849906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.850380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.851027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.889207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:19.889636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:19.890013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:19.934018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:19.934191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] MFA Rules not processed for user `0572c6921fca48a58b98c9b770b281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:19.934304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:19.934822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:19.995183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1855/3717] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:19.996308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:19.997923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:20.059284 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1863/3718] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:20.063807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.085551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7418ad2-0981-4cd6-ba3d-754714494e51 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.096831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.097706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.098163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.099152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] PATH_INFO: `/v3/users/f857d6b0826e47c6875a307e7ccfb104` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.101180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f857d6b0826e47c6875a307e7ccfb104)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.107993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.180422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd046a-de8c-4f24-a4a9-3c81b1489968 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.186172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.186782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.187063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.187334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.190019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:20.204229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.205868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.218693 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1864/3719] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:20.219782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.232539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76501a66-5a22-41dc-b46d-a2bfcaef1781 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.238517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.239399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.239909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.240368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.241304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.243403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.355331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f857d6b0826e47c6875a307e7ccfb104'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:20.356648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f857d6b0826e47c6875a307e7ccfb104'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:20.364522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f857d6b0826e47c6875a307e7ccfb104'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:20.365512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f857d6b0826e47c6875a307e7ccfb104'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:20.406810 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1865/3720] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:20 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:20.411013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.416618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:20.453673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f857d6b0826e47c6875a307e7ccfb104'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:20.476601 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1856/3721] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:19 2022] DELETE /identity/v3/users/f857d6b0826e47c6875a307e7ccfb104 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:20.499625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aac4-aff0-470b-af73-7ef6fc42497d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.574748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.576868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.577272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.581484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.581484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.581484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.791536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.794136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:20.817390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37cdc4-2a26-47dd-bfa8-881fce0157d0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.819664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.820574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.821029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.821900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] PATH_INFO: `/v3/projects/4aa9c648b20d41d7b150fbf64cde6fe8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.822526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa9c648b20d41d7b150fbf64cde6fe8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.830449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.869956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1866/3722] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:20 2022] POST /identity/v3/users => generated 297 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:20.874128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.886896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9294e0-d00d-4f40-80bf-4c41fd97002a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.891594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.892203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.892483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.892845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.893595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.895376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:20.908104 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1867/3723] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:20.913364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:20.924462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5687fa-26ef-47ef-a363-2ede27b2b088 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:20.931187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:20.932118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:20.937355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:20.937355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] PATH_INFO: `/v3/projects/a78cb9e614874fa68dde952ebd639bb9/users/7cae2c6679384d0f8295204e382dd041/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:20.949490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78cb9e614874fa68dde952ebd639bb9, user_id=7cae2c6679384d0f8295204e382dd041, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:20.952188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.064560 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:21.077123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1868/3724] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:20 2022] PUT /identity/v3/projects/a78cb9e614874fa68dde952ebd639bb9/users/7cae2c6679384d0f8295204e382dd041/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:21.081452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.087285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa9c648b20d41d7b150fbf64cde6fe8', 'request_id': 'req-dd31b444-141f-411b-9ad1-78c72ef3b5c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:21.093589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa9c648b20d41d7b150fbf64cde6fe8', 'request_id': 'req-dd31b444-141f-411b-9ad1-78c72ef3b5c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:21.137028 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:21.157199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb818561-807b-4d26-8e73-075b8ed45606 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.160575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa9c648b20d41d7b150fbf64cde6fe8', 'request_id': 'req-dd31b444-141f-411b-9ad1-78c72ef3b5c4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:21.177960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] The token cache is being invalidate because project 4aa9c648b20d41d7b150fbf64cde6fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:21.178277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:21.179096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd31b444-141f-411b-9ad1-78c72ef3b5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:21.180599 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1857/3725] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:20 2022] DELETE /identity/v3/projects/4aa9c648b20d41d7b150fbf64cde6fe8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:21.186381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c23c-f665-49d3-ad59-2152ae0fb482 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.187042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c23c-f665-49d3-ad59-2152ae0fb482 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.187426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c23c-f665-49d3-ad59-2152ae0fb482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.220793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0dc8c23c-f665-49d3-ad59-2152ae0fb482 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:21.222328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0dc8c23c-f665-49d3-ad59-2152ae0fb482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.247617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.248332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.249053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.249368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.252025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.252561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.264520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1869/3726] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:21.268723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.270515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.284348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ed61-930e-45a3-9e0f-43c717d66bd3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.289102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.289993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.290273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1858/3727] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:21.290634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.290919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] PATH_INFO: `/v3/projects/a78cb9e614874fa68dde952ebd639bb9/users/7cae2c6679384d0f8295204e382dd041/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.292896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78cb9e614874fa68dde952ebd639bb9, user_id=7cae2c6679384d0f8295204e382dd041, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.296158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229968e-a97a-4281-a517-905dfc08e124 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.298949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.299239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.299575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.307419 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1870/3728] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:21 2022] PUT /identity/v3/projects/a78cb9e614874fa68dde952ebd639bb9/users/7cae2c6679384d0f8295204e382dd041/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:21.318844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.319480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.319929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.336082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:21.337502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.360335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] MFA Rules not processed for user `7cae2c6679384d0f8295204e382dd041`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:21.361439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.409745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1859/3729] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:21.411028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.433233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c9e5f-3b88-4377-a82b-1d20c988c2f5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.438721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.440160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.440511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.440843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.441528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:29:21.441829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.443645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.446328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1871/3730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:21.452736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.454429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.461430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1860/3731] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:29:21.463090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.474555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ba1e-1011-437e-ba4a-41dd7f1671fa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.483567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.484336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.484743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.485115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.485884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.488042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.527941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc35db-0dba-403f-b9b4-c1be25cbad63 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.533474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.534631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.534631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.534889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.536688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:21.596523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.598001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.607337 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1872/3732] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:29:21.682864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1861/3733] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:21 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:21.687011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.698281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5500fc5-c47c-42b5-adee-624d43049534 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.758827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.759443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.759796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.760136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.760872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.763506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.850439 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:21.865780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1873/3734] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:21 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:21.869712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.891057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bea9-1c29-421b-96d0-9d4f61aeb4a1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.897797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.899640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.899922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.900192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.900862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.902542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.914659 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1862/3735] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:21.918831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.931106 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:21.936055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb8fc-e06e-47f7-ade6-ef2d5d778a6b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.944511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.945436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.945910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.946183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:21.946871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:21.948680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e065eb-bd63-49b3-9106-123c4f51a60c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:21.964706 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1874/3736] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:21.967004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:21.980287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f3d4-7503-4215-8f84-4624c9c46876 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:21.986361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:21.986805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:21.987153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:21.987886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] PATH_INFO: `/v3/projects/d1fcce1fadf54d089ec4fd751a3cf6ae/users/fea8a24166674250a98268ae52604f12/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:22.010795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1fcce1fadf54d089ec4fd751a3cf6ae, user_id=fea8a24166674250a98268ae52604f12, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:22.027659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:22.155537 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1863/3737] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:21 2022] PUT /identity/v3/projects/d1fcce1fadf54d089ec4fd751a3cf6ae/users/fea8a24166674250a98268ae52604f12/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:22.167234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de936-a5cf-4536-bff3-15e2a5fe8c87 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:22.167540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de936-a5cf-4536-bff3-15e2a5fe8c87 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:22.167810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81de936-a5cf-4536-bff3-15e2a5fe8c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:22.200840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f81de936-a5cf-4536-bff3-15e2a5fe8c87 None None] MFA Rules not processed for user `fea8a24166674250a98268ae52604f12`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:22.202315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f81de936-a5cf-4536-bff3-15e2a5fe8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:22.278518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1875/3738] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:22.290721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:22.293044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:22.358249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f287e1a-f7e4-4a64-b519-01f9e67a0b7d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:22.361987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:22.362587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:22.362866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:22.363254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:22.372861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:22.374362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:22.383676 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1864/3739] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:22.898009 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:23.182872 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:23.641673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53ad-4ac5-49ab-8c76-1be64ff41dba None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:23.642193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53ad-4ac5-49ab-8c76-1be64ff41dba None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:23.642452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a53ad-4ac5-49ab-8c76-1be64ff41dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:23.662017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7c0a53ad-4ac5-49ab-8c76-1be64ff41dba None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:23.663211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7c0a53ad-4ac5-49ab-8c76-1be64ff41dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:23.718369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1876/3740] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:29:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:23.730251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:23.731643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:23.803653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dcd48-7ea4-496f-b0b4-6d269e3362f8 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:23.808958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:23.810221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:23.810499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:23.810771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:23.819214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:23.820788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:23.829303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1865/3741] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:25.949051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c467479-0fec-4008-a098-fcdf80c4348b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:25.950272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c467479-0fec-4008-a098-fcdf80c4348b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:25.950621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c467479-0fec-4008-a098-fcdf80c4348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:25.973659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6c467479-0fec-4008-a098-fcdf80c4348b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:25.974921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c467479-0fec-4008-a098-fcdf80c4348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:25.995066 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1877/3742] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:26.010101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:26.028755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9fa5-3f77-4550-bfdb-220a32e53da1 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:26.041299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:26.042117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:26.043495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:26.043784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:26.056018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:26.057800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:26.073638 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1866/3743] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:29:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:28.075102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005be-4346-48db-9e8c-c62817017849 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:28.075919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005be-4346-48db-9e8c-c62817017849 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:28.076353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf005be-4346-48db-9e8c-c62817017849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:28.093436 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:28.115207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0cf005be-4346-48db-9e8c-c62817017849 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:28.116415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0cf005be-4346-48db-9e8c-c62817017849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:28.131383 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1878/3744] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:28.165699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:28.184426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cadca-11d1-4f07-be4a-e5fae22f321d service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:28.201647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:28.202602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:28.203085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:28.203587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:28.224790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:28.226809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57bb48-8abe-4fcf-996f-e73ecf4d42c4 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:28.239021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1867/3745] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:29:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:29:29.007213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:29.007494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:29.007765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:29.045719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] MFA Rules not processed for user `fea8a24166674250a98268ae52604f12`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:29.047183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:29.055100 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1879/3746] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:29.781930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:29.782498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:29.782613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:29.841090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] MFA Rules not processed for user `fea8a24166674250a98268ae52604f12`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:29.843098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:29.851567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1868/3747] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:33.247100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:33.326455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6ee3e-dc5f-420b-a6bd-8ec7abd38007 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:33.335172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:33.337393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:33.338342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:33.338895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:33.443539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:33.445133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:33.460689 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1880/3748] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:37.436592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:37.440071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:37.543584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaab14-b9be-4833-8670-2fb404bd9c9d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:37.550478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:37.551161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:37.551515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:37.551854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:37.553713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:37.574112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:37.574112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:37.575096 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:37.582581 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1869/3749] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:39.247292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:39.262306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4afec-0e71-4f28-a7d4-5db60fc7bcdb service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:39.268103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:39.268707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:39.269164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:39.269477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:39.271219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:39.285658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:39.287443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:39.306577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1881/3750] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:41.516117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:41.518466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:41.548829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a1f9-3275-42a1-ab5a-e126b0461c12 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:41.553839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:41.554561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:41.554896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:41.555231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:41.557257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:41.623672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:41.625158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa537db9-fb48-40e2-89b7-a89c090ef358 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:41.634425 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1870/3751] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:29:49.298494 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=60 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:51.630318 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=29 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:52.312877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:52.419022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca828b51-7de9-44b0-b1df-d6804888d23d service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:52.439782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:52.440800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:52.441080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:52.441476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] PATH_INFO: `/v3/users/8cac4bb6a8294228ae7e8284795cd223` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:52.443492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cac4bb6a8294228ae7e8284795cd223)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:52.447381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:52.736709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cac4bb6a8294228ae7e8284795cd223'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:52.907092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cac4bb6a8294228ae7e8284795cd223'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:52.909583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cac4bb6a8294228ae7e8284795cd223'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:52.928093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cac4bb6a8294228ae7e8284795cd223'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:52.954138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cac4bb6a8294228ae7e8284795cd223'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:52.968051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1882/3752] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:52 2022] DELETE /identity/v3/users/8cac4bb6a8294228ae7e8284795cd223 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:29:52.972657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:52.973136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:52.973261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:52.996792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:52.996792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:53.075219 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1871/3753] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:53.086688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:53.088895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:53.151212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49e6-f700-4f2d-8d24-0d6e9f2a6571 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:53.155998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:53.157036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:53.157532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:53.158072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:53.168718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:53.170482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:53.181775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1883/3754] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:53.708776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:53.713184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:53.749088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6359747-ba4c-46fd-b57a-a777872a5445 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:53.772105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:53.773102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:53.774374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:53.774884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] PATH_INFO: `/v3/projects/6346d68f5e42487fb45417638392074b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:53.776201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6346d68f5e42487fb45417638392074b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:53.778626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:53.915134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6346d68f5e42487fb45417638392074b', 'request_id': 'req-2bf37ae2-fd5e-4e0b-9731-d552df92a654'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:53.922512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6346d68f5e42487fb45417638392074b', 'request_id': 'req-2bf37ae2-fd5e-4e0b-9731-d552df92a654'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.015688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6346d68f5e42487fb45417638392074b', 'request_id': 'req-2bf37ae2-fd5e-4e0b-9731-d552df92a654'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.030451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] The token cache is being invalidate because project 6346d68f5e42487fb45417638392074b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:54.030730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.032019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2bf37ae2-fd5e-4e0b-9731-d552df92a654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.038399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:54.039505 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1872/3755] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:53 2022] DELETE /identity/v3/projects/6346d68f5e42487fb45417638392074b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:54.050400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0045c-1f11-4df9-89a3-a14f65198ee2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:54.079460 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:54.124567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:54.125588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:54.126060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:54.126549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] PATH_INFO: `/v3/users/0572c6921fca48a58b98c9b770b281bb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:54.127944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0572c6921fca48a58b98c9b770b281bb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:54.130531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:54.376652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0572c6921fca48a58b98c9b770b281bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.461372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0572c6921fca48a58b98c9b770b281bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.461932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0572c6921fca48a58b98c9b770b281bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.476881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0572c6921fca48a58b98c9b770b281bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.485453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0572c6921fca48a58b98c9b770b281bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:54.494072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1884/3756] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:54 2022] DELETE /identity/v3/users/0572c6921fca48a58b98c9b770b281bb => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:55.108916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:55.109489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:55.109751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:55.134636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:55.135823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:55.171093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:55.172942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:55.204176 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1873/3757] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:55.277596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85bcb7-f903-4668-9aa6-68d902bada6b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:55.282996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:55.283633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:55.286834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:55.286834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] PATH_INFO: `/v3/projects/ee54f145a5394631a0917d532e687829` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:55.286834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee54f145a5394631a0917d532e687829)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:55.287851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:55.395153 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:55.398123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee54f145a5394631a0917d532e687829', 'request_id': 'req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.483671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee54f145a5394631a0917d532e687829', 'request_id': 'req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.487214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee54f145a5394631a0917d532e687829', 'request_id': 'req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.500083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] The token cache is being invalidate because project ee54f145a5394631a0917d532e687829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:55.500825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.501382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.504720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1885/3758] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:55 2022] DELETE /identity/v3/projects/ee54f145a5394631a0917d532e687829 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:29:55.509091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:55.521736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dd1c3-8bec-43a5-b446-d5446d81277b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:55.553606 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:55.585380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:55.586097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:55.586443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:55.586820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] PATH_INFO: `/v3/users/7cae2c6679384d0f8295204e382dd041` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:55.587994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cae2c6679384d0f8295204e382dd041)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:55.590437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:55.819351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cae2c6679384d0f8295204e382dd041'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.820059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cae2c6679384d0f8295204e382dd041'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.828353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cae2c6679384d0f8295204e382dd041'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.829349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cae2c6679384d0f8295204e382dd041'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.915450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ad5253d6-4bb6-4813-97ca-8fc98f3bf1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cae2c6679384d0f8295204e382dd041'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:55.944419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1874/3759] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:29:55 2022] DELETE /identity/v3/users/7cae2c6679384d0f8295204e382dd041 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:56.541903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:56.543446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:56.557243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1e5ab-367f-4f6e-9d9e-008ad8f72bdf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:56.618770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:56.619521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:56.619822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:56.620099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] PATH_INFO: `/v3/projects/a78cb9e614874fa68dde952ebd639bb9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:56.621309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78cb9e614874fa68dde952ebd639bb9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:56.623228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:56.750437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78cb9e614874fa68dde952ebd639bb9', 'request_id': 'req-73667c1a-48cf-431e-992d-7680a95967aa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:56.821043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78cb9e614874fa68dde952ebd639bb9', 'request_id': 'req-73667c1a-48cf-431e-992d-7680a95967aa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:56.828821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78cb9e614874fa68dde952ebd639bb9', 'request_id': 'req-73667c1a-48cf-431e-992d-7680a95967aa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:56.840730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] The token cache is being invalidate because project a78cb9e614874fa68dde952ebd639bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:29:56.841065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:56.841696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73667c1a-48cf-431e-992d-7680a95967aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:29:56.843254 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1886/3760] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:29:56 2022] DELETE /identity/v3/projects/a78cb9e614874fa68dde952ebd639bb9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:56.848365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0204-60dd-4223-8e48-17de5918992e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:56.848925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0204-60dd-4223-8e48-17de5918992e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:56.848925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e0204-60dd-4223-8e48-17de5918992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:56.868680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-872e0204-60dd-4223-8e48-17de5918992e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:56.869887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-872e0204-60dd-4223-8e48-17de5918992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:56.931989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1875/3761] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:56.940788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:56.941071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:56.941354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:56.963292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:56.964573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:56.973219 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1887/3762] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:56.977700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0204-60dd-4223-8e48-17de5918992e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:56.988078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e0204-60dd-4223-8e48-17de5918992e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:56.992735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:56.993327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:56.993633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:56.993902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:56.994671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:29:56.994974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:56.996555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.008876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1876/3763] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:29:57.013246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.023516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5f667-3160-4b5c-beea-a20c24e9f7f2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.028500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.029080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.029411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.029772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.030510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.032377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.136525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1888/3764] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:57.141057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.158160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b71c6-64ae-4a20-ab32-6ecdfd03a40e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.208238 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:57.268344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.269056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.269356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.269669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.270357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.272431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.403416 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1877/3765] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:57 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:29:57.407448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.431765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ea108-a48c-42aa-bf8a-1af1083e9e24 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.438226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.438910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.439275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.439611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.440322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.442091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.456064 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1889/3766] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:57.458908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.478547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57b73e-d57b-4ecf-98ba-9febc48c6e00 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.483366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.484018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.484282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.484526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.485197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.487291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11b4d6-aa34-427b-86c2-88e294bb37a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.505364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1878/3767] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:29:57.506898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.517876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c0141-be85-42d7-b3e9-316eeadca39d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.524415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.525071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.525367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.525911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] PATH_INFO: `/v3/projects/cb013c1fbdd648c19673149ffba6886b/users/fa81b46047264f31a370b6178bb28248/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.544476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb013c1fbdd648c19673149ffba6886b, user_id=fa81b46047264f31a370b6178bb28248, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.547550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:57.690365 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:57.697665 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1890/3768] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:57 2022] PUT /identity/v3/projects/cb013c1fbdd648c19673149ffba6886b/users/fa81b46047264f31a370b6178bb28248/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:57.708962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.709256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.711248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.738986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] MFA Rules not processed for user `fa81b46047264f31a370b6178bb28248`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:57.740185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:57.813306 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1879/3769] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:57.818493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:57.921285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13feee8e-3b0b-4187-b478-5ef94632e12e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:57.927939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:57.931015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:57.931015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:57.931015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:57.931015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:57.932447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.089289 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1891/3770] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:29:57 2022] POST /identity/v3/projects => generated 377 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:58.093384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.108680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b6e9-dc22-4a65-9a55-aeb240f5ca39 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:58.173270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:58.173914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.174193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.174463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.175101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:58.177537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.272347 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1880/3771] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:29:58 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:29:58.276625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.289999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044981af-0ef3-4fc8-9d3a-79a81cd9a530 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:58.296610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:58.297573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.297962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.298330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.299292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:58.301836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.314249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1892/3772] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:29:58.318819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.331389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b68081-16f7-4554-8183-0811f3853631 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:58.336975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:58.337761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.338066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.338336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] PATH_INFO: `/v3/projects/3e88637cec784dbdb7b39c8c289ba193/users/ae2f720411894277b0e4d70d6f76bb96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.354757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88637cec784dbdb7b39c8c289ba193, user_id=ae2f720411894277b0e4d70d6f76bb96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:58.358784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.428352 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1881/3773] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:58 2022] PUT /identity/v3/projects/3e88637cec784dbdb7b39c8c289ba193/users/ae2f720411894277b0e4d70d6f76bb96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:58.432679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.446428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee8de1-7363-48ef-b49c-f8896a826c00 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:58.544726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:58.560889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.561516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.562509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.563402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:58.571502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496f41a-69f9-4bec-86b3-d99d277d616b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.605217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1893/3774] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:29:58.606681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.629707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418bbf1-a0af-4912-98d6-0591fe660bc8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:58.641492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:58.642283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.642630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.645349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] PATH_INFO: `/v3/projects/3e88637cec784dbdb7b39c8c289ba193/users/ae2f720411894277b0e4d70d6f76bb96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.649106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e88637cec784dbdb7b39c8c289ba193, user_id=ae2f720411894277b0e4d70d6f76bb96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:58.653275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:58.657162 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:58.676491 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1882/3775] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:29:58 2022] PUT /identity/v3/projects/3e88637cec784dbdb7b39c8c289ba193/users/ae2f720411894277b0e4d70d6f76bb96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:29:58.678797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dacb7-1ca4-4bf5-a291-813de015a7d2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:58.679365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dacb7-1ca4-4bf5-a291-813de015a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:58.679806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dacb7-1ca4-4bf5-a291-813de015a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:58.724666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e70dacb7-1ca4-4bf5-a291-813de015a7d2 None None] MFA Rules not processed for user `ae2f720411894277b0e4d70d6f76bb96`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:58.726115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e70dacb7-1ca4-4bf5-a291-813de015a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:58.811993 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:29:58.823932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1894/3776] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:29:58.875945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:58.883637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:59.014234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004093ad-a265-4306-9055-11e0e9bd7b01 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:29:59.020335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:29:59.021177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:59.024068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:59.024068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:59.043140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:29:59.045118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:29:59.063092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1883/3777] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:29:59.814945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3da80-fcb6-4785-8d27-495cc6259c9b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:29:59.815483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3da80-fcb6-4785-8d27-495cc6259c9b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:29:59.815612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3da80-fcb6-4785-8d27-495cc6259c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:29:59.836492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a3e3da80-fcb6-4785-8d27-495cc6259c9b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:29:59.838049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a3e3da80-fcb6-4785-8d27-495cc6259c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:29:59.914645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1895/3778] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:29:59.927375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:29:59.928848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:00.008866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd56c7-403d-4b1a-83cf-0cb6805bcec8 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:00.017121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:00.021801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:00.021801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:00.021801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:00.036690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:00.038379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:00.066393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1884/3779] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:05.568576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:05.568576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:05.568576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:05.600375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] MFA Rules not processed for user `6134c05549f14bc19962acea9c913f53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:05.604163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:05.741019 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1896/3780] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:06.320304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:06.339076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcda4cc-ccf5-41ac-9bdf-db16d0eefe34 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:06.350923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:06.371829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:06.371829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:06.371829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:06.378547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:06.396963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:06.399373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:06.413106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1885/3781] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:13.749607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:13.752781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:13.914186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949c325-362f-4ba9-bcd2-f027873db196 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:13.940536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:13.945916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:13.947669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:13.949928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] PATH_INFO: `/v3/users/6b3394f28c4f444f8cd8bda6bacc9fc8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:13.952802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3394f28c4f444f8cd8bda6bacc9fc8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:13.957433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:14.315780 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:14.321176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3394f28c4f444f8cd8bda6bacc9fc8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:14.424170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3394f28c4f444f8cd8bda6bacc9fc8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:14.424807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3394f28c4f444f8cd8bda6bacc9fc8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:14.464148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3394f28c4f444f8cd8bda6bacc9fc8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:14.493962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3394f28c4f444f8cd8bda6bacc9fc8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:14.516602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1897/3782] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:30:13 2022] DELETE /identity/v3/users/6b3394f28c4f444f8cd8bda6bacc9fc8 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:30:15.259086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:15.278885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d9a76-a780-44d5-8bb1-c910f903253f service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:15.437060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae2f720411894277b0e4d70d6f76bb96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e88637cec784dbdb7b39c8c289ba193', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:15.441406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:15.441406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:15.441406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:15.441406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:30:15.441406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:15.445264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:15.476935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:15.478484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:15.495569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1886/3783] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:30:15.515100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050e44e-e45d-4baf-a7ed-2bef38176c84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:15.536258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae2f720411894277b0e4d70d6f76bb96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e88637cec784dbdb7b39c8c289ba193', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:15.536800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:15.537092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:15.537393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:15.542426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:15.551393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:15.738070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1898/3784] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:30:15 2022] POST /identity/v3/projects => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:30:15.836202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:15.862421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4486ef-0fbd-40fb-83cf-9e546e7a9fde tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:15.872131 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:15.972642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae2f720411894277b0e4d70d6f76bb96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e88637cec784dbdb7b39c8c289ba193', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:15.973880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:15.979829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:15.979829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:15.979829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:30:15.979829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:15.979829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421f27-a739-489b-9b4b-fc7e719102b9 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:15.994752 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1887/3785] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:30:16.038312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:16.040135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:16.182372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c82-a0cf-456b-87be-f2c96a449af0 tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:16.197729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:16.197729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:16.197729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:16.197729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] PATH_INFO: `/v3/projects/9d1e9b74043548e48a5bb8fb4d054803` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:16.201742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1e9b74043548e48a5bb8fb4d054803)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:16.203940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:16.413890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1e9b74043548e48a5bb8fb4d054803', 'request_id': 'req-a86663b4-2df0-4b3e-adf0-3bf993831d0d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:16.537967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1e9b74043548e48a5bb8fb4d054803', 'request_id': 'req-a86663b4-2df0-4b3e-adf0-3bf993831d0d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:16.549505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1e9b74043548e48a5bb8fb4d054803', 'request_id': 'req-a86663b4-2df0-4b3e-adf0-3bf993831d0d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:16.576489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] The token cache is being invalidate because project 9d1e9b74043548e48a5bb8fb4d054803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:30:16.577058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:16.578001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a86663b4-2df0-4b3e-adf0-3bf993831d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:16.580366 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1899/3786] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:16 2022] DELETE /identity/v3/projects/9d1e9b74043548e48a5bb8fb4d054803 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:30:16.585460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:16.585992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:16.585992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:16.642933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:16.645796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:16.797144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1888/3787] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:16.804427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f82a-1857-47eb-874b-b3468975815b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:16.804711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f82a-1857-47eb-874b-b3468975815b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:16.805195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f82a-1857-47eb-874b-b3468975815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:16.843626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5647f82a-1857-47eb-874b-b3468975815b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:16.847594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5647f82a-1857-47eb-874b-b3468975815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:16.867569 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1900/3788] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:16.873120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:16.902353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6c9ec-c4c2-4cf5-81aa-c263659675a0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:16.909419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:16.911327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:16.911796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:16.912279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:16.913128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:30:16.916335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:16.918710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:16.946909 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1889/3789] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:30:16.951458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647f82a-1857-47eb-874b-b3468975815b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:16.961559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647f82a-1857-47eb-874b-b3468975815b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:16.967122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:16.967746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:16.968024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:16.968474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:16.969283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:16.978598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:17.109066 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1901/3790] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:30:16 2022] POST /identity/v3/projects => generated 397 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:30:17.110743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:17.125801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf5dca-3cf5-4424-8004-3202bfb487da admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:17.265592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:17.266823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:17.268140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:17.268445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:17.269794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:17.275267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:17.441149 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1890/3791] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:30:17 2022] POST /identity/v3/users => generated 299 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:30:17.445746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:17.452865 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:17.465542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac650d-7564-49cb-96cc-2c098f112e27 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:17.472157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:17.473089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:17.473729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:17.474283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:17.475110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:17.476902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:17.491585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1902/3792] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:30:17.492488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:17.507545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d87cb-874e-4847-bc62-2d2703e63523 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:17.527019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:17.527796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:17.528170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:17.528760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:17.530193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:17.535993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:17.551512 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1891/3793] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:30:17.552756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:17.572066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1c785-6421-479b-a3f3-150220cb8f42 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:17.587026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:17.588033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:17.597825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:17.598138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] PATH_INFO: `/v3/projects/93c145959fe44ed1bec7c4c964be8d2e/users/11293effe45345aeac9fd7dd672b738b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:17.618749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c145959fe44ed1bec7c4c964be8d2e, user_id=11293effe45345aeac9fd7dd672b738b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:17.622265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122e1c5-5491-4d24-ae13-ffdd8c005eb0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:17.674587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:17.676367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:17.696679 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:17.777006 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1903/3794] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:30:17 2022] PUT /identity/v3/projects/93c145959fe44ed1bec7c4c964be8d2e/users/11293effe45345aeac9fd7dd672b738b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:30:17.778504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:17.778793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:17.779070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:17.884493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:17.888717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:17.898110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85faee-8031-4c69-9c0a-73cd20bc41bc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:18.049118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae2f720411894277b0e4d70d6f76bb96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e88637cec784dbdb7b39c8c289ba193', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:18.050320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:18.050802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:18.051416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] PATH_INFO: `/v3/projects/971a2ebf722448c4ac316126e31f8c1c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:18.053129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorizing `identity:delete_project(project_id=971a2ebf722448c4ac316126e31f8c1c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:18.055314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:18.089485 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1904/3795] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:18.127386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:18.132384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:18.274930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971a2ebf722448c4ac316126e31f8c1c', 'request_id': 'req-62a56c1b-24ed-4837-bb9d-dc0c451280fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:18.299854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971a2ebf722448c4ac316126e31f8c1c', 'request_id': 'req-62a56c1b-24ed-4837-bb9d-dc0c451280fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:18.344019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5b13-45f9-4a89-908a-ab6ef1498965 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:18.423540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971a2ebf722448c4ac316126e31f8c1c', 'request_id': 'req-62a56c1b-24ed-4837-bb9d-dc0c451280fb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:18.453079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] The token cache is being invalidate because project 971a2ebf722448c4ac316126e31f8c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:30:18.454176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:18.458167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:18.461830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1892/3796] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:17 2022] DELETE /identity/v3/projects/971a2ebf722448c4ac316126e31f8c1c => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:30:18.483542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:18.485011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:18.485522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:18.486008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:18.487918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:18.489486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:18.489920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:18.525618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a56c1b-24ed-4837-bb9d-dc0c451280fb tempest-RoutersIpV6AdminTest-1460514135 tempest-RoutersIpV6AdminTest-1460514135-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:18.533000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:18.533792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:18.534141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:18.534509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:18.538837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:18.576062 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:18.621681 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:18.622815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:18.624282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:18.638761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:18.640221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:18.646447 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1905/3797] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:18.654920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1893/3798] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:30:19.078710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:19.080312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:19.096355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec40da-04ee-4f3a-8746-86ad26fa750d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:19.103353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:19.104303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:19.104841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:19.105176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] PATH_INFO: `/v3/users/a4fff27847f74c39b425dba724cf847f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:19.106429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fff27847f74c39b425dba724cf847f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:19.108434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:19.470154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fff27847f74c39b425dba724cf847f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:19.576560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fff27847f74c39b425dba724cf847f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:19.578200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fff27847f74c39b425dba724cf847f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:19.609099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fff27847f74c39b425dba724cf847f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:19.642599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed185690-071e-4d90-9b05-27bf2c6d894c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fff27847f74c39b425dba724cf847f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:19.672587 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1906/3799] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:30:19 2022] DELETE /identity/v3/users/a4fff27847f74c39b425dba724cf847f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:30:20.219935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:20.240752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96848809-22f4-4944-8d38-c3425b31db0e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:20.336325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:20.336999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:20.337410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:20.337787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] PATH_INFO: `/v3/projects/fdedb3257fe94513bd5c51de0ae1d737` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:20.339079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdedb3257fe94513bd5c51de0ae1d737)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:20.341291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:20.571675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdedb3257fe94513bd5c51de0ae1d737', 'request_id': 'req-286ab78e-7427-4724-9c1f-4a75d1f9a067'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:20.578854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdedb3257fe94513bd5c51de0ae1d737', 'request_id': 'req-286ab78e-7427-4724-9c1f-4a75d1f9a067'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:20.679886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdedb3257fe94513bd5c51de0ae1d737', 'request_id': 'req-286ab78e-7427-4724-9c1f-4a75d1f9a067'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:20.698155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] The token cache is being invalidate because project fdedb3257fe94513bd5c51de0ae1d737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:30:20.699099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:20.699776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-286ab78e-7427-4724-9c1f-4a75d1f9a067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:30:20.701583 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1894/3800] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:30:20 2022] DELETE /identity/v3/projects/fdedb3257fe94513bd5c51de0ae1d737 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:30:20.710032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:20.710032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:20.710032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:20.731223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:20.732766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:20.818515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1907/3801] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:20.834949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:20.834949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:20.834949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:20.848352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:20.849786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:20.865867 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1895/3802] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:30:20.870206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:20.884516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd839c-ec72-49ae-aa07-d63d56e6f17a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:20.889876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:20.890802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:20.891261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:20.891709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:20.892856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:30:20.893514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:20.896139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:20.919812 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1908/3803] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:30:20.925971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:20.937251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf639d39-fad9-47e8-9673-d1056b0145e4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:20.942968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:20.944510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:20.944510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:20.944510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:20.945117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:20.949029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:21.099555 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1896/3804] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:30:20 2022] POST /identity/v3/projects => generated 393 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:30:21.101270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:21.115587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94f34-691f-438e-a362-f824a03af336 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:21.207522 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:21.268719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:21.269454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:21.269775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:21.270906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:21.281899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:21.294979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:21.423423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1909/3805] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:30:21 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:30:21.425418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:21.447642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a573bf4-572e-4b83-8bbe-56cc43467a85 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:21.463598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:21.463598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:21.463598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:21.463931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:21.464511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:21.470128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:21.493742 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1897/3806] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:30:21.497563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:21.510240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d477ca-1d36-4371-9ceb-6e708146d3d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:21.515249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:21.516385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:21.516667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:21.516930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:21.517690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:21.519871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0aae5-f3fc-455c-af0b-4b33217eaed3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:21.538991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1910/3807] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:30:21.542951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:21.562813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96c55f-6d16-42d4-ac64-14722c60662b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:21.565935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:21.567036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:21.567558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:21.568064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] PATH_INFO: `/v3/projects/edc4c8f707304cd98a5f2e13cb1d5a5b/users/f9ec278d8d7b4a5a96af042ba613bafa/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:21.585609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc4c8f707304cd98a5f2e13cb1d5a5b, user_id=f9ec278d8d7b4a5a96af042ba613bafa, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:21.590506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:21.786288 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1898/3808] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:30:21 2022] PUT /identity/v3/projects/edc4c8f707304cd98a5f2e13cb1d5a5b/users/f9ec278d8d7b4a5a96af042ba613bafa/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:30:21.788474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651f5c-832b-434e-838e-db45b25d009b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:21.788950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651f5c-832b-434e-838e-db45b25d009b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:21.789057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651f5c-832b-434e-838e-db45b25d009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:21.810800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bf651f5c-832b-434e-838e-db45b25d009b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:21.812061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf651f5c-832b-434e-838e-db45b25d009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:21.904886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1911/3809] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:21.927512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:21.929312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:21.954421 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:22.059564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80831dda-c4c2-439f-9de0-0e51ad67e52f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:22.063823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:22.065119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:22.065538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:22.067516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:22.102764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:22.104506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:22.145078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1899/3810] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:24.783420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef517b-e34f-4cd0-81fc-666e9622b392 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:24.784386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef517b-e34f-4cd0-81fc-666e9622b392 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:24.784957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef517b-e34f-4cd0-81fc-666e9622b392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:24.811576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0eef517b-e34f-4cd0-81fc-666e9622b392 None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:24.817436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0eef517b-e34f-4cd0-81fc-666e9622b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:24.894398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1912/3811] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:25.498411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:25.510666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c683ee3-b9a8-4188-b02a-72a1bbdf01e2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:25.515664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:25.516463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:25.516947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:25.517416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:25.519351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:25.539001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:25.540747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:25.566106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1900/3812] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:28.166206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352428df-5baa-4631-b674-5ff9f9728556 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:28.166789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352428df-5baa-4631-b674-5ff9f9728556 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:28.167159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352428df-5baa-4631-b674-5ff9f9728556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:28.251225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-352428df-5baa-4631-b674-5ff9f9728556 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:28.255680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-352428df-5baa-4631-b674-5ff9f9728556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:28.422503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1913/3813] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:30:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:28.450049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:28.452448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:28.659443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ecd8-9945-468f-9d5e-2dcff7c2ef3e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:28.670803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:28.673451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:28.673731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:28.677764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:28.703535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:28.705656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5e0e9-07f5-4542-8ef8-5f05670b7911 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:28.735844 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1901/3814] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:30:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:30:33.245448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:33.246346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:33.246850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:33.255432 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:33.317233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] MFA Rules not processed for user `11293effe45345aeac9fd7dd672b738b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:33.318965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:33.707851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1914/3815] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:33.720105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d3bc4-17d0-4e53-8952-fd5c69d465f7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:33.722546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d3bc4-17d0-4e53-8952-fd5c69d465f7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:33.723011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d3bc4-17d0-4e53-8952-fd5c69d465f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:33.788868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0d9d3bc4-17d0-4e53-8952-fd5c69d465f7 None None] MFA Rules not processed for user `11293effe45345aeac9fd7dd672b738b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:33.797125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d9d3bc4-17d0-4e53-8952-fd5c69d465f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:33.817016 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1902/3816] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:33.834088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:33.838559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:34.012934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f2119-3cf6-4f46-b36b-05e53abb6db6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:34.047353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:34.051157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:34.051468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:34.051751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:34.072663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:34.076467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05cd19-eddb-415c-954b-7a0987fd49b5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:34.091323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1915/3817] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:37.258228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:37.259260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:37.259859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:37.373927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] MFA Rules not processed for user `f9ec278d8d7b4a5a96af042ba613bafa`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:37.373927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:37.533245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1903/3818] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:37.544848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca3025-a090-4bf5-a0b9-8d30bec6d9d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:37.544848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca3025-a090-4bf5-a0b9-8d30bec6d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:37.544848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca3025-a090-4bf5-a0b9-8d30bec6d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:37.610910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-36ca3025-a090-4bf5-a0b9-8d30bec6d9d4 None None] MFA Rules not processed for user `f9ec278d8d7b4a5a96af042ba613bafa`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:37.614863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-36ca3025-a090-4bf5-a0b9-8d30bec6d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:37.639301 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1916/3819] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:30:37.799797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:30:37.803649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:37.897171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b139f6-48aa-4588-ba4c-dcb435a182e8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:30:37.948806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:30:37.966656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:37.966656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:37.966656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:38.055302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:30:38.057349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456016c-7894-4442-af7d-5aecb9661d67 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:30:38.079235 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:38.093296 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1904/3820] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:30:47.575609 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=68 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:30:51.641270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:30:51.642543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:30:51.642822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:30:51.684332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:30:51.685940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:30:51.694318 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1917/3821] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:01.630739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:01.631307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:01.631564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:01.655668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:01.657297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:01.667340 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:01.676349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1905/3822] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:01.688268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:01.702565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ed63-4b72-4bd9-9cce-bfda66195a76 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:01.707649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:01.708261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:01.708536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:01.708802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:01.722629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:01.722629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:01.730369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1918/3823] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:11.650741 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:11.663136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:11.664862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:11.689496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4f3b-b4dd-4ff0-923f-2553be8c3aca None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:11.698629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:11.699680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:11.700187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:11.700725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] PATH_INFO: `/v3/users/11293effe45345aeac9fd7dd672b738b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:11.702172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11293effe45345aeac9fd7dd672b738b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:11.704395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:11.741905 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:11.985990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11293effe45345aeac9fd7dd672b738b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:11.985990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11293effe45345aeac9fd7dd672b738b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.002203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11293effe45345aeac9fd7dd672b738b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.008372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11293effe45345aeac9fd7dd672b738b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.100316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9975c4b-66a2-41d2-ac4c-c63dada0379b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11293effe45345aeac9fd7dd672b738b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.155129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1906/3824] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:31:11 2022] DELETE /identity/v3/users/11293effe45345aeac9fd7dd672b738b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:12.488629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:12.509020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093c9a0-48aa-49bd-8703-57180e1102e3 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:12.599977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:12.600768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:12.601161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:12.601580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] PATH_INFO: `/v3/projects/93c145959fe44ed1bec7c4c964be8d2e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:12.602823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c145959fe44ed1bec7c4c964be8d2e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:12.604876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:12.837634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c145959fe44ed1bec7c4c964be8d2e', 'request_id': 'req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.951886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c145959fe44ed1bec7c4c964be8d2e', 'request_id': 'req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.966902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c145959fe44ed1bec7c4c964be8d2e', 'request_id': 'req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.987547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] The token cache is being invalidate because project 93c145959fe44ed1bec7c4c964be8d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:31:12.997552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.997552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-061dbacd-8a3b-47b0-b88c-1e55c5969e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:12.997552 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1919/3825] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:12 2022] DELETE /identity/v3/projects/93c145959fe44ed1bec7c4c964be8d2e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:13.025314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.026112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.027032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.069720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:13.074060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:13.220950 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1907/3826] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:13.228489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.228920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.229217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.249641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:13.250847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:13.259600 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1920/3827] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:13.263910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:13.274121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a82726-29eb-4c5a-967a-cf00ac3d5ae2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:13.278978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:13.279883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.280236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.280575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.281292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:31:13.281713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:13.283377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:13.295336 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1908/3828] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:31:13.299758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:13.309869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd659825-86f3-4575-a9e3-4eccb2f44366 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:13.314531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:13.315127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.315396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.315662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.316364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:13.318384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:13.676205 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1921/3829] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:31:13 2022] POST /identity/v3/projects => generated 381 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:31:13.677295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:13.688986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13621ef7-c122-4128-86d5-c2b4a88ae0ae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:13.748091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:13.748726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.749003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.749275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.750050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:13.757677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:13.763941 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:13.902964 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1909/3830] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:31:13 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:31:13.906890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:13.921693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830bd3d-541d-4bbd-a65b-6a51d63fa385 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:13.929019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:13.929772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.930122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.930898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.932766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:13.934702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:13.955813 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1922/3831] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:13.959803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:13.970283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89009d45-ba3d-4136-afc8-b23c372541fa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:13.976395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:13.977078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:13.977378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:13.977903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:13.978617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:13.983099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ee069-dcfb-4130-b499-5714b5938301 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:13.995890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1910/3832] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:14.000058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:14.012001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf99a-0127-454e-a20b-f93930388c1d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:14.020422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:14.021083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:14.021384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:14.021665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] PATH_INFO: `/v3/projects/3efbfd76a9a74c03907d7d9be25f42d4/users/0bce487302c24def8a8473b0725904f2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:14.039036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efbfd76a9a74c03907d7d9be25f42d4, user_id=0bce487302c24def8a8473b0725904f2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:14.041919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:14.113802 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1923/3833] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:31:13 2022] PUT /identity/v3/projects/3efbfd76a9a74c03907d7d9be25f42d4/users/0bce487302c24def8a8473b0725904f2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:14.118453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:14.119363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:14.119840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:14.146332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:14.148445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:14.229454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1911/3834] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:31:14.240099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:14.242797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:14.294935 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:14.331716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594fc1c-a96b-4a0e-91f5-909e02529de0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:14.336747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:14.339252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:14.340255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:14.341775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:14.353375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:14.354979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea865b28-32b6-45f2-b5ac-9b5d398c3875 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:14.385169 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1924/3835] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:21.544445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:21.545945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:21.637932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84ac9-f802-4572-8349-a1717dcba518 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:21.651002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:21.653485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:21.654175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:21.655610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] PATH_INFO: `/v3/users/fa81b46047264f31a370b6178bb28248` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:21.658544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa81b46047264f31a370b6178bb28248)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:21.662190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:22.002633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa81b46047264f31a370b6178bb28248'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:22.004258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa81b46047264f31a370b6178bb28248'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:22.031357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa81b46047264f31a370b6178bb28248'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:22.032475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa81b46047264f31a370b6178bb28248'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:22.140597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa81b46047264f31a370b6178bb28248'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:22.208952 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1912/3836] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:31:21 2022] DELETE /identity/v3/users/fa81b46047264f31a370b6178bb28248 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:22.213655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:22.214226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:22.214226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:22.251794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:22.253666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:22.366884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1925/3837] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:22.377623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:22.379517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:22.432325 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:22.550395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df548-66d2-420f-8c48-e9fb300ee93c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:22.566044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:22.566756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:22.567106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:22.567455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:22.588834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:22.592648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940042-c58f-4299-8eb7-5e6a777066a7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:22.605651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1913/3838] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:23.700431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:23.700431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:23.759691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4844-d11d-41b6-8ef2-974bf53cf95c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:23.780177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:23.784452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:23.787298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:23.787603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] PATH_INFO: `/v3/projects/cb013c1fbdd648c19673149ffba6886b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:23.800964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb013c1fbdd648c19673149ffba6886b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:23.804608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:24.023955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38271-2f9f-48c3-a675-1709b18cd5f2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:24.024452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38271-2f9f-48c3-a675-1709b18cd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:24.026494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38271-2f9f-48c3-a675-1709b18cd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:24.074139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb013c1fbdd648c19673149ffba6886b', 'request_id': 'req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.093057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eea38271-2f9f-48c3-a675-1709b18cd5f2 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:24.094783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eea38271-2f9f-48c3-a675-1709b18cd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:24.228817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb013c1fbdd648c19673149ffba6886b', 'request_id': 'req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.240490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb013c1fbdd648c19673149ffba6886b', 'request_id': 'req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.263290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] The token cache is being invalidate because project cb013c1fbdd648c19673149ffba6886b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:31:24.266821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.266821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.269018 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1926/3839] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:23 2022] DELETE /identity/v3/projects/cb013c1fbdd648c19673149ffba6886b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:24.273652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1914/3840] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:24.275217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:24.276051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:24.276366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:24.276658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:24.280558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:24.306211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:24.312438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:24.323369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1915/3841] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:24.396274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:24.402555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:24.406955 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:24.431829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1314-d5f1-4ce7-9d03-26e3364cbd8f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:24.438366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:24.439198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:24.439548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:24.440047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] PATH_INFO: `/v3/users/ae2f720411894277b0e4d70d6f76bb96` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:24.441582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2f720411894277b0e4d70d6f76bb96)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:24.444958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:24.557591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b999fbe-45c0-4933-862d-cdedf741bce1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:24.563136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:24.563742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:24.564016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:24.564284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:24.566084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:24.577767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:24.580007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:24.589244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1916/3842] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:31:24.747602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2f720411894277b0e4d70d6f76bb96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.885244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2f720411894277b0e4d70d6f76bb96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.888465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2f720411894277b0e4d70d6f76bb96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.916360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2f720411894277b0e4d70d6f76bb96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.933205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b547bf71-13ef-4b9e-9ded-444200ef31c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2f720411894277b0e4d70d6f76bb96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:24.940243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1927/3843] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:31:24 2022] DELETE /identity/v3/users/ae2f720411894277b0e4d70d6f76bb96 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:25.242972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:25.256508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9783-1817-4184-8d1a-8818db3fde83 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:25.274215 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:25.342381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:25.343025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:25.343305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:25.343577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] PATH_INFO: `/v3/projects/3e88637cec784dbdb7b39c8c289ba193` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:25.344882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e88637cec784dbdb7b39c8c289ba193)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:25.346818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:25.470634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e88637cec784dbdb7b39c8c289ba193', 'request_id': 'req-04c38920-9852-4d04-b111-9fa4a41f8731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:25.479044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e88637cec784dbdb7b39c8c289ba193', 'request_id': 'req-04c38920-9852-4d04-b111-9fa4a41f8731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:25.604306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e88637cec784dbdb7b39c8c289ba193', 'request_id': 'req-04c38920-9852-4d04-b111-9fa4a41f8731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:25.620630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] The token cache is being invalidate because project 3e88637cec784dbdb7b39c8c289ba193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:31:25.621776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:25.623037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-04c38920-9852-4d04-b111-9fa4a41f8731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:25.638138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1917/3844] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:25 2022] DELETE /identity/v3/projects/3e88637cec784dbdb7b39c8c289ba193 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:25.639633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a8c9-3e87-4d89-ae14-dc2816db2493 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:25.640025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a8c9-3e87-4d89-ae14-dc2816db2493 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:25.640403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488a8c9-3e87-4d89-ae14-dc2816db2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:25.676655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e488a8c9-3e87-4d89-ae14-dc2816db2493 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:25.678165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e488a8c9-3e87-4d89-ae14-dc2816db2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:25.791632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:25.792237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:25.792957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:25.832746 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1928/3845] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:25.835311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:25.835311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:25.835311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:25.844498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:25.845802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:25.856969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:25.858513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:25.872617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1929/3846] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:25.889213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:25.915108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553fc11-5d60-4680-839a-691f20fb9c21 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:25.924631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:25.925472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:25.925760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:25.926029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:25.926736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:31:25.927038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:25.928697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:25.957496 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1930/3847] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:31:25.964979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:25.997015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d51bb7-f6a3-4e2e-af11-bdd8c0f732c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:26.000555 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1918/3848] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:26.012903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:26.014417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.014417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.014417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.015249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:26.017287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed014d-dd89-4914-9217-f82d3c051123 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:26.223245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1931/3849] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:31:25 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:31:26.227771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:26.245820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54bb1a-95f2-4101-bd0c-ada1cc6f399e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:26.374892 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:26.405079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:26.405717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.405993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.406262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.406889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:26.408815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:26.526385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.526666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.526939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.564091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:26.568169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:26.577564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1919/3850] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:31:26 2022] POST /identity/v3/users => generated 286 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:31:26.579610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:26.606847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa441f-aed9-45a8-b913-cea5be2bb694 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:26.632643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:26.633453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.633623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.633936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.634709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:26.646042 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:26.647887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:26.715707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1920/3851] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:26.730528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:26.764031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf06ad-ed7a-4536-b79b-ff6eb606979c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:26.780606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:26.781266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.783903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.784370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.787289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:26.788984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:26.804601 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1921/3852] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:26.807508 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1932/3853] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:31:26.813296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:26.824043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:26.825492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:26.827892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5157c4d-8225-485a-b0cb-da3cdecb2692 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:26.843503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:26.844169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:26.844447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:26.844719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] PATH_INFO: `/v3/projects/d6bd8b0ad06c4f188946291ca96b551c/users/1104201e8b024625ac96a782beee10e0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:26.900866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bd8b0ad06c4f188946291ca96b551c, user_id=1104201e8b024625ac96a782beee10e0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:26.903702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d3909-9a80-43c4-8e5f-1a1833b41d9b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:26.998917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc5bd9-695b-4cf1-b5d4-bbff205b0014 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:27.006716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:27.008289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1922/3854] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:31:26 2022] PUT /identity/v3/projects/d6bd8b0ad06c4f188946291ca96b551c/users/1104201e8b024625ac96a782beee10e0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:27.008574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:27.009086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:27.009624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:27.019379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596870b-c52c-41bc-a76e-963feae464f7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:27.019598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596870b-c52c-41bc-a76e-963feae464f7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:27.019794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596870b-c52c-41bc-a76e-963feae464f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:27.035813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:27.040039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:27.065212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1933/3855] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:31:27.102150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6596870b-c52c-41bc-a76e-963feae464f7 None None] MFA Rules not processed for user `1104201e8b024625ac96a782beee10e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:27.103452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6596870b-c52c-41bc-a76e-963feae464f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:27.246059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1923/3856] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:31:27.253223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:27.255099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:27.342836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a91f2-8bce-4af0-a899-6461d2efc848 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:27.415185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:27.416489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:27.416980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:27.417471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:27.447559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:27.450745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:27.474294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1934/3857] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:28.628916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767da9-35a2-4eb3-8c68-7e47e86b3e82 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:28.630005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767da9-35a2-4eb3-8c68-7e47e86b3e82 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:28.630099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767da9-35a2-4eb3-8c68-7e47e86b3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:28.667292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-54767da9-35a2-4eb3-8c68-7e47e86b3e82 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:28.669877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54767da9-35a2-4eb3-8c68-7e47e86b3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:28.756490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1924/3858] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:31:28.785313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:28.876172 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:29.017227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d66f5a-ceff-40e9-9517-4ae9eda81122 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:29.023872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:29.024503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:29.024910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:29.025238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:29.038944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:29.041193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:29.051360 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1935/3859] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:30.427566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:30.429929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:30.429929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:30.479966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:30.481678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:30.495712 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1925/3860] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:30.510727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:30.534034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f39cf-b762-4041-9eb7-7bcfc149ab0c service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:30.540360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:30.541281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:30.541814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:30.542368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:30.554255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:30.556621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011f045-1561-4347-a38a-86a3a4b1b43c service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:30.586009 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1936/3861] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:39.024250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:39.027037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:39.051037 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:39.130448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc5c6-89e0-4721-affe-17c06fc0ea0b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:39.137143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:39.137812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:39.138305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:39.138868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:39.141241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:39.156530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:39.158383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:39.172890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1926/3862] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:40.418135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:40.418726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:40.418726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:40.454310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] MFA Rules not processed for user `6134c05549f14bc19962acea9c913f53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:40.459547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:40.554555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1937/3863] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:43.348484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:43.350605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:43.420842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcbb9e-0943-407b-9c10-08f1bccf1d52 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:43.426255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:43.426749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:43.427029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:43.427309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] PATH_INFO: `/v3/users/2fd2e319840c4a8aab90b495374aa1d2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:43.428523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd2e319840c4a8aab90b495374aa1d2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:43.430534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:43.668058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd2e319840c4a8aab90b495374aa1d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:43.668872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd2e319840c4a8aab90b495374aa1d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:43.677165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd2e319840c4a8aab90b495374aa1d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:43.677967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd2e319840c4a8aab90b495374aa1d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:43.770599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-37f9b086-48a9-4578-b7b2-2456aa237ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd2e319840c4a8aab90b495374aa1d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:43.789770 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1927/3864] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:31:43 2022] DELETE /identity/v3/users/2fd2e319840c4a8aab90b495374aa1d2 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:44.086224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.105077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c05e-a211-4589-98b9-012442e0c8d6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.188929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.189620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.189947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.190218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] PATH_INFO: `/v3/projects/0eba4d14f2004498850092bff100b757` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.191328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eba4d14f2004498850092bff100b757)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.193480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.298745 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:44.308238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eba4d14f2004498850092bff100b757', 'request_id': 'req-bb890e12-29e0-46fe-bf63-75faf13f6cbd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:44.369424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eba4d14f2004498850092bff100b757', 'request_id': 'req-bb890e12-29e0-46fe-bf63-75faf13f6cbd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:44.376387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eba4d14f2004498850092bff100b757', 'request_id': 'req-bb890e12-29e0-46fe-bf63-75faf13f6cbd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:44.388468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] The token cache is being invalidate because project 0eba4d14f2004498850092bff100b757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:31:44.389894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:44.389894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb890e12-29e0-46fe-bf63-75faf13f6cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:31:44.391192 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1938/3865] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:31:44 2022] DELETE /identity/v3/projects/0eba4d14f2004498850092bff100b757 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:31:44.397359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.397901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.398030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.419956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:44.421329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:44.426154 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:44.504669 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1928/3866] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:44.506454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.506733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.507003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.536305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:44.537501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:44.546027 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1939/3867] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:44.550309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.560847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e58c7-6ab3-458d-a3b0-5fbd1de2cca0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.566150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.566860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.567213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.568229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.569159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:31:44.569649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.572004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.586095 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1929/3868] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:31:44.590755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.602126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39ed76-684a-490c-b56c-ef24be66b191 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.607702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.607702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.607702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.608039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.608405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.610354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.696965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1940/3869] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:31:44.698167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.714112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d556e3e-0d97-4838-995b-69f606d5ec9d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.786555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.787185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.787448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.787719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.788344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.790341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.865207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1930/3870] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:31:44 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:31:44.869651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.883888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af64dd-c95c-47e8-a16a-0fabe0b2ee71 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.897671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.898405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.898686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.899492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.900054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.901751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.914224 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1941/3871] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:44.921543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.932729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d60c68-7334-4aa0-b731-325caef34072 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.938332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.938946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.939221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.939492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.940678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.942306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fade4a-b814-42ac-89cc-a450d6a32d9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:44.958087 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1931/3872] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:31:44.959269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:44.970131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0f924-50ce-4bb0-b2c0-3745572a9621 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:44.975240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:44.975940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:44.976220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:44.976493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] PATH_INFO: `/v3/projects/8b25b290c8004e1f8f89e17b448f242a/users/b0d4603acbc846dcb2f523091cd78ae4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:44.994051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b25b290c8004e1f8f89e17b448f242a, user_id=b0d4603acbc846dcb2f523091cd78ae4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:44.997012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:45.063675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1942/3873] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:31:44 2022] PUT /identity/v3/projects/8b25b290c8004e1f8f89e17b448f242a/users/b0d4603acbc846dcb2f523091cd78ae4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:31:45.069914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63af4c-d907-46c9-b25c-d950cdc4d7f3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:45.070282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63af4c-d907-46c9-b25c-d950cdc4d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:45.070801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63af4c-d907-46c9-b25c-d950cdc4d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:45.091639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2e63af4c-d907-46c9-b25c-d950cdc4d7f3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:45.093058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e63af4c-d907-46c9-b25c-d950cdc4d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:45.157870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1932/3874] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:45.168374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:45.170278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:45.230400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe85f2-f580-4426-825c-0c0a26efd015 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:45.234096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:45.234714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:45.235048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:45.235349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:45.246124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:45.247562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9828-ed8d-4de6-9675-51e747a3cfaf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:45.258278 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1943/3875] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:47.591177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e8eb-923a-4214-a689-f9609030ee86 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:47.591772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e8eb-923a-4214-a689-f9609030ee86 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:47.591772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278e8eb-923a-4214-a689-f9609030ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:47.656027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f278e8eb-923a-4214-a689-f9609030ee86 None None] MFA Rules not processed for user `b0d4603acbc846dcb2f523091cd78ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:47.656027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f278e8eb-923a-4214-a689-f9609030ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:47.665448 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:47.796372 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1933/3876] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:47.798201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:47.799239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:47.799348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:47.826442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] MFA Rules not processed for user `b0d4603acbc846dcb2f523091cd78ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:47.831464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:47.859858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1944/3877] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:47.863027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fe69-fc42-484a-8cfc-956ea4205f80 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:47.863027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fe69-fc42-484a-8cfc-956ea4205f80 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:47.863234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6fe69-fc42-484a-8cfc-956ea4205f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:47.919126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-efa6fe69-fc42-484a-8cfc-956ea4205f80 None None] MFA Rules not processed for user `b0d4603acbc846dcb2f523091cd78ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:47.921399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-efa6fe69-fc42-484a-8cfc-956ea4205f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:47.931021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1934/3878] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:48.461406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:48.462872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:48.565572 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:48.593917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a790-95f7-4b27-bb5a-9ac2b9c6d473 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:48.603118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:48.604161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:48.604378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:48.604775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:48.621630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:48.625175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c6d8b-3080-436d-a243-8cada7a3fa9c service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:48.652631 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1945/3879] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:49.112476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:49.113088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:49.114027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:49.156232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:49.157925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:49.246413 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1935/3880] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:50.399784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce45d2-3a5d-4a8a-a361-4c788e979f68 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:50.400978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce45d2-3a5d-4a8a-a361-4c788e979f68 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:50.401488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce45d2-3a5d-4a8a-a361-4c788e979f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:50.446531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-50ce45d2-3a5d-4a8a-a361-4c788e979f68 None None] MFA Rules not processed for user `b0d4603acbc846dcb2f523091cd78ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:50.447936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-50ce45d2-3a5d-4a8a-a361-4c788e979f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:50.459966 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1946/3881] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:53.564767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:53.566304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:53.690737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a69e6-3d7e-4696-98ba-5a70a9df3386 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:53.700191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:53.701043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:53.701455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:53.701823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:53.703923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:53.782790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:53.784552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23aa8-8e38-4138-9193-f7cee39e530e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:53.821163 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1936/3882] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:54.294605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:54.295136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:54.295136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:54.328173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] MFA Rules not processed for user `b0d4603acbc846dcb2f523091cd78ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:54.329950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:54.354953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f3850-8836-43f3-8a88-cfee42854d41 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:54.355323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f3850-8836-43f3-8a88-cfee42854d41 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:54.355667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f3850-8836-43f3-8a88-cfee42854d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:54.355968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1947/3883] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:54.395331 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:54.406572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fb0f3850-8836-43f3-8a88-cfee42854d41 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:54.406572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fb0f3850-8836-43f3-8a88-cfee42854d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:54.512475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1937/3884] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:54.527817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:54.535937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:54.624974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffcc63-349b-477c-bf6a-13fcc8613120 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:54.632461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:54.633277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:54.633897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:54.634230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:54.644705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:54.646624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:54.660995 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1948/3885] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:57.229830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752adcb-72a7-470d-9af8-aef3cb49cf90 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:57.231398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752adcb-72a7-470d-9af8-aef3cb49cf90 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:57.231398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752adcb-72a7-470d-9af8-aef3cb49cf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:57.280631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a752adcb-72a7-470d-9af8-aef3cb49cf90 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:57.282257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a752adcb-72a7-470d-9af8-aef3cb49cf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:57.318237 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1938/3886] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:57.319476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:57.341479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc30-a5a3-417b-b8f4-9f95a7e40b26 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:57.351539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:57.352356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:57.353031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:57.354859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:57.377844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:57.379933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bedbf-3729-401a-b137-505acdbb3af2 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:57.406951 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1949/3887] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:57.717583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:57.717942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:57.718226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:57.721246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1939/3888] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:31:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:31:57.729506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:57.730188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:57.735650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:57.852666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:57.853939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:57.926941 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1950/3889] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:31:58.003843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:58.006230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:58.032998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7f0d3-9076-436c-b18a-3e56864d051e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:58.038078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:58.038948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:58.039433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:58.039893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:58.050655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:58.052867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911517-8f22-4059-a74f-1c24f80d2216 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:58.064369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1940/3890] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:59.073295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:59.074709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:59.173078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4329176-ce10-4f30-98c7-8a1c821c72e5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:59.182858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:59.182858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:59.182858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:59.182858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:59.183198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:59.199413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:59.203908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:59.216595 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:31:59.216668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:59.217093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:59.217222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:59.220886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1951/3891] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:31:59.248115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:31:59.250176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:31:59.258919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1941/3892] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:31:59.278017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:59.290817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063d3c2-90d2-46d2-affe-cbf1995a7f65 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:31:59.299684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:31:59.302931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:31:59.303471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:31:59.303898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:31:59.323758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:31:59.325684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e6f3a-5152-48ea-ba95-2f09ea5618ea service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:31:59.343567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1952/3893] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:31:59.817213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:31:59.819519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:00.054211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2c8fa-3f4a-455e-9c40-efb674281cd4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:00.054211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:00.054211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:00.054211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:00.054864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] PATH_INFO: `/v3/users/fea8a24166674250a98268ae52604f12` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:00.054864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea8a24166674250a98268ae52604f12)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:00.054864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:00.300544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea8a24166674250a98268ae52604f12'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:00.312079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea8a24166674250a98268ae52604f12'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:00.336581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea8a24166674250a98268ae52604f12'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:00.338099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea8a24166674250a98268ae52604f12'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:00.483201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea8a24166674250a98268ae52604f12'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:00.552684 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1942/3894] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:31:59 2022] DELETE /identity/v3/users/fea8a24166674250a98268ae52604f12 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:00.554772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:00.602790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:00.602790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:00.602790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:00.602790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:00.719642 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1953/3895] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:00.797746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:00.804338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:00.856664 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:00.887193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2493959-7331-4f05-907c-6cf49f5c8554 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:00.895735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:00.896503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:00.896779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:00.897046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:00.907384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:00.908876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cc6ea-5f0c-4b5c-b159-452c19e4701d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:00.920466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1943/3896] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:01.279235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:01.282350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:01.308042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e22af-2581-4a8c-b287-f3448e43dc73 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:01.312962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:01.314600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.314600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.314600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] PATH_INFO: `/v3/projects/d1fcce1fadf54d089ec4fd751a3cf6ae` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.315591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1fcce1fadf54d089ec4fd751a3cf6ae)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:01.318358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:01.443491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'request_id': 'req-2140e1fe-f9fb-42d0-be68-86955e173dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:01.518236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'request_id': 'req-2140e1fe-f9fb-42d0-be68-86955e173dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:01.526243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1fcce1fadf54d089ec4fd751a3cf6ae', 'request_id': 'req-2140e1fe-f9fb-42d0-be68-86955e173dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:01.538318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] The token cache is being invalidate because project d1fcce1fadf54d089ec4fd751a3cf6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:01.538659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:01.539328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2140e1fe-f9fb-42d0-be68-86955e173dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:01.540841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1954/3897] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:01 2022] DELETE /identity/v3/projects/d1fcce1fadf54d089ec4fd751a3cf6ae => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:01.546086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.546554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.547532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.587477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:01.588697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:01.649886 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1944/3898] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:01.657614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.658103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.658218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.678575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:01.679790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:01.689394 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1955/3899] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:01.693267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:01.703208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed419-ab88-44ec-817b-ad72ec854994 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:01.708645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:01.709271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.709589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.709949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.711032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:01.711509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:01.713854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:01.729619 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1945/3900] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:01.730826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:01.741066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bd3c-2dc2-4f6d-a4b2-e20d45cf84df None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:01.745857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:01.746503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.746778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.747050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.747707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:01.749765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:01.852213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1956/3901] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:01.852368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:01.863086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bcdf3-b7b9-4a47-b805-708a97da0236 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:01.950552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:01.951172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:01.951453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:01.951784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:01.952427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:01.955627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:02.039322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1946/3902] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:01 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:02.043108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:02.057415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aacea7-54a9-4bbe-b3e4-0a60f581a7d5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:02.073584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:02.074219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:02.074586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:02.075151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:02.078113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:02.085206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:02.101977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1957/3903] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:02.103937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:02.115042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad56490-da0a-4029-a522-df9f66347276 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:02.120627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:02.121476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:02.121870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:02.123550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:02.124499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:02.127099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37d220-c870-430b-b8e7-e413c451bbd2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:02.153996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1947/3904] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:32:02.155810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:02.167484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658db89-4cf5-4395-80d1-14aa6c8c80c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:02.174481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:02.175460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:02.175838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:02.176326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] PATH_INFO: `/v3/projects/09d179276dbf4e4d9cb780b18e7a22c7/users/88ac5422c8f048148aac2c9b62e0482e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:02.211617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d179276dbf4e4d9cb780b18e7a22c7, user_id=88ac5422c8f048148aac2c9b62e0482e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:02.214965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:02.286185 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:02.290501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1958/3905] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:02 2022] PUT /identity/v3/projects/09d179276dbf4e4d9cb780b18e7a22c7/users/88ac5422c8f048148aac2c9b62e0482e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:02.295739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe108-aa95-46f6-856b-728eaa61a522 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:02.296431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe108-aa95-46f6-856b-728eaa61a522 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:02.298215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abe108-aa95-46f6-856b-728eaa61a522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:02.322724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a9abe108-aa95-46f6-856b-728eaa61a522 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:02.324670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a9abe108-aa95-46f6-856b-728eaa61a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:02.359761 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:02.448526 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1948/3906] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:02.502773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:02.504495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:02.605426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182628-3b12-455e-a79b-09cd2ab2947c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:02.610065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:02.611556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:02.612420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:02.612705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:02.624182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:02.626286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489fd13-3c2c-4191-871c-356b80531667 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:02.637309 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1959/3907] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:06.047185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:06.048061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:06.048558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:06.077552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] MFA Rules not processed for user `ef5f8a3e6fef4d6393603575479b16a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:06.079421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:06.159111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1949/3908] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:13.517276 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=27 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:14.503332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222e2e4-63e1-444b-b8e4-64d74cb5498b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:14.503790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222e2e4-63e1-444b-b8e4-64d74cb5498b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:14.504359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222e2e4-63e1-444b-b8e4-64d74cb5498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:14.541430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e222e2e4-63e1-444b-b8e4-64d74cb5498b None None] MFA Rules not processed for user `88ac5422c8f048148aac2c9b62e0482e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:14.543621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e222e2e4-63e1-444b-b8e4-64d74cb5498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:14.648539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1960/3909] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:14.661511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:14.663155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:14.777798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8cc72a-6c14-44b1-9623-3607df1bdb9d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:14.790412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:14.791155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:14.791531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:14.791950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:14.811210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:14.813653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:14.824045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1950/3910] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:16.430842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:16.431314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:16.431399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:16.485624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] MFA Rules not processed for user `88ac5422c8f048148aac2c9b62e0482e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:16.487739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:16.499838 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1961/3911] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:21.355237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:21.356804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:21.416016 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:21.434294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d4fb-c10c-4f00-bc54-faa0abcafa71 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:21.439902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:21.440497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:21.440786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:21.441054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:21.442882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:21.456277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:21.457885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:21.469846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1951/3912] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:21.640197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:21.642542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:21.661641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee36b2-51c6-43b9-9b27-46ccfa3e6ffd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:21.675798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:21.676794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:21.677258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:21.677721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] PATH_INFO: `/v3/users/f9ec278d8d7b4a5a96af042ba613bafa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:21.679005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ec278d8d7b4a5a96af042ba613bafa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:21.681842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:21.918044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ec278d8d7b4a5a96af042ba613bafa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:21.995486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ec278d8d7b4a5a96af042ba613bafa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:21.996778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ec278d8d7b4a5a96af042ba613bafa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.012724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ec278d8d7b4a5a96af042ba613bafa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.038374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d4bbbc-9258-4846-98a4-7457c70d1786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ec278d8d7b4a5a96af042ba613bafa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.048878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1962/3913] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:21 2022] DELETE /identity/v3/users/f9ec278d8d7b4a5a96af042ba613bafa => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:22.449839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:22.466115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376c2c9-ce7c-443f-a245-04534f2b8cc1 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:22.541010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:22.541714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:22.545619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:22.545619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] PATH_INFO: `/v3/projects/edc4c8f707304cd98a5f2e13cb1d5a5b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:22.545619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc4c8f707304cd98a5f2e13cb1d5a5b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:22.546379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:22.698179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'request_id': 'req-8d121796-d1f1-4867-977e-d61a861acdd8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.699795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'request_id': 'req-8d121796-d1f1-4867-977e-d61a861acdd8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.819045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc4c8f707304cd98a5f2e13cb1d5a5b', 'request_id': 'req-8d121796-d1f1-4867-977e-d61a861acdd8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.832594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] The token cache is being invalidate because project edc4c8f707304cd98a5f2e13cb1d5a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:22.833027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.834516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8d121796-d1f1-4867-977e-d61a861acdd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:22.836454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1952/3914] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:22 2022] DELETE /identity/v3/projects/edc4c8f707304cd98a5f2e13cb1d5a5b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:22.846880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87221-c61d-4be6-9690-551657cb540f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:22.847486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87221-c61d-4be6-9690-551657cb540f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:22.847486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87221-c61d-4be6-9690-551657cb540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:22.869928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99b87221-c61d-4be6-9690-551657cb540f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:22.871470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99b87221-c61d-4be6-9690-551657cb540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:22.935918 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:22.947699 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1963/3915] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:22.955729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:22.956019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:22.956357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:22.978207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:22.981399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:22.989592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1953/3916] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:22.994368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87221-c61d-4be6-9690-551657cb540f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.005644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87221-c61d-4be6-9690-551657cb540f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.011644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.012281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.012589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.012826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.014373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:23.014678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.016305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.033510 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1964/3917] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:23.035911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.047414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec3650-0b77-4e25-9914-caed64db62b0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.052667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.053354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.053636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.053912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.054720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.057938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.157106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1954/3918] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:23.161396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.172600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0431d-ec04-4b99-87b4-d70fd6515155 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.242393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.243005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.243278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.243550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.244190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.246204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.338810 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1965/3919] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:23.343638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.355023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b6611-79f0-4471-8f81-71bba4cc838d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.360012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.360630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.360942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.361219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.361931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.363560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.375451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1955/3920] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:23.380865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.393375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b125-8b60-4924-b6cc-d9006f1906c4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.398441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.399839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.399839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.399839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.400345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.401975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7603c0-dd0d-44ea-8d5b-ccb33bb298e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.416819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1966/3921] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:23.418208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.428923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dcb60-b676-4df0-b523-e728e1b56e97 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.433853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.434535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.444582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.444582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] PATH_INFO: `/v3/projects/65087adfc404406e9933a0d1493a4c41/users/6e74340ddb754aa18da265e2591859e2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.451650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65087adfc404406e9933a0d1493a4c41, user_id=6e74340ddb754aa18da265e2591859e2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.454422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50cd3-0ae9-491c-8a53-0e0089717676 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.532991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1956/3922] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:23 2022] PUT /identity/v3/projects/65087adfc404406e9933a0d1493a4c41/users/6e74340ddb754aa18da265e2591859e2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:23.543453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.543735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.544005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.602446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.602989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.603466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.615201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] MFA Rules not processed for user `6e74340ddb754aa18da265e2591859e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:23.615201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:23.626608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:23.628190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:23.635688 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:23.724220 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1957/3923] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:23.758825 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1967/3924] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:23.759049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.839443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435895d-4d3f-4263-baea-edcde61535eb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:23.844634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:23.849494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:23.849494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:23.849494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:23.849494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:23.849494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:23.959998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1958/3925] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:23.960971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:23.971923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2aff3-2c6c-43a0-9b38-50d212de7ac7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.027473 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:24.037258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.039068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.039068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.039068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.039339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.041209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.125410 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1968/3926] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:23 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:24.126921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.138724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bbb27-4dd7-4181-84d6-ad3fbbb9efb0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.144208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.148874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.148874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.148874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.148874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.148874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.159318 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1959/3927] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:32:24.163450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.175356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347335-e6f4-4a60-97de-5caa8f838a21 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.180074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.180722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.182465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.182465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] PATH_INFO: `/v3/projects/f8924aeb4a544f23a714af815be0cb3b/users/e90037fbad714dba8c670c0b81167cbf/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.195999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8924aeb4a544f23a714af815be0cb3b, user_id=e90037fbad714dba8c670c0b81167cbf, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.198730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.265176 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1969/3928] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:24 2022] PUT /identity/v3/projects/f8924aeb4a544f23a714af815be0cb3b/users/e90037fbad714dba8c670c0b81167cbf/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:24.270328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.290739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840087ca-eec7-4b3b-9046-07e21d780da7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.353864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.354111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.354223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.354489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.355126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.357735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9dbb0-5002-400a-8462-b56079bc83bd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.368330 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1960/3929] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:24.372448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.385946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83882925-17a3-49f3-a6b5-5cd4b9981146 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.390605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.391262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.391540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.391814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] PATH_INFO: `/v3/projects/f8924aeb4a544f23a714af815be0cb3b/users/e90037fbad714dba8c670c0b81167cbf/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.393737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8924aeb4a544f23a714af815be0cb3b, user_id=e90037fbad714dba8c670c0b81167cbf, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.396367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.407446 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1970/3930] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:24 2022] PUT /identity/v3/projects/f8924aeb4a544f23a714af815be0cb3b/users/e90037fbad714dba8c670c0b81167cbf/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:24.418705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.419117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.419461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.448548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] MFA Rules not processed for user `e90037fbad714dba8c670c0b81167cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:24.449762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:24.462336 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:24.526230 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1961/3931] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:24.531378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.551304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118abc-9cf8-4467-b7ba-a8467f081a0c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.557477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.558375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.558995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.559469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.561704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.562903 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:24.562903 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:24.562903 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:24.564149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.675362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1971/3932] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:32:24 2022] POST /identity/v3/domains => generated 275 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:24.676146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.689260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91ae22-9112-4650-9310-dad3ad172b3c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.752907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.753671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.753961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.754234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.754890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.756844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:24.868732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1962/3933] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:32:24 2022] POST /identity/v3/domains => generated 276 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:24.870252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:24.882558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59117609-54fb-4b86-9196-abd93d02c225 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:24.944433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:24.945070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:24.945416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:24.945638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:24.946300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:24.947873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:25.014181 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1972/3934] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:32:24 2022] POST /identity/v3/domains => generated 277 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:25.018381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:25.029008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355d949-8852-44f5-b2a0-f380f596514c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:25.089544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:25.090057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:25.090333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:25.090604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:25.091276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:25.092986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:25.186242 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1963/3935] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:32:25 2022] POST /identity/v3/domains => generated 280 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:25.186369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:25.199573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9c1db-40fc-4fb9-8e12-796776f24aa1 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:25.271296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:25.272081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:25.272359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:25.272631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/9758cc951506474bbee2278f11c46baf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:25.286056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9758cc951506474bbee2278f11c46baf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:25.291007 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:25.291007 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:25.291007 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:25.291007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:25.312613 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:25.319679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9758cc951506474bbee2278f11c46baf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.340115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9758cc951506474bbee2278f11c46baf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.436683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.508226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.515235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.526289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project 9758cc951506474bbee2278f11c46baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:25.526564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.527352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.538172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.539157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.550616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9758cc951506474bbee2278f11c46baf', 'request_id': 'req-93a695e0-ba75-4280-b060-bef4ea290b2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.585417 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1973/3936] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:25 2022] DELETE /identity/v3/domains/9758cc951506474bbee2278f11c46baf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:25.589203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:25.591098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:25.603906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b5fda-6be2-44e4-a53a-b7ac9f3a7333 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:25.641068 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:25.667509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:25.668347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:25.668826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:25.671393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:25.672479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:25.675039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:25.789129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1964/3937] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:32:25 2022] POST /identity/v3/domains => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:25.794166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:25.814423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a695e0-ba75-4280-b060-bef4ea290b2d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:25.888976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:25.890106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:25.890587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:25.891036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/8651bcfaf460472ea1d9acd9fe08e2e2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:25.929658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8651bcfaf460472ea1d9acd9fe08e2e2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:25.929658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:25.969508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:25.972068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.056083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.057887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.062930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1974/3938] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:25 2022] PATCH /identity/v3/domains/8651bcfaf460472ea1d9acd9fe08e2e2 => generated 250 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:26.066891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:26.069506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:26.095793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f905be-8dfe-4b05-bc79-f84aca308a1d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:26.169124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:26.169124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:26.169124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:26.169402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/8651bcfaf460472ea1d9acd9fe08e2e2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:26.183040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8651bcfaf460472ea1d9acd9fe08e2e2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:26.184735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:26.213176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.218448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.380531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.412441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.486859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.515408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project 8651bcfaf460472ea1d9acd9fe08e2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:26.516078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.517449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.537086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.547828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.549175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8651bcfaf460472ea1d9acd9fe08e2e2', 'request_id': 'req-c3304d62-8641-44d0-92af-cf1d71d7d76a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:26.570227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1965/3939] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:26 2022] DELETE /identity/v3/domains/8651bcfaf460472ea1d9acd9fe08e2e2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:26.570348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:26.583010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de419c-e7a9-467c-9c37-4669609c749d tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:26.612155 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:26.698858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:26.699540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:26.699760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:26.700015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:26.701416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:26.704124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:26.786552 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1975/3940] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:32:26 2022] POST /identity/v3/domains => generated 279 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:26.791039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:26.791892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:26.809047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304d62-8641-44d0-92af-cf1d71d7d76a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:26.816857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:26.916990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:26.917730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:26.922092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:26.922374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/6d1022c863844591b8419af47db4262b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:26.950281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6d1022c863844591b8419af47db4262b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:26.951256 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:26.951256 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:26.951256 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:26.956645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:27.021420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.023565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.109682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.111147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.117234 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1966/3941] 10.222.0.13 () {60 vars in 1250 bytes} [Sun Oct 30 01:32:26 2022] PATCH /identity/v3/domains/6d1022c863844591b8419af47db4262b => generated 278 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:27.122123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.122123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:27.137009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f52e04-7614-4798-8c1b-9c41ff931fe7 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:27.271717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:27.273632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:27.274082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:27.274522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/6d1022c863844591b8419af47db4262b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:27.341979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=6d1022c863844591b8419af47db4262b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:27.345225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:27.350435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1976/3942] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:32:27 2022] GET /identity/v3/domains/6d1022c863844591b8419af47db4262b => generated 278 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:27.351745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.373409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094c49-74da-4d51-a10c-fc9dbe5348ec tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:27.386334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:27.387353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:27.387739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:27.388181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/6d1022c863844591b8419af47db4262b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:27.389509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6d1022c863844591b8419af47db4262b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:27.391405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:27.429541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.435454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6d1022c863844591b8419af47db4262b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.569046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.578000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.691304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.704605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project 6d1022c863844591b8419af47db4262b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:27.704890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.705552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.714480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.719077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.719942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6d1022c863844591b8419af47db4262b', 'request_id': 'req-c4164ddf-9046-49ea-bc21-b50bb37c467a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:27.736745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1967/3943] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:27 2022] DELETE /identity/v3/domains/6d1022c863844591b8419af47db4262b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:27.740077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.741904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:27.755465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799e9d3-e42f-4c75-8b97-a300d40bfd29 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:27.815306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:27.815926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:27.816207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:27.816475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:27.817093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:27.818767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:27.839755 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1977/3944] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:32:27 2022] GET /identity/v3/domains => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:27.844983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.853185 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:27.858523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4164ddf-9046-49ea-bc21-b50bb37c467a tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:27.863676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:27.864339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:27.864612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:27.865010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/6d1022c863844591b8419af47db4262b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:27.873215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find domain: 6d1022c863844591b8419af47db4262b.: keystone.exception.DomainNotFound: Could not find domain: 6d1022c863844591b8419af47db4262b. Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6d1022c863844591b8419af47db4262b. Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:27.878446 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:27.879701 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6d1022c863844591b8419af47db4262b. Oct 30 01:32:27.881168 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:27.886176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.886445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1968/3945] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:27 2022] PATCH /identity/v3/domains/6d1022c863844591b8419af47db4262b => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:27.896490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6b00-a6f4-4c79-a799-b2276955d5c0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:27.902228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:27.902840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:27.903126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:27.903403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:27.904187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:27.905755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:27.965518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1978/3946] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:32:27 2022] POST /identity/v3/domains => generated 276 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:27.966786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:27.977764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92110b89-8632-4e82-a0e7-4d160b407708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:28.081380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:28.081380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:28.081380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:28.081735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:28.081735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:28.082535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2c59f-5748-4995-bb6a-488b1e7f4880 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:28.236654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1969/3947] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:27 2022] POST /identity/v3/users => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:28.241029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:28.263963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412b62-dd4c-4bf9-a4ce-b761906ce0e3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:28.277514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:28.278132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:28.278412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:28.278686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:28.279403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:28.281292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:28.326162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:28.326467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:28.326748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:28.347176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:28.348404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:28.375873 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1979/3948] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:28 2022] POST /identity/v3/groups => generated 324 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:28.377575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:28.398020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79b378-88c5-486a-8fc5-21a300947bcf tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:28.409126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1970/3949] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:28.417417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:28.418318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:28.418602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:28.419772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/f75f78b995154a8abb98be4fc02211ea` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:28.420585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f75f78b995154a8abb98be4fc02211ea)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:28.422456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:28.433911 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:28.446824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:28.447777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:28.565844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:28.569139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:28.579312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:28.580500 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1980/3950] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:28 2022] PATCH /identity/v3/domains/f75f78b995154a8abb98be4fc02211ea => generated 277 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:28.596395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e274d8-b227-4a74-b2ca-34670cd550e4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:28.743225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:28.743881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:28.744215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:28.744574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/f75f78b995154a8abb98be4fc02211ea` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:28.766139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f75f78b995154a8abb98be4fc02211ea)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:28.768897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:28.790384 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:28.796705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:28.800484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.175216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa110fd18664f07a258ad80410394dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.176619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa110fd18664f07a258ad80410394dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.189016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa110fd18664f07a258ad80410394dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.192875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa110fd18664f07a258ad80410394dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.270592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa110fd18664f07a258ad80410394dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.403228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.409040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.493316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.503138 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:29.514475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project f75f78b995154a8abb98be4fc02211ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:29.517037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.518706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.539829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.547281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.557561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f75f78b995154a8abb98be4fc02211ea', 'request_id': 'req-52ca25de-989d-49aa-9cd1-58f3b21d6892'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:29.576380 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1971/3951] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:28 2022] DELETE /identity/v3/domains/f75f78b995154a8abb98be4fc02211ea => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:29.584423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:29.584423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:29.614320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c31cd-a435-4518-988f-f409f48ed01c tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:29.693034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:29.694293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:29.694964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:29.695717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/f75f78b995154a8abb98be4fc02211ea` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:29.713597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=f75f78b995154a8abb98be4fc02211ea)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:29.715729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find domain: f75f78b995154a8abb98be4fc02211ea.: keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:29.739192 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:29.740350 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:29.741182 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:32:29.745629 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1981/3952] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:32:29 2022] GET /identity/v3/domains/f75f78b995154a8abb98be4fc02211ea => generated 112 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:29.745889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:29.747959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:29.772239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca25de-989d-49aa-9cd1-58f3b21d6892 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:29.777922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:29.781227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:29.781227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:29.781227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/users/ffa110fd18664f07a258ad80410394dd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:29.790062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:get_user(user_id=ffa110fd18664f07a258ad80410394dd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:29.792126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find user: ffa110fd18664f07a258ad80410394dd.: keystone.exception.UserNotFound: Could not find user: ffa110fd18664f07a258ad80410394dd. Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 30 01:32:29.813097 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:29.814006 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ffa110fd18664f07a258ad80410394dd. Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:29.814844 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1972/3953] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:32:29 2022] GET /identity/v3/users/ffa110fd18664f07a258ad80410394dd => generated 110 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:29.818701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:29.830939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb615-266b-4c4d-a7e4-96863e0cdef3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:29.845669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:29.846450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:29.846738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:29.849658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/groups/eec135efd1744ac5b5ce3a6da7cc1503` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:29.857186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:get_group(group_id=eec135efd1744ac5b5ce3a6da7cc1503)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:29.860477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find group: eec135efd1744ac5b5ce3a6da7cc1503.: keystone.exception.GroupNotFound: Could not find group: eec135efd1744ac5b5ce3a6da7cc1503. Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 30 01:32:29.883486 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:29.884332 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: eec135efd1744ac5b5ce3a6da7cc1503. Oct 30 01:32:29.885177 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:32:29.886423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1982/3954] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:29 2022] GET /identity/v3/groups/eec135efd1744ac5b5ce3a6da7cc1503 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:32:29.889427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:29.906019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364af770-87c0-4608-8da1-a5705a9c68b6 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:29.912513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:29.913158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:29.913681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:29.914290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/groups/eec135efd1744ac5b5ce3a6da7cc1503` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:29.920699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find group: eec135efd1744ac5b5ce3a6da7cc1503.: keystone.exception.GroupNotFound: Could not find group: eec135efd1744ac5b5ce3a6da7cc1503. Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 30 01:32:29.933016 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:29.942008 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: eec135efd1744ac5b5ce3a6da7cc1503. Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:29.943721 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1973/3955] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:32:29 2022] DELETE /identity/v3/groups/eec135efd1744ac5b5ce3a6da7cc1503 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:29.944694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:29.957098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20e490-aa07-47a4-8850-a50b9a188fc2 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:29.977131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:29.977713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:29.978001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:29.978844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/users/ffa110fd18664f07a258ad80410394dd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.003171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ffa110fd18664f07a258ad80410394dd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.010949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find user: ffa110fd18664f07a258ad80410394dd.: keystone.exception.UserNotFound: Could not find user: ffa110fd18664f07a258ad80410394dd. Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 30 01:32:30.054200 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:30.054959 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: ffa110fd18664f07a258ad80410394dd. Oct 30 01:32:30.055867 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:32:30.058733 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1983/3956] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:29 2022] DELETE /identity/v3/users/ffa110fd18664f07a258ad80410394dd => generated 110 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:30.060442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.081117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0ecc-88f4-4335-ab8d-414e771a8cd3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.095304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.097887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.097887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.097887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/f75f78b995154a8abb98be4fc02211ea` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.113076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find domain: f75f78b995154a8abb98be4fc02211ea.: keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:30.132805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:30.134187 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.134994 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.135818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1974/3957] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:30 2022] PATCH /identity/v3/domains/f75f78b995154a8abb98be4fc02211ea => generated 112 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:32:30.135881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.151903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a43b41-311c-489b-918e-ccb7a12e21f4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.161466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.162301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.166875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.166875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.166875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.166875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.184148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1984/3958] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:32:30 2022] GET /identity/v3/domains => generated 1346 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:30.189390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.208989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baee264-ced2-4fca-a1d9-be48e07274b8 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.220728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.225561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.225561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.225561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.227600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:30.228010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.238257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.286608 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1975/3959] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:30 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:30.286841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.313942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f17ec-7137-46c8-9e97-3ecf742ed708 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.321271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.322066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.322561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.322843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.323539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-914246241) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:30.325030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.327872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.352538 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1985/3960] 10.222.0.13 () {58 vars in 1197 bytes} [Sun Oct 30 01:32:30 2022] GET /identity/v3/domains?name=tempest-test_domain-914246241 => generated 406 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:30.358641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.371845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4caca51-2823-4549-a2d1-cd7a8c79d877 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.381661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.382311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.382610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.382871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/f75f78b995154a8abb98be4fc02211ea` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.399973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Could not find domain: f75f78b995154a8abb98be4fc02211ea.: keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:32:30.406722 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:32:30.407734 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f75f78b995154a8abb98be4fc02211ea. Oct 30 01:32:30.408508 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:32:30.412406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1976/3961] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:30 2022] PATCH /identity/v3/domains/f75f78b995154a8abb98be4fc02211ea => generated 112 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:32:30.416256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.448464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799fc83-ff6f-44ae-ac95-f68db81f70b0 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.470769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.472910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.472910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.472910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/b59d074e19ec4c2c8d8573d1116aeb5b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.523763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b59d074e19ec4c2c8d8573d1116aeb5b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.534671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.663154 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1986/3962] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:30 2022] PATCH /identity/v3/domains/b59d074e19ec4c2c8d8573d1116aeb5b => generated 277 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:30.665994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:30.701467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca693-83ba-4342-b060-e493160601d3 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:30.718210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:30.721623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:30.721913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:30.722251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/b59d074e19ec4c2c8d8573d1116aeb5b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:30.760420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b59d074e19ec4c2c8d8573d1116aeb5b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:30.763663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:30.835149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:30.844386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.031889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.039158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.132478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.152054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project b59d074e19ec4c2c8d8573d1116aeb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:31.152482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.153408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.170545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.179498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.188619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b59d074e19ec4c2c8d8573d1116aeb5b', 'request_id': 'req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.201023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:31.203237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:31.217075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1977/3963] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:30 2022] DELETE /identity/v3/domains/b59d074e19ec4c2c8d8573d1116aeb5b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:31.229868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7db76-5431-43ac-9fbb-97fb790279ba tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:31.257546 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:31.352409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:31.353184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:31.353586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:31.354070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/e70fe706ba3743859f0ef6fa19b7970a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:31.366176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e70fe706ba3743859f0ef6fa19b7970a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:31.367887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:31.390475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.391329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.496434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.499743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.501628 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1987/3964] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:31 2022] PATCH /identity/v3/domains/e70fe706ba3743859f0ef6fa19b7970a => generated 277 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:31.505562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:31.531996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa69f36-0a2d-4a24-8f55-13bddc3f6602 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:31.562865 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:31.644910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:31.645633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:31.645920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:31.646196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/e70fe706ba3743859f0ef6fa19b7970a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:31.658661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e70fe706ba3743859f0ef6fa19b7970a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:31.662858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:31.687837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.691968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.810875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.823990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.891711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.916434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project e70fe706ba3743859f0ef6fa19b7970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:31.916737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.917445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.962958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.969153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.969987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e70fe706ba3743859f0ef6fa19b7970a', 'request_id': 'req-99652c33-f3d9-4dee-b4cb-338cfdbc471e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:31.998971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1978/3965] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:31 2022] DELETE /identity/v3/domains/e70fe706ba3743859f0ef6fa19b7970a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:31.999655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:32.001773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:32.027810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc476c-1ceb-41d1-bb18-c18de1c53cae tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:32.144002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:32.148742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:32.148742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:32.148742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/3001f3eb294c4980a2a113d03d588a59` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:32.174333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3001f3eb294c4980a2a113d03d588a59)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:32.177368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:32.219463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.220472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.344530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.345934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ade8dbc-4e44-4348-a015-8151ab404e98 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.356886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1988/3966] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:31 2022] PATCH /identity/v3/domains/3001f3eb294c4980a2a113d03d588a59 => generated 276 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:32.357075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:32.361357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:32.397489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99652c33-f3d9-4dee-b4cb-338cfdbc471e tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:32.448770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:32.449037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:32.449316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:32.476823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:32.478066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:32.518618 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:32.529112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e90037fbad714dba8c670c0b81167cbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8924aeb4a544f23a714af815be0cb3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:32.530140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:32.530371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:32.530648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] PATH_INFO: `/v3/domains/3001f3eb294c4980a2a113d03d588a59` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:32.544453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3001f3eb294c4980a2a113d03d588a59)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:32.546251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:32.549985 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:32.575997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.579969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3001f3eb294c4980a2a113d03d588a59'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.584796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1989/3967] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:32.704916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.714785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.765541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.782330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] The token cache is being invalidate because project 3001f3eb294c4980a2a113d03d588a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:32.782630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.783303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.794627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.800003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.801578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4 tempest-DomainsTestJSON-2054327973 tempest-DomainsTestJSON-2054327973-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3001f3eb294c4980a2a113d03d588a59', 'request_id': 'req-7a2c5f6e-f3d0-4f3f-8f30-bfbd49c35ad4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:32.812853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:32.813543 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1979/3968] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:32 2022] DELETE /identity/v3/domains/3001f3eb294c4980a2a113d03d588a59 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:32.814529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:32.921159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2e032-a793-4b1b-bf74-afaea6fe8148 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:32.999096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:32.999720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:33.000272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:33.001096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] PATH_INFO: `/v3/users/6e74340ddb754aa18da265e2591859e2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:33.001826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e74340ddb754aa18da265e2591859e2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:33.003997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:33.234040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e74340ddb754aa18da265e2591859e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:33.265956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:33.266610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:33.266939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:33.302067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:33.304934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:33.349934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e74340ddb754aa18da265e2591859e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:33.350698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e74340ddb754aa18da265e2591859e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:33.378899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e74340ddb754aa18da265e2591859e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:33.391065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1a27c10d-0688-4c65-b197-31f8a3c9c75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e74340ddb754aa18da265e2591859e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:33.411858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1990/3969] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:32 2022] DELETE /identity/v3/users/6e74340ddb754aa18da265e2591859e2 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:33.417512 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1980/3970] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:33.419249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50cce-ccc3-4000-8438-f5cf0fc48ba6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:33.419538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50cce-ccc3-4000-8438-f5cf0fc48ba6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:33.419824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50cce-ccc3-4000-8438-f5cf0fc48ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:33.488883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4ba50cce-ccc3-4000-8438-f5cf0fc48ba6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:33.492391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4ba50cce-ccc3-4000-8438-f5cf0fc48ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:33.504823 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:33.591523 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1991/3971] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:33.600153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:33.601677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:33.660168 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:33.690954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d674a32-6246-4ab9-ad43-709225cdd0f9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:33.799165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:33.800615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:33.801084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:33.801541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:33.813308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:33.814718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:33.825077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1981/3972] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:34.151352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:34.151882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:34.151882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:34.200790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:34.202356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:34.300592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1992/3973] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:34.466955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:34.468413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:34.482245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211d0b-98ba-41b4-ba96-bd992fad407d service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:34.489410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:34.491874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:34.491874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:34.491874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] PATH_INFO: `/v3/projects/65087adfc404406e9933a0d1493a4c41` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:34.492340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65087adfc404406e9933a0d1493a4c41)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:34.494501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:34.622841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65087adfc404406e9933a0d1493a4c41', 'request_id': 'req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:34.630550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65087adfc404406e9933a0d1493a4c41', 'request_id': 'req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:34.697509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65087adfc404406e9933a0d1493a4c41', 'request_id': 'req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:34.714975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] The token cache is being invalidate because project 65087adfc404406e9933a0d1493a4c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:34.715488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:34.716255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:34.721784 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1982/3974] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:34 2022] DELETE /identity/v3/projects/65087adfc404406e9933a0d1493a4c41 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:34.722748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:34.735895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae90a6a-5798-4264-8a33-99e97aac4c9a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:34.804085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:34.805105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:34.805430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:34.805690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] PATH_INFO: `/v3/users/e90037fbad714dba8c670c0b81167cbf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:34.806838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90037fbad714dba8c670c0b81167cbf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:34.808796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:34.987262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90037fbad714dba8c670c0b81167cbf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.040438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90037fbad714dba8c670c0b81167cbf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.041149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90037fbad714dba8c670c0b81167cbf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.045202 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:35.057734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90037fbad714dba8c670c0b81167cbf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.066882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9a184b38-6f79-4e03-85a9-c7ea87925c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90037fbad714dba8c670c0b81167cbf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.073835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1993/3975] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:34 2022] DELETE /identity/v3/users/e90037fbad714dba8c670c0b81167cbf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:35.625214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:35.627377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:35.649453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675cb3-6efd-439a-8f0a-a5cb94441cb1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:35.720040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:35.720605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:35.720885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:35.721157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] PATH_INFO: `/v3/projects/f8924aeb4a544f23a714af815be0cb3b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:35.722756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8924aeb4a544f23a714af815be0cb3b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:35.725356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:35.752607 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:35.794737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab50b0-c8e5-4596-af1a-adf2bb973816 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:35.795574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab50b0-c8e5-4596-af1a-adf2bb973816 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:35.796043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab50b0-c8e5-4596-af1a-adf2bb973816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:35.827412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-61ab50b0-c8e5-4596-af1a-adf2bb973816 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:35.830157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-61ab50b0-c8e5-4596-af1a-adf2bb973816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:35.845890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8924aeb4a544f23a714af815be0cb3b', 'request_id': 'req-01139ebf-e352-4470-b3b7-229287e1511e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.853000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8924aeb4a544f23a714af815be0cb3b', 'request_id': 'req-01139ebf-e352-4470-b3b7-229287e1511e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.909097 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1994/3976] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:35.930632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8924aeb4a544f23a714af815be0cb3b', 'request_id': 'req-01139ebf-e352-4470-b3b7-229287e1511e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.954386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] The token cache is being invalidate because project f8924aeb4a544f23a714af815be0cb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:35.955236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.955754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01139ebf-e352-4470-b3b7-229287e1511e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:35.963045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1983/3977] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:35 2022] DELETE /identity/v3/projects/f8924aeb4a544f23a714af815be0cb3b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:35.967503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:35.967792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:35.968089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:35.991422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:35.991882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:36.089517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1995/3978] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:36.097790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.098091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.098718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.162371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:36.164536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:36.205951 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1984/3979] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:36.211189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.236382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3af643-7328-49fd-b63c-fa4c28a92ed5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.252015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.252557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.252836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.253104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.254130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:36.254439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.256500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.270756 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1996/3980] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:36.275247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.285879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d838-5e32-47b9-aabf-ff9938e9d1b3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.291343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.291960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.292236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.292505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.293147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.295244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.418289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1985/3981] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:36 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:36.419889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.430384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648d819-2ff7-4e50-82c0-fda694267018 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.503676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.504202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.504479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.504992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.505684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.507621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.519123 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:36.612828 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1997/3982] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:36 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:36.614047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.625680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad88cb-63ef-4aa1-b4a6-8530786bfe76 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.635067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.635956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.636449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.636907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.637874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.639768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.652446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1986/3983] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:36.657168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.670233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5744-475a-4d9a-ad9e-3a828ca320fd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.676273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.677775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.678242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.678723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.679584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.681366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445613cd-4c79-4ac1-b458-8688425a9250 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.708264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1998/3984] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:36.712308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:36.737359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb35613-95a8-4610-9e5c-57d37772f647 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:36.737359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:36.737359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.737359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.737765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] PATH_INFO: `/v3/projects/b211acba01294d64b8713f1fb9ae24fb/users/506b47e2ac7249cb9bcb8b1598e8b210/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.750884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.751170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.751427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.762005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b211acba01294d64b8713f1fb9ae24fb, user_id=506b47e2ac7249cb9bcb8b1598e8b210, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:36.765190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012acff-c21d-41cc-ad64-6a2348840a80 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:36.776887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:36.778963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:36.853270 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1987/3985] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:36 2022] PUT /identity/v3/projects/b211acba01294d64b8713f1fb9ae24fb/users/506b47e2ac7249cb9bcb8b1598e8b210/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:36.864412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:36.865353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:36.865748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:36.870510 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 1999/3986] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:36.909482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] MFA Rules not processed for user `506b47e2ac7249cb9bcb8b1598e8b210`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:36.910807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:37.062745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1988/3987] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:37.067240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.095107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69456d-1f99-43dd-a4e0-da43b3591f95 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.255676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.256400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.256749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.257148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.258075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.264440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:37.379426 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2000/3988] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:37 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:37.383436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.401451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed253-7a70-4616-b044-3c8ed7a05042 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.458282 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:37.508990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.513977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.514481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.514955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.516231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.520536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:37.645051 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1989/3989] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:37 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:37.645722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.663021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a105b-9dd2-4ca8-921a-e2dbe76fb5aa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.674746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.675800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.676916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.677204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.677988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.679946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:37.698591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2001/3990] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:37.698749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.710082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc260ba1-bf9d-4b63-ac11-b219e0c0e280 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.752212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.752212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.752212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.752212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] PATH_INFO: `/v3/projects/7da5688b6c15429da16226f625ec71dc/users/446ab4245b244a7d96a49185eeb13f1c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.761995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da5688b6c15429da16226f625ec71dc, user_id=446ab4245b244a7d96a49185eeb13f1c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.765183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:37.855357 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1990/3991] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:37 2022] PUT /identity/v3/projects/7da5688b6c15429da16226f625ec71dc/users/446ab4245b244a7d96a49185eeb13f1c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:37.856276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.870322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ddc3b-a780-4b47-b9ff-25dbc333d59e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.950154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.950745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.951024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.951294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.951924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.954151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af82fd-f9e2-437d-b077-2d60f5d6ae93 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:37.959997 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:37.965213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2002/3992] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:32:37.969636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:37.980138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f993d9d-76a7-4a3b-9fac-d96f6eca3c83 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:37.985869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:37.987594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:37.987594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:37.987594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] PATH_INFO: `/v3/projects/7da5688b6c15429da16226f625ec71dc/users/446ab4245b244a7d96a49185eeb13f1c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:37.989268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da5688b6c15429da16226f625ec71dc, user_id=446ab4245b244a7d96a49185eeb13f1c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:37.991968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:38.004463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1991/3993] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:37 2022] PUT /identity/v3/projects/7da5688b6c15429da16226f625ec71dc/users/446ab4245b244a7d96a49185eeb13f1c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:38.016443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.016716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.016990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.047311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] MFA Rules not processed for user `446ab4245b244a7d96a49185eeb13f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:38.048551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:38.177684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2003/3994] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:38.184655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:38.197600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6ea48-6d85-4f87-afbf-97081a5e1ccf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:38.202908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:38.204219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.204541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.204894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.205684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:38.209953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:38.300266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1992/3995] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/domains => generated 277 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:38.304311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:38.321477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d501ab-311a-46c6-8531-1d57e215c271 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:38.398978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:38.400207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.400829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.401252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.402069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:38.404947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa9950-8f3c-4699-b794-5488371adc1a tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:38.529058 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2004/3996] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/projects => generated 403 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:38.532760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:38.539939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.543781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.543781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.553242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c4db0-27b7-4b19-ab1d-a5c3aea87e8f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:38.604356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:38.606219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:38.689771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:38.690533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.690819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.691093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.691735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:38.693680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:38.726742 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2005/3997] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:38.778159 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1993/3998] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/groups => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:38.782119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:38.799742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01436-1606-482a-9347-daf77b828c16 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:38.805237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:38.806433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.806779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.807061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.807987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:38.811283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:38.828787 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:38.907386 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2006/3999] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/users => generated 442 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:38.911995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:38.927776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d3a1-a9fa-4215-8249-fde47564cbb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:38.937602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:38.938419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:38.938819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:38.939170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:38.944850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:38.944850 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:38.944850 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:38.944850 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:38.944850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.066870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1994/4000] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:38 2022] POST /identity/v3/roles => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:39.068326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.092011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31b2e0-510b-44c9-971b-26c97283af09 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.098213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.098911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.099181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.099462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.110620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=d0c0ba9eea9b4fa897ab56043899a908)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:39.114018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.228707 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2007/4001] 10.222.0.13 () {60 vars in 1585 bytes} [Sun Oct 30 01:32:39 2022] PUT /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:39.233093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.244263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d31c4-b27e-4698-8b1b-cae6a3257f65 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.324339 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:39.334623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.335308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.335646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.335933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.338480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:check_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=d0c0ba9eea9b4fa897ab56043899a908)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:39.339741 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:39.339741 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:39.339741 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:39.342304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.354682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1995/4002] 10.222.0.13 () {58 vars in 1567 bytes} [Sun Oct 30 01:32:39 2022] HEAD /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:39.355973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.368206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7dc78-a121-4973-8c10-8b482a022f92 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.394551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.395376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.395847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.396211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.398626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=d0c0ba9eea9b4fa897ab56043899a908)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:39.399935 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:39.399935 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:39.399935 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:39.402529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.410109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role d0c0ba9eea9b4fa897ab56043899a908 was removed from group 69083490fe0d4a38a077ccc4a62a6e4b on project 41a039582af04d6cbf42a81d1ab345ab. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:39.410526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:39.411354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:39.474601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2008/4003] 10.222.0.13 () {58 vars in 1569 bytes} [Sun Oct 30 01:32:39 2022] DELETE /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/d0c0ba9eea9b4fa897ab56043899a908/inherited_to_projects => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:39.478787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.481201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:39.495720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac919-2d66-4bbb-ade1-2de1e00ff0f1 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.578977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.579899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.580657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.581537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/d0c0ba9eea9b4fa897ab56043899a908` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.586616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d0c0ba9eea9b4fa897ab56043899a908)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:39.588611 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:39.588611 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:39.588611 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:39.589927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.729920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role d0c0ba9eea9b4fa897ab56043899a908 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:39.730971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:39.731704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2a9a7206-a31c-4428-8f45-2e762c4b1d27 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:39.734122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1996/4004] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:39 2022] DELETE /identity/v3/roles/d0c0ba9eea9b4fa897ab56043899a908 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:39.739460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.753803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa8fa-9abc-4f20-9cf1-196eb94a8d63 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.833748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.834586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.834705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.834904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.837985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:39.837985 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:39.837985 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:39.837985 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:39.837985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:39.894650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.895403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.895691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.929648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:39.930891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:39.934819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2009/4005] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:39 2022] POST /identity/v3/roles => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:39.938647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:39.940719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:39.955316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e124-31af-4c2a-990d-3a28a6ca2b7d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:39.968797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:39.969762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:39.970204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:39.970490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:39.999042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=3d269566c56e4f34b6734bf5ce87428e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.006448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.046597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1997/4006] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:40.095675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2010/4007] 10.222.0.13 () {60 vars in 1582 bytes} [Sun Oct 30 01:32:39 2022] PUT /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:40.105997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.128885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a4f6-2e01-4424-8075-87f4b327b15a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.206039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.206896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.207304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.207702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.210499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:check_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=3d269566c56e4f34b6734bf5ce87428e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.213659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.218678 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:40.223299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1998/4008] 10.222.0.13 () {58 vars in 1564 bytes} [Sun Oct 30 01:32:40 2022] HEAD /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:40.227700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.253620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920d6c1-c045-4ab9-b869-e71b2fb06026 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.260500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.261287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.261597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.262689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.265089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=3d269566c56e4f34b6734bf5ce87428e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.267494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.273545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 3d269566c56e4f34b6734bf5ce87428e was removed from user 4bb6c10cd6ee424e9118b71edc5a1fa5 on project 41a039582af04d6cbf42a81d1ab345ab. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:40.273845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:40.275095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:40.382997 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2011/4009] 10.222.0.13 () {58 vars in 1566 bytes} [Sun Oct 30 01:32:40 2022] DELETE /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/3d269566c56e4f34b6734bf5ce87428e/inherited_to_projects => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:40.387416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.389265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:40.403045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d273-0f9b-47ad-a8e4-965680716dc7 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.465597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.466156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.466439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.466739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/3d269566c56e4f34b6734bf5ce87428e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.468179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3d269566c56e4f34b6734bf5ce87428e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.469815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.560616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 3d269566c56e4f34b6734bf5ce87428e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:40.560910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:40.565014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:40.565014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 1999/4010] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:40 2022] DELETE /identity/v3/roles/3d269566c56e4f34b6734bf5ce87428e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:40.569153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.581782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae45f0-6ec6-4fd1-9fa2-bd581e7e3a4f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.642478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.643098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.643376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.643646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.644325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.645973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.732183 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=7,keystone:SELECT=91,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:40.742485 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2012/4011] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:40 2022] POST /identity/v3/roles => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:40.743265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.744817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:40.760535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164084-eb5e-42e2-9854-0a6ac5fad159 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.766213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.766887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.767172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.767454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.769991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8c563a0a14f141d393798608eb47e238, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=2335a18aba2e406b80854ef7a04556dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.772671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.868722 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2000/4012] 10.222.0.13 () {60 vars in 1582 bytes} [Sun Oct 30 01:32:40 2022] PUT /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:40.873700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.884531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ede9f-af49-4ee0-961e-29890f11c752 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.945260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.945966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.946245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.946614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.948352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8c563a0a14f141d393798608eb47e238, group_id=69083490fe0d4a38a077ccc4a62a6e4b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.949974 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:40.949974 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:40.949974 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:40.951782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.965649 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2013/4013] 10.222.0.13 () {58 vars in 1464 bytes} [Sun Oct 30 01:32:40 2022] GET /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/inherited_to_projects => generated 448 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:40.969757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:40.979890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77378-7bd0-435f-9e22-1b981f3a6bb6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:40.985235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:40.985931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:40.986211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:40.986489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:40.988725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8c563a0a14f141d393798608eb47e238, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=2335a18aba2e406b80854ef7a04556dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:40.991381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:40.997866 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2001/4014] 10.222.0.13 () {58 vars in 1564 bytes} [Sun Oct 30 01:32:40 2022] HEAD /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.002156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.012497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0479c-3237-41b4-b905-d7c18f0f6060 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.017067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.017757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.018039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.018315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.020453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8c563a0a14f141d393798608eb47e238, group_id=69083490fe0d4a38a077ccc4a62a6e4b, role_id=2335a18aba2e406b80854ef7a04556dc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.023154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.028713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 2335a18aba2e406b80854ef7a04556dc was removed from group 69083490fe0d4a38a077ccc4a62a6e4b on domain 8c563a0a14f141d393798608eb47e238. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:41.029012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.029927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.097156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2014/4015] 10.222.0.13 () {58 vars in 1566 bytes} [Sun Oct 30 01:32:41 2022] DELETE /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/groups/69083490fe0d4a38a077ccc4a62a6e4b/roles/2335a18aba2e406b80854ef7a04556dc/inherited_to_projects => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.101257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.103204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:41.117667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf19a-ec7c-4b06-88a2-6776760bda72 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.176345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.176984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.177271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.177579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/2335a18aba2e406b80854ef7a04556dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.179012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2335a18aba2e406b80854ef7a04556dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.180689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.274020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 2335a18aba2e406b80854ef7a04556dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:41.274313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.274982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.276781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2002/4016] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:41 2022] DELETE /identity/v3/roles/2335a18aba2e406b80854ef7a04556dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.282297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.294079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b31641-3986-4c9d-949e-e20c51ff4cb9 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.366316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.367178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.367841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.367841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.368661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.370472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.449441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2015/4017] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:41 2022] POST /identity/v3/roles => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:41.450841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.452383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:41.465969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16524ca-6ece-44f1-b973-dcb74797b086 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.470731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.471395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.471684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.471941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.474192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=f76836eedac342aca65e18c83bb12da9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.476904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.480211 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:41.542302 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2003/4018] 10.222.0.13 () {60 vars in 1579 bytes} [Sun Oct 30 01:32:41 2022] PUT /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.547662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.558022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857679-53b8-48ff-9071-9a0eb06387ec tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.619207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.620020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.620364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.620687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.622615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.625375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.635259 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:41.639524 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2016/4019] 10.222.0.13 () {58 vars in 1461 bytes} [Sun Oct 30 01:32:41 2022] GET /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/inherited_to_projects => generated 447 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:41.654938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.666354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729981e-6fac-4d68-800f-d3872f80da37 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.671759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.672425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.672706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.672985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.675180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=f76836eedac342aca65e18c83bb12da9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.677923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.687256 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2004/4020] 10.222.0.13 () {58 vars in 1561 bytes} [Sun Oct 30 01:32:41 2022] HEAD /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.688471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.707539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdd49-b7cf-43e4-97b8-5196fedb83ef tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.707539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.707539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.707837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.707837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.718116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=f76836eedac342aca65e18c83bb12da9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.721080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.728467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role f76836eedac342aca65e18c83bb12da9 was removed from user 4bb6c10cd6ee424e9118b71edc5a1fa5 on domain 8c563a0a14f141d393798608eb47e238. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:41.728764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.729688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.799652 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2017/4021] 10.222.0.13 () {58 vars in 1563 bytes} [Sun Oct 30 01:32:41 2022] DELETE /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f76836eedac342aca65e18c83bb12da9/inherited_to_projects => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.803658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.805932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:41.819039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228038-e3db-4f3a-bf08-052eb6698719 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:41.879290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:41.880428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:41.880863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:41.881145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/f76836eedac342aca65e18c83bb12da9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:41.882888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f76836eedac342aca65e18c83bb12da9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:41.884871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:41.953614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role f76836eedac342aca65e18c83bb12da9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:41.954001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.954783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-52dbca9c-e110-44ed-ab5d-d6dc9a2c0840 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:41.957044 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2005/4022] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:41 2022] DELETE /identity/v3/roles/f76836eedac342aca65e18c83bb12da9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:41.962845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:41.975281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d712d-351f-49f5-91a8-170318a1e06f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.013607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.014141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.015024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.039350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:42.040785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:42.065194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.065942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.066409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.066750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.067492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.069975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.107190 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2006/4023] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:42.185036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2018/4024] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:41 2022] POST /identity/v3/roles => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:42.189303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:42.191147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:42.206401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769ca20-c0ff-45dc-819f-733eff368e3f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.211581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.212207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.212485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.212756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.213416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.215442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.365403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:42.366477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2007/4025] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:42 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:42.380520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3897ed-c946-445b-b22d-b8588f4fe70d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.454331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.455672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.455952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.456299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f859e2b955634fbc93cd552ed00b6819/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.458850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=f859e2b955634fbc93cd552ed00b6819)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.462839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.569835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2019/4026] 10.222.0.13 () {60 vars in 1579 bytes} [Sun Oct 30 01:32:42 2022] PUT /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f859e2b955634fbc93cd552ed00b6819/inherited_to_projects => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:42.571025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:42.584949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf7e60-e310-40dd-9618-3b403cf0fab6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.649383 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:42.698957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.700876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.701366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.701789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.702655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=41a039582af04d6cbf42a81d1ab345ab, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:42.704079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.705561 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:42.705561 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:42.705561 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:42.707897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.794020 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2008/4027] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:42 2022] GET /identity/v3/role_assignments?scope.project.id=41a039582af04d6cbf42a81d1ab345ab&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 648 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:42.798622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:42.813137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbff4b-2cb7-4746-a0c5-b04e8fe75e50 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.817947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.819199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.819199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.819199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.820167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=ff4a072681f34282a1085771732e65b5, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:42.820569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.821763 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:42.821763 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:42.821763 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:42.823161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.890060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2020/4028] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:42 2022] GET /identity/v3/role_assignments?scope.project.id=ff4a072681f34282a1085771732e65b5&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 648 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:42.898449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:42.911373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041faf32-6638-415b-886b-8a41a1c7fd30 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:42.916999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:42.918382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:42.918720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:42.919053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f859e2b955634fbc93cd552ed00b6819/inherited_to_projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:42.921280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8c563a0a14f141d393798608eb47e238, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=f859e2b955634fbc93cd552ed00b6819)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:42.922320 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:42.922320 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:32:42.922320 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:32:42.924475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:42.930232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role f859e2b955634fbc93cd552ed00b6819 was removed from user 4bb6c10cd6ee424e9118b71edc5a1fa5 on domain 8c563a0a14f141d393798608eb47e238. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:42.934360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:42.935271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.034342 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2009/4029] 10.222.0.13 () {58 vars in 1563 bytes} [Sun Oct 30 01:32:42 2022] DELETE /identity/v3/OS-INHERIT/domains/8c563a0a14f141d393798608eb47e238/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/f859e2b955634fbc93cd552ed00b6819/inherited_to_projects => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:43.038549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:43.040976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:43.057786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e966bd-d9bd-42b4-88e5-15a2efb3f2d3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:43.072447 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:43.129082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:43.129991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:43.130272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:43.130542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:43.131293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=41a039582af04d6cbf42a81d1ab345ab, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:43.131555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:43.133432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:43.186353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2021/4030] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:43 2022] GET /identity/v3/role_assignments?scope.project.id=41a039582af04d6cbf42a81d1ab345ab&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 228 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:43.186934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:43.198698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0753b8-44cf-46d2-8fb0-2b5e8799c36b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:43.203986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:43.204596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:43.204875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:43.205152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:43.205928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=ff4a072681f34282a1085771732e65b5, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:43.206234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:43.208579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:43.277617 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2010/4031] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:43 2022] GET /identity/v3/role_assignments?scope.project.id=ff4a072681f34282a1085771732e65b5&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 228 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:43.281545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:43.292108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfda5e-0fe2-478f-ba5f-34dbe81bff5f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:43.309843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:43.310502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:43.310788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:43.311407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects/ff4a072681f34282a1085771732e65b5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:43.313377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff4a072681f34282a1085771732e65b5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:43.315217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:43.457751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4a072681f34282a1085771732e65b5', 'request_id': 'req-1053db50-3058-4598-9237-ca965319636f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.514197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4a072681f34282a1085771732e65b5', 'request_id': 'req-1053db50-3058-4598-9237-ca965319636f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.575770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4a072681f34282a1085771732e65b5', 'request_id': 'req-1053db50-3058-4598-9237-ca965319636f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.606349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] The token cache is being invalidate because project ff4a072681f34282a1085771732e65b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:43.606703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.607530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.609385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2022/4032] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:43 2022] DELETE /identity/v3/projects/ff4a072681f34282a1085771732e65b5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:43.613853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:43.615818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:43.634902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01042ee-6fb8-4945-b161-9e7d5d25cd03 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:43.754810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:43.755772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:43.756060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:43.756336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/f859e2b955634fbc93cd552ed00b6819` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:43.758570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f859e2b955634fbc93cd552ed00b6819)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:43.760549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:43.783001 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:43.913087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role f859e2b955634fbc93cd552ed00b6819 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:43.913087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.913087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:43.915721 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2011/4033] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:43 2022] DELETE /identity/v3/roles/f859e2b955634fbc93cd552ed00b6819 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:43.920848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:43.931287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053db50-3058-4598-9237-ca965319636f tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:43.993782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:43.994413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:43.994696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:43.994974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:43.995699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:43.997916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.002699 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:44.069125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2023/4034] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:32:43 2022] POST /identity/v3/roles => generated 240 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:44.073840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.075483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:44.090193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e941-39d4-44bd-bf98-2e605db0f464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.095629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.096775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.096775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.097437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.098180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.100308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.205400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2012/4035] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:44 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:44.207234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.218316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a6536-b8b9-47c1-95e3-22602cb4e868 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.287226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.288020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.288557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.288956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/5274bbc1144d4ffa8c25f0cc54fb3957/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.292296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:create_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=5274bbc1144d4ffa8c25f0cc54fb3957)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.296411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.368103 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2024/4036] 10.222.0.13 () {60 vars in 1582 bytes} [Sun Oct 30 01:32:44 2022] PUT /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/5274bbc1144d4ffa8c25f0cc54fb3957/inherited_to_projects => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:44.373125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.386122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8014a6-5c8c-4d80-9a64-b5c981e95783 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.460333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.461002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.461473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.461855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.462704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=5760eda9f0a44e7b8f0037a7072fbf0c, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:44.463123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.467076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.549246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2013/4037] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:44 2022] GET /identity/v3/role_assignments?scope.project.id=5760eda9f0a44e7b8f0037a7072fbf0c&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 649 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:44.550245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.565199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd589-22a5-4850-8019-b5cdd8a9e252 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.571306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.572167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.572468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.572753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/5274bbc1144d4ffa8c25f0cc54fb3957/inherited_to_projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.575590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=41a039582af04d6cbf42a81d1ab345ab, user_id=4bb6c10cd6ee424e9118b71edc5a1fa5, role_id=5274bbc1144d4ffa8c25f0cc54fb3957)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.578879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.585257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 5274bbc1144d4ffa8c25f0cc54fb3957 was removed from user 4bb6c10cd6ee424e9118b71edc5a1fa5 on project 41a039582af04d6cbf42a81d1ab345ab. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:44.585629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:44.586654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:44.664601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2025/4038] 10.222.0.13 () {58 vars in 1566 bytes} [Sun Oct 30 01:32:44 2022] DELETE /identity/v3/OS-INHERIT/projects/41a039582af04d6cbf42a81d1ab345ab/users/4bb6c10cd6ee424e9118b71edc5a1fa5/roles/5274bbc1144d4ffa8c25f0cc54fb3957/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:44.669628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.671537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:44.687044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c1d4a-7e6b-4b66-b300-b1343451edbd tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.754446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.755629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.755915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.756245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.756962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Adding query filter params (scope.project.id=5760eda9f0a44e7b8f0037a7072fbf0c, user.id=4bb6c10cd6ee424e9118b71edc5a1fa5) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:44.757471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.759478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:44.772088 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:44.831438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2014/4039] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:32:44 2022] GET /identity/v3/role_assignments?scope.project.id=5760eda9f0a44e7b8f0037a7072fbf0c&user.id=4bb6c10cd6ee424e9118b71edc5a1fa5&effective => generated 228 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:44.835275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:44.848407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99abd-2f44-4a0c-a52e-2248acba79b6 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:44.855759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:44.856829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:44.857050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:44.857277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects/5760eda9f0a44e7b8f0037a7072fbf0c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:44.858648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5760eda9f0a44e7b8f0037a7072fbf0c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:44.860937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:45.006645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5760eda9f0a44e7b8f0037a7072fbf0c', 'request_id': 'req-42db53bb-ff9a-461c-aaa7-153a3b316464'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.078926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5760eda9f0a44e7b8f0037a7072fbf0c', 'request_id': 'req-42db53bb-ff9a-461c-aaa7-153a3b316464'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.091411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5760eda9f0a44e7b8f0037a7072fbf0c', 'request_id': 'req-42db53bb-ff9a-461c-aaa7-153a3b316464'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.103420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] The token cache is being invalidate because project 5760eda9f0a44e7b8f0037a7072fbf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:45.103723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.104437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.110251 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2026/4040] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:44 2022] DELETE /identity/v3/projects/5760eda9f0a44e7b8f0037a7072fbf0c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:45.111242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:45.114478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:45.150096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4103c5-381c-41a4-86e2-635072318228 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:45.246998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:45.247832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:45.248118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:45.248393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/roles/5274bbc1144d4ffa8c25f0cc54fb3957` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:45.249963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5274bbc1144d4ffa8c25f0cc54fb3957)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:45.255750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:45.408901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invalidating the token cache because role 5274bbc1144d4ffa8c25f0cc54fb3957 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:45.409597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.411475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.414886 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2015/4041] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:45 2022] DELETE /identity/v3/roles/5274bbc1144d4ffa8c25f0cc54fb3957 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:45.419772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:45.430915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db53bb-ff9a-461c-aaa7-153a3b316464 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:45.513502 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:45.535299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:45.536545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:45.537688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:45.538265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/users/4bb6c10cd6ee424e9118b71edc5a1fa5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:45.540111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4bb6c10cd6ee424e9118b71edc5a1fa5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:45.544173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:45.688439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb6c10cd6ee424e9118b71edc5a1fa5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.778310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb6c10cd6ee424e9118b71edc5a1fa5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.779039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb6c10cd6ee424e9118b71edc5a1fa5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.800612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb6c10cd6ee424e9118b71edc5a1fa5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.809402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb6c10cd6ee424e9118b71edc5a1fa5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:45.819351 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2027/4042] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:45 2022] DELETE /identity/v3/users/4bb6c10cd6ee424e9118b71edc5a1fa5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:45.823185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:45.824619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:45.846533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed822b0f-0874-44ad-af58-d39591d0908d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:45.928089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:45.928734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:45.929015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:45.929327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/groups/69083490fe0d4a38a077ccc4a62a6e4b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:45.930554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_group(group_id=69083490fe0d4a38a077ccc4a62a6e4b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:45.932615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:46.047068 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:46.081373 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2016/4043] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:32:45 2022] DELETE /identity/v3/groups/69083490fe0d4a38a077ccc4a62a6e4b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:46.085547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:46.087974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:46.116211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd01e35-20d6-404e-897f-2b2c8380c17c tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:46.218552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:46.219262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:46.219540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:46.219835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/projects/41a039582af04d6cbf42a81d1ab345ab` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:46.220966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41a039582af04d6cbf42a81d1ab345ab)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:46.222927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:46.346558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:46.348412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:46.404245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a039582af04d6cbf42a81d1ab345ab', 'request_id': 'req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.452545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebaa05-669a-4838-a104-cadfb0f98d2b tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:46.501984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a039582af04d6cbf42a81d1ab345ab', 'request_id': 'req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.510220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a039582af04d6cbf42a81d1ab345ab', 'request_id': 'req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.526820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] The token cache is being invalidate because project 41a039582af04d6cbf42a81d1ab345ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:46.527127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.528363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.532115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2028/4044] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:46 2022] DELETE /identity/v3/projects/41a039582af04d6cbf42a81d1ab345ab => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:46.541706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:46.541706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:46.541706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:46.541706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:46.542020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:46.546549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:46.548484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:46.556434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:46.559406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:46.562601 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:46.582695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2017/4045] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:32:46.683560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f75ea-e684-4d9b-8f8d-4cd10c2de4f3 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:46.690438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:46.690917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:46.691196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:46.691675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/domains/8c563a0a14f141d393798608eb47e238` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:46.693145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8c563a0a14f141d393798608eb47e238)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:46.696511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:46.723372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.726512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.843724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.844340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:46.849677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2029/4046] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:32:46 2022] PATCH /identity/v3/domains/8c563a0a14f141d393798608eb47e238 => generated 278 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:46.852152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:46.884318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820614-21c6-4b88-af86-4e00e3ace6fd service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:47.008207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446ab4245b244a7d96a49185eeb13f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7da5688b6c15429da16226f625ec71dc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:47.009509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:47.009796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:47.010075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] PATH_INFO: `/v3/domains/8c563a0a14f141d393798608eb47e238` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:47.027397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8c563a0a14f141d393798608eb47e238)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:47.029128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:47.052425 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:47.068106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.074764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8c563a0a14f141d393798608eb47e238'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.201410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.212216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.305095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.325910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] The token cache is being invalidate because project 8c563a0a14f141d393798608eb47e238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:47.326204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.330162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.351214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.362498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.365224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-111bcc68-f0f2-44f0-a378-e47a31943286 tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8c563a0a14f141d393798608eb47e238', 'request_id': 'req-111bcc68-f0f2-44f0-a378-e47a31943286'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:47.376269 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2018/4047] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:46 2022] DELETE /identity/v3/domains/8c563a0a14f141d393798608eb47e238 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:47.380741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:47.382380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:47.531670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c54b-879a-42ab-b938-fd5dc8a6441d tempest-InheritsV3TestJSON-1611040728 tempest-InheritsV3TestJSON-1611040728-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:47.631762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:47.633495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:47.634096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:47.635279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] PATH_INFO: `/v3/users/506b47e2ac7249cb9bcb8b1598e8b210` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:47.639531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506b47e2ac7249cb9bcb8b1598e8b210)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:47.641247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:47.706138 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:47.916692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506b47e2ac7249cb9bcb8b1598e8b210'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.010964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506b47e2ac7249cb9bcb8b1598e8b210'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.011908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506b47e2ac7249cb9bcb8b1598e8b210'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.036899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506b47e2ac7249cb9bcb8b1598e8b210'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.048574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506b47e2ac7249cb9bcb8b1598e8b210'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.067657 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2030/4048] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:47 2022] DELETE /identity/v3/users/506b47e2ac7249cb9bcb8b1598e8b210 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:48.070611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:48.070811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:48.071087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:48.113263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:48.115298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:48.194570 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2019/4049] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:48.206651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:48.208275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:48.327534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650affba-6304-4d7a-a44b-cfd69bdefdb3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:48.331379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:48.331987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:48.332285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:48.332556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:48.344713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:48.346867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:48.359423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2031/4050] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:48.841011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:48.842718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:48.859043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef29be-56f6-463a-ae91-eafab5cca7c8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:48.864044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:48.864816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:48.865436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:48.865962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] PATH_INFO: `/v3/projects/b211acba01294d64b8713f1fb9ae24fb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:48.867373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b211acba01294d64b8713f1fb9ae24fb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:48.869819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:48.985617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b211acba01294d64b8713f1fb9ae24fb', 'request_id': 'req-2363763e-5932-42c4-80e2-be8171d46c01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:48.989491 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:48.991881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b211acba01294d64b8713f1fb9ae24fb', 'request_id': 'req-2363763e-5932-42c4-80e2-be8171d46c01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.099307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b211acba01294d64b8713f1fb9ae24fb', 'request_id': 'req-2363763e-5932-42c4-80e2-be8171d46c01'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.122827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] The token cache is being invalidate because project b211acba01294d64b8713f1fb9ae24fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:49.123125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.124042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.125496 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2020/4051] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:48 2022] DELETE /identity/v3/projects/b211acba01294d64b8713f1fb9ae24fb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:49.129420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:49.140094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c03450-92b7-42be-9d35-68839b587992 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:49.202417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:49.203055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:49.203331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:49.203600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] PATH_INFO: `/v3/users/446ab4245b244a7d96a49185eeb13f1c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:49.204764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=446ab4245b244a7d96a49185eeb13f1c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:49.206749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:49.416166 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:49.421705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446ab4245b244a7d96a49185eeb13f1c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.508848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446ab4245b244a7d96a49185eeb13f1c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.509982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446ab4245b244a7d96a49185eeb13f1c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.530163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446ab4245b244a7d96a49185eeb13f1c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.543148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-075e077c-ab27-43f1-8b28-22c78e56d18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446ab4245b244a7d96a49185eeb13f1c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:49.550803 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2032/4052] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:49 2022] DELETE /identity/v3/users/446ab4245b244a7d96a49185eeb13f1c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:50.603426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:50.605692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:50.621271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363763e-5932-42c4-80e2-be8171d46c01 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:50.731257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:50.732206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:50.732682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:50.733121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] PATH_INFO: `/v3/projects/7da5688b6c15429da16226f625ec71dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:50.734746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da5688b6c15429da16226f625ec71dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:50.736814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:50.882027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da5688b6c15429da16226f625ec71dc', 'request_id': 'req-73c754c1-3d12-4253-bcf5-8762947c8c22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:50.888880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da5688b6c15429da16226f625ec71dc', 'request_id': 'req-73c754c1-3d12-4253-bcf5-8762947c8c22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:50.970813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da5688b6c15429da16226f625ec71dc', 'request_id': 'req-73c754c1-3d12-4253-bcf5-8762947c8c22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:50.987894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] The token cache is being invalidate because project 7da5688b6c15429da16226f625ec71dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:50.988896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:50.990180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73c754c1-3d12-4253-bcf5-8762947c8c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:50.995063 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2021/4053] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:50 2022] DELETE /identity/v3/projects/7da5688b6c15429da16226f625ec71dc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:50.997236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da0-2d33-45e8-b0bb-21f38ad17b09 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:50.997748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da0-2d33-45e8-b0bb-21f38ad17b09 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:50.997826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da0-2d33-45e8-b0bb-21f38ad17b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.018740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ac237da0-2d33-45e8-b0bb-21f38ad17b09 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:51.019980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ac237da0-2d33-45e8-b0bb-21f38ad17b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:51.062719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.063222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.063595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.097995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] MFA Rules not processed for user `88ac5422c8f048148aac2c9b62e0482e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:51.099574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:51.142715 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2033/4054] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:51.150118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.150756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.152247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.184492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:51.187135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:51.199152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2034/4055] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:51.203275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.219141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212d494-1e2b-4af1-b2f8-1c63072f6b9c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.229377 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2022/4056] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:51.230963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.232190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.232681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.233431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.234428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:51.235397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.237139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.252589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2035/4057] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:51.256939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.269031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ba02-cf73-4c4d-b888-b8c26063c387 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.274072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.275013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.276068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.277076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.278424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.281564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.306702 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:51.415522 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2023/4058] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:51 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:51.419928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.434869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09298260-a682-40f7-b9a4-ac838b554e1c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.565609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.567348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.567630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.568038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.569063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.571891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.679160 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2036/4059] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:51 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:51.684039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.697461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eacfb-04f1-4365-8ca9-e32dcd16b31f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.703252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.704537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.704869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.705157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.705977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.707765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.727094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.738006 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2024/4060] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:51.739771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f797186-0185-4a36-b6bb-70ad6f8a9b2c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.749954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.750573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.750901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.751168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.751811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.753489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd74fe-45a6-4ee9-aa8f-53943de07048 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.792133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2037/4061] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:51.796029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:51.807135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64ac2-5cda-40fb-8539-de49b08a214f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:51.821746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:51.822430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.822713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.823500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] PATH_INFO: `/v3/projects/e6eaa098facd4b1997bca66d2c8125ec/users/cb3e90a035bc4e4697f9ffececdc6978/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:51.843676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6eaa098facd4b1997bca66d2c8125ec, user_id=cb3e90a035bc4e4697f9ffececdc6978, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:51.846717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:51.933275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2025/4062] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:51 2022] PUT /identity/v3/projects/e6eaa098facd4b1997bca66d2c8125ec/users/cb3e90a035bc4e4697f9ffececdc6978/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:51.944555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:51.944837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:51.945111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:52.001596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] MFA Rules not processed for user `cb3e90a035bc4e4697f9ffececdc6978`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:52.003106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:52.011564 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:52.132273 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2038/4063] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:52.132442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:52.227390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a9735-11d4-4671-8d46-135fe5d9e382 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:52.232829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:52.233474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:52.233817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:52.234335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:52.235106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:52.237203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:52.388288 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2026/4064] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:52 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:32:52.391977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:52.423217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cfc2e-3870-4a87-bad2-d5231e9ad0cd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:52.497179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:52.497899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:52.498283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:52.498659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:52.499434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:52.501553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:52.673008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:52.674601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2039/4065] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:52 2022] POST /identity/v3/users => generated 300 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:52.693393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1480a-b0b0-426a-9d0d-1b9e2d17e7d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:52.715293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:52.718434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:52.719888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:52.720695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:52.722906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:52.725287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:52.765245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2027/4066] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:32:52.769426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:52.780447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02a329-7760-436b-9f01-6d3a1b536d52 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:52.794042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:52.794815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:52.795327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:52.795441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] PATH_INFO: `/v3/projects/fff06be24e7042788ed3f47b9160f8ac/users/245cc46183da48fdab156c7917da4d64/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:52.839812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff06be24e7042788ed3f47b9160f8ac, user_id=245cc46183da48fdab156c7917da4d64, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:52.843428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f8758-82e9-4283-8a45-488fc95fd3d9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.003756 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2040/4067] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:52 2022] PUT /identity/v3/projects/fff06be24e7042788ed3f47b9160f8ac/users/245cc46183da48fdab156c7917da4d64/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:53.006079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.008806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.009098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.009453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.018874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa73-2b27-43d0-bbb2-740dee9f4441 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.029671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:53.030903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:53.164010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.164638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.164914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.165181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.165853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.168126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a45a-0b04-4ea7-80ad-3264f40ed608 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.197386 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2041/4068] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:32:53.206883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2028/4069] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:53.207806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.222288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d88e2-707f-4ac2-903c-49d2cc6224ea None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.240116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.240916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.241231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.247628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] PATH_INFO: `/v3/projects/fff06be24e7042788ed3f47b9160f8ac/users/245cc46183da48fdab156c7917da4d64/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.249932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff06be24e7042788ed3f47b9160f8ac, user_id=245cc46183da48fdab156c7917da4d64, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.255598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.275829 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2042/4070] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:53 2022] PUT /identity/v3/projects/fff06be24e7042788ed3f47b9160f8ac/users/245cc46183da48fdab156c7917da4d64/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:53.286331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.286613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.286891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.344097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] MFA Rules not processed for user `245cc46183da48fdab156c7917da4d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:53.360131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:53.391141 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:53.461680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2029/4071] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:53.467688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.474056 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:53.475485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805dcc4-af1f-4b92-ac9e-01d5fba55ee1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.481347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.482301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.482656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.483126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects/e6eaa098facd4b1997bca66d2c8125ec` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.484329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:get_project(project_id=e6eaa098facd4b1997bca66d2c8125ec)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.486721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.493068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.514327 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2043/4072] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:53 2022] GET /identity/v3/projects/e6eaa098facd4b1997bca66d2c8125ec => generated 389 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:53.516297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6058c4-e125-475a-8322-f0ace87348f7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.547513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.548233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.548516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.548788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.549452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.555545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.684858 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2030/4073] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:32:53 2022] POST /identity/v3/projects => generated 339 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:53.689726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.710383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c7230-9b47-4c17-afd7-e5d4d3d35d4a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.864358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.864984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.865265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.865559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.866210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.867215 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:32:53.867215 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:32:53.867215 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:32:53.868357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.950936 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2044/4074] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:32:53 2022] GET /identity/v3/projects => generated 6564 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:53.953021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:53.979767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d2071-a836-43e4-94b6-f13daefa743f tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:53.985652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:53.987194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:53.987692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:53.988303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects/e6eaa098facd4b1997bca66d2c8125ec` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:53.990191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:get_project(project_id=e6eaa098facd4b1997bca66d2c8125ec)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:53.992632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:53.995829 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2031/4075] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:53 2022] GET /identity/v3/projects/e6eaa098facd4b1997bca66d2c8125ec => generated 389 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:54.005534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.020916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df594bf0-6f0c-4310-a847-03eaa5da9391 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.040367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.040367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.040367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.041890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects/1fcc919d64ec4e0887a6695ebe61a6d2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.046001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:get_project(project_id=1fcc919d64ec4e0887a6695ebe61a6d2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.052101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.054588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2045/4076] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects/1fcc919d64ec4e0887a6695ebe61a6d2 => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:54.059175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.071001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c83df-5908-42af-abd3-33025a94f95d tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.078354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.079393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.079788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.080157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.081399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.083393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.144576 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2032/4077] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects => generated 6564 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:54.145416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.155718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.157548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:54.159643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c665c-c6aa-469e-b484-c874e534f25a tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.165979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.167724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.168269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.168796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.169852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:54.170512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.172990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.208946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2046/4078] 10.222.0.13 () {58 vars in 1166 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects?domain_id=default => generated 6233 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:54.213513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.225951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707850d-fc8f-475f-a0ae-3181804de150 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.244170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.245383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.245793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.246146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.246808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.248717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2af927-2698-41e9-b435-f3d3477ca995 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.298156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2047/4079] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects => generated 6564 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:54.298156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.298156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.298156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.320542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:54.322308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:54.330261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4a92-451e-4e51-b4de-e9179fc8df9c tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.336182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.337176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.337653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.344041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] PATH_INFO: `/v3/users/1104201e8b024625ac96a782beee10e0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.344041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1104201e8b024625ac96a782beee10e0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.344041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.415245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2048/4080] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:54.415245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.439230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cec3b-d053-4cce-b4ef-ef0ca4ec3d81 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.445138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.446050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.446981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.447421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.448871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:54.449348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.452150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.476423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2049/4081] 10.222.0.13 () {58 vars in 1166 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects?domain_id=default => generated 6233 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:54.484503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.497009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de47bc8-696f-48d1-b6a3-e8fd13aa9bb8 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.502170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.502849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.503199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.503783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.504493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.506465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.533385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2050/4082] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects => generated 6564 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:32:54.536145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.551765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff2060-cb83-42bd-91ed-706ad4f9abd2 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.559006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.559707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.560067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.560370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.561019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1926304573) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:54.562117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.564117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.577314 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2051/4083] 10.222.0.13 () {58 vars in 1232 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1926304573 => generated 537 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:54.582367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.596715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542504cd-cbdd-4d2b-9523-a0c59e1ecacb tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:54.603325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245cc46183da48fdab156c7917da4d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fff06be24e7042788ed3f47b9160f8ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:54.604456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.604990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.605099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] PATH_INFO: `/v3/projects/1fcc919d64ec4e0887a6695ebe61a6d2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.606262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1fcc919d64ec4e0887a6695ebe61a6d2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:54.609947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:54.611202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1104201e8b024625ac96a782beee10e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.614601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1104201e8b024625ac96a782beee10e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.620896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1104201e8b024625ac96a782beee10e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.621743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1104201e8b024625ac96a782beee10e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.643022 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:54.747256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1be3ecee-a2da-43b4-adb0-47504cf2f8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1104201e8b024625ac96a782beee10e0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.763360 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:54.780957 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2033/4084] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:54 2022] DELETE /identity/v3/users/1104201e8b024625ac96a782beee10e0 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:54.786076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:54.788503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:54.789813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:54.802494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcc919d64ec4e0887a6695ebe61a6d2', 'request_id': 'req-b24201d3-9196-4aa7-bab5-1267371dd654'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.836004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:54.837813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:54.927196 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2034/4085] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:54.936284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcc919d64ec4e0887a6695ebe61a6d2', 'request_id': 'req-b24201d3-9196-4aa7-bab5-1267371dd654'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.945235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.949452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:54.954168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcc919d64ec4e0887a6695ebe61a6d2', 'request_id': 'req-b24201d3-9196-4aa7-bab5-1267371dd654'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.977360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] The token cache is being invalidate because project 1fcc919d64ec4e0887a6695ebe61a6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:54.978633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.980199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:54.982255 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2052/4086] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:54 2022] DELETE /identity/v3/projects/1fcc919d64ec4e0887a6695ebe61a6d2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:54.985978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:54.987706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.024730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8e791-b4ee-49b7-8a61-581bd9296c1a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:55.031449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:55.032731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.033050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.033325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.035137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.048823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:55.052966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:55.060500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2035/4087] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:32:55.087294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24201d3-9196-4aa7-bab5-1267371dd654 tempest-ListProjectsStaticTestJSON-270696068 tempest-ListProjectsStaticTestJSON-270696068-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:55.093655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:55.094526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.094821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.095200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] PATH_INFO: `/v3/users/cb3e90a035bc4e4697f9ffececdc6978` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.096438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3e90a035bc4e4697f9ffececdc6978)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:55.098634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:55.363036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3e90a035bc4e4697f9ffececdc6978'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.446405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:55.448364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.455769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3e90a035bc4e4697f9ffececdc6978'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.457529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3e90a035bc4e4697f9ffececdc6978'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.460956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f8bf-c632-49e6-b7bb-53c9583e6249 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:55.467638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:55.468744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.468744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.468912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] PATH_INFO: `/v3/projects/d6bd8b0ad06c4f188946291ca96b551c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.470109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bd8b0ad06c4f188946291ca96b551c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:55.472065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:55.501284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3e90a035bc4e4697f9ffececdc6978'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.514803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ff8e0e1d-b06c-4f0d-acf8-14e8990f2eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3e90a035bc4e4697f9ffececdc6978'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.548277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2053/4088] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:54 2022] DELETE /identity/v3/users/cb3e90a035bc4e4697f9ffececdc6978 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:55.552836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.553130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.553509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.584535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:55.585920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.648960 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:55.659313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bd8b0ad06c4f188946291ca96b551c', 'request_id': 'req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.687115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bd8b0ad06c4f188946291ca96b551c', 'request_id': 'req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.741553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2054/4089] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:55.742777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:55.744278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.818391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57428bb-efac-432a-8f96-db3751f20a81 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:55.821442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bd8b0ad06c4f188946291ca96b551c', 'request_id': 'req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.841170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] The token cache is being invalidate because project d6bd8b0ad06c4f188946291ca96b551c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:55.841512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.842773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bd53ca5-03a7-4403-a44d-2f1b8b580f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:55.846284 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2036/4090] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:55 2022] DELETE /identity/v3/projects/d6bd8b0ad06c4f188946291ca96b551c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:55.851373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4412d-18fd-4ce8-8004-41b3cfba7e84 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.851705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4412d-18fd-4ce8-8004-41b3cfba7e84 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.851981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4412d-18fd-4ce8-8004-41b3cfba7e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.903180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ecf4412d-18fd-4ce8-8004-41b3cfba7e84 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:55.912383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ecf4412d-18fd-4ce8-8004-41b3cfba7e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:55.965104 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:55.966121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:55.968056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:55.969312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:55.970153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:55.972459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:56.019936 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2037/4091] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:56.028851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.030118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.030867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.074530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:56.076256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:56.096947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2038/4092] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:56.098272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.110214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c1946-3e7d-4dfa-94cc-e1ce271baae6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.115575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.116568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.117600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.118226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.119177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:56.120315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.121888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.123058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.123341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.152054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2055/4094] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:56.152261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2039/4094] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:32:56.153751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.178042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1665-9259-45b2-9225-cdcb2185f739 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.200126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.200126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.200126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.200126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.200786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.200786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.305264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2056/4095] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:56 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:56.310835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.328232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03899b-ec97-4775-88fa-f868bdea6751 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.476636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.477431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.477753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.478027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.478666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.481474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.609515 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2040/4096] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:56 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:56.613287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.626236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b51c0d-7bcc-4db2-a6c5-6e4d6c2aedf7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.632996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.634454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.635114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.635623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.636674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.638566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.664767 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2057/4097] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:56.666048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.681192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c165c6-9219-4633-b4aa-2c69ac761628 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.699803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.700667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.700948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.701224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.705459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.709729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.772503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2041/4098] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:56.777109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.784186 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:56.791084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974581a4-3d1a-4917-8ed1-95ba10a2a345 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:56.817603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:56.818756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.819218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.819669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] PATH_INFO: `/v3/projects/7634181ad4b84c9784bd9e4cfa45e346/users/fb30eee04535493c82a5f8d18d8bd6b8/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.837028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7634181ad4b84c9784bd9e4cfa45e346, user_id=fb30eee04535493c82a5f8d18d8bd6b8, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:56.840650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c91616-423f-4e24-9f0f-94b0a2840b93 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:56.944841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:56.947115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2058/4099] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:56 2022] PUT /identity/v3/projects/7634181ad4b84c9784bd9e4cfa45e346/users/fb30eee04535493c82a5f8d18d8bd6b8/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:56.947396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:56.956739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:56.957018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:56.957295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:56.973420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c6ed6-7761-48ea-a844-3adc652cc270 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:57.035707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] MFA Rules not processed for user `fb30eee04535493c82a5f8d18d8bd6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:57.036963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:57.120397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:57.121097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:57.121326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:57.121609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] PATH_INFO: `/v3/projects/e6eaa098facd4b1997bca66d2c8125ec` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:57.124330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6eaa098facd4b1997bca66d2c8125ec)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:57.126291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:57.174900 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2059/4100] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:57.185843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:57.187472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:57.205585 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:57.275156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32b2c-305e-43f5-b8ef-3b28b1d70f71 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:57.283196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6eaa098facd4b1997bca66d2c8125ec', 'request_id': 'req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.290989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6eaa098facd4b1997bca66d2c8125ec', 'request_id': 'req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.354635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:57.355574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:57.356959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:57.357495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:57.398147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6eaa098facd4b1997bca66d2c8125ec', 'request_id': 'req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.413995 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:57.417752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] The token cache is being invalidate because project e6eaa098facd4b1997bca66d2c8125ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:57.418250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.419087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.421107 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2042/4101] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:56 2022] DELETE /identity/v3/projects/e6eaa098facd4b1997bca66d2c8125ec => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:57.424718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:57.426339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:57.437803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:57.440385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:57.450471 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2060/4102] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:32:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:32:57.537232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35c0a-d9f1-46e4-a3bd-9832b5704916 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:57.549432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:57.549432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:57.549968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:57.550353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] PATH_INFO: `/v3/users/245cc46183da48fdab156c7917da4d64` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:57.552975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245cc46183da48fdab156c7917da4d64)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:57.555591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:57.848043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245cc46183da48fdab156c7917da4d64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.851323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245cc46183da48fdab156c7917da4d64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.866373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245cc46183da48fdab156c7917da4d64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.870467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245cc46183da48fdab156c7917da4d64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.941508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4c3f7fc-7be2-4f1a-ae4a-868fa39bd2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245cc46183da48fdab156c7917da4d64'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:57.981691 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2043/4103] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:32:57 2022] DELETE /identity/v3/users/245cc46183da48fdab156c7917da4d64 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:32:58.690721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:58.702747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83a3e5-27d4-4867-bb59-aad3682a150d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:58.821795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:58.822739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:58.823448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:58.824540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] PATH_INFO: `/v3/projects/fff06be24e7042788ed3f47b9160f8ac` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:58.825843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff06be24e7042788ed3f47b9160f8ac)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:58.828504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.040842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff06be24e7042788ed3f47b9160f8ac', 'request_id': 'req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:59.119368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff06be24e7042788ed3f47b9160f8ac', 'request_id': 'req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:59.129815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff06be24e7042788ed3f47b9160f8ac', 'request_id': 'req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:59.149611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] The token cache is being invalidate because project fff06be24e7042788ed3f47b9160f8ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:32:59.149963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:59.151218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c75ad47-3c73-4431-b3a4-4c15ed9878fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:32:59.156581 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2061/4104] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:32:58 2022] DELETE /identity/v3/projects/fff06be24e7042788ed3f47b9160f8ac => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:32:59.158816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.159305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.159512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.207586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:59.210021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:59.262764 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:32:59.327055 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2044/4105] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:59.328437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.328726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.329077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.390672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:32:59.395936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:32:59.409149 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2062/4106] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:32:59.414120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:59.426232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74b9a-b0f7-4c66-9d82-ee06ea25dafa None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:59.432438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:59.436317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.436317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.436317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.436317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:32:59.436317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:59.438124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.461322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2045/4107] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:32:59.467893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:59.479691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de92e44-7cef-487f-a0b2-83051c1cf387 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:59.488267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:59.488267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.488267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.488267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.488741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:59.490642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.651425 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2063/4108] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:32:59 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:59.654996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:59.673625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3797a3-1594-4267-8c6c-10c28df4f01c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:59.755889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:59.756956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.757250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.757627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.758327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:59.761365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.851801 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2046/4109] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:32:59 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:32:59.855828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:59.872116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58b829-cba9-42dc-8282-b53ff8719f9f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:59.878894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:59.879780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.880202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.880624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.881453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:59.885769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.928443 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2064/4110] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:59.934476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:32:59.942923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed390f-32fa-490e-89a2-5279f610680c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:32:59.955621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:32:59.956318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:32:59.956674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:32:59.957023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:32:59.957789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:32:59.961903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477d866-e6c1-434d-a921-27492f64851e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:32:59.991503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2047/4111] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:32:59.996071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:00.016507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94f432-7d86-4c5e-95ee-d99fd74b4eb1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:00.030561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:00.034028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:00.034480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:00.038355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] PATH_INFO: `/v3/projects/01f21ee9e19141a8a3db9504cea14c9f/users/4957586edfb64031aa6cbb63226513f0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:00.093004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f21ee9e19141a8a3db9504cea14c9f, user_id=4957586edfb64031aa6cbb63226513f0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:00.097063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:00.238095 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2065/4112] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:32:59 2022] PUT /identity/v3/projects/01f21ee9e19141a8a3db9504cea14c9f/users/4957586edfb64031aa6cbb63226513f0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:00.249763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:00.250303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:00.250303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:00.284135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] MFA Rules not processed for user `4957586edfb64031aa6cbb63226513f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:00.285629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:00.413789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2048/4113] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:00.419626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:00.442461 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:00.545293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d7eea-735b-4e28-9a31-a5b2265a1d3b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:00.553012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:00.556225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:00.558754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:00.559239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:00.560584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:00.563042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:00.772108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2066/4114] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:00 2022] POST /identity/v3/projects => generated 371 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:00.775874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:00.787871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427810-95dd-4aaa-bcf6-7d6a7f23ad92 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:00.825015 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:00.869730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:00.870368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:00.870958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:00.871140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:00.871781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:00.874454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.002247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2049/4115] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:00 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:01.003792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.034490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8689b-8a5f-4a45-b188-580200f4c045 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.046936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.047568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.048064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.048411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.049133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.050879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.062635 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2067/4116] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:01.066827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.078601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e9c39-4659-4634-b004-d3b3969c46c4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.083857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.084530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.084860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.085144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] PATH_INFO: `/v3/projects/4100ce5c4b834f6899a799713fa97721/users/244244fc3962405b9465f70b4d26e087/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.103313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4100ce5c4b834f6899a799713fa97721, user_id=244244fc3962405b9465f70b4d26e087, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.106565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.201243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2050/4117] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:01 2022] PUT /identity/v3/projects/4100ce5c4b834f6899a799713fa97721/users/244244fc3962405b9465f70b4d26e087/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:01.205632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.219397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1d221-ddd1-4ebd-8947-e7b0b501bd0c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.370141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.372324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.372639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.372890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.373579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.375685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380515-0301-4efb-8bc0-2ab7e6ad0362 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.388364 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2068/4118] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:01.392117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.405547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2eeee6-4c64-416e-8d78-b361a5409491 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.414198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.415124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.416932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.416932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] PATH_INFO: `/v3/projects/4100ce5c4b834f6899a799713fa97721/users/244244fc3962405b9465f70b4d26e087/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.419230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4100ce5c4b834f6899a799713fa97721, user_id=244244fc3962405b9465f70b4d26e087, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.422337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.444091 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2051/4119] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:01 2022] PUT /identity/v3/projects/4100ce5c4b834f6899a799713fa97721/users/244244fc3962405b9465f70b4d26e087/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:01.445787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.446576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.447243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.499691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] MFA Rules not processed for user `244244fc3962405b9465f70b4d26e087`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:01.501999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:01.596816 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2069/4120] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:01.601783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.614313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488adaf-db1e-4fb4-9670-bc27e3a8d763 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.620124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.620729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.621172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.621632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.622479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.624491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.729888 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2052/4121] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:01 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:01.733842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.744174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c03a4-7a86-478c-80b9-f74017ae1a3a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.806513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.807516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.808034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.808535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.809431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:01.811868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:01.969244 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2070/4122] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:01 2022] POST /identity/v3/users => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:01.970953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:01.988167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ce2d8-43af-4ed4-9d51-043a9bc3396c tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:01.994261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:01.995097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:01.996267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:01.996742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:01.997994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:01.999283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:02.000878 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:02.000878 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:02.000878 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:02.002411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f9078-40a4-4214-8ca3-ffe3aca5147e tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:02.043678 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2053/4123] 10.222.0.13 () {58 vars in 1157 bytes} [Sun Oct 30 01:33:01 2022] GET /identity/v3/users?domain_id=default => generated 8009 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:02.048395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:02.063708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bd96c-d24e-420e-ad6d-ba6dc68b7553 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:02.068925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:02.069921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:02.070402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:02.071444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/users/207c6b5c62fe446d892a1c9056cca712` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:02.093134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:update_user(user_id=207c6b5c62fe446d892a1c9056cca712)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:02.094590 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:02.094590 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:02.094590 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:02.096797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:02.207705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.328020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invalidating the token cache because user 207c6b5c62fe446d892a1c9056cca712 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:02.328020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.329365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.331531 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2071/4124] 10.222.0.13 () {60 vars in 1244 bytes} [Sun Oct 30 01:33:02 2022] PATCH /identity/v3/users/207c6b5c62fe446d892a1c9056cca712 => generated 488 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:02.335956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:02.336243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:02.336522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:02.352180 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.auth.plugins.core [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] User is disabled: 207c6b5c62fe446d892a1c9056cca712: AssertionError: User is disabled: 207c6b5c62fe446d892a1c9056cca712 Oct 30 01:33:02.359669 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.application [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:33:02.361053 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2054/4125] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:02 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 26 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 30 01:33:02.365188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:02.366881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:02.382828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368c58-e57d-4e4d-a0a1-2aeb1b117d22 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:02.387862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:02.388502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:02.393475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:02.393475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/users/207c6b5c62fe446d892a1c9056cca712` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:02.405734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:delete_user(user_id=207c6b5c62fe446d892a1c9056cca712)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:02.407952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:02.534108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.575892 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:02.643498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.644206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.665322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.674529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207c6b5c62fe446d892a1c9056cca712'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.680910 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2072/4126] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:02 2022] DELETE /identity/v3/users/207c6b5c62fe446d892a1c9056cca712 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:02.685001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:02.686929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:02.794291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbfd52-5d95-4141-8a3b-d5dc1a1c346b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:02.801740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:02.802387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:02.802665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:02.802933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/projects/94fd36c8d42944f48208304faef24914` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:02.804153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94fd36c8d42944f48208304faef24914)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:02.805992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:02.955599 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:02.962456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fd36c8d42944f48208304faef24914', 'request_id': 'req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:02.969090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fd36c8d42944f48208304faef24914', 'request_id': 'req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.052051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fd36c8d42944f48208304faef24914', 'request_id': 'req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.089163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] The token cache is being invalidate because project 94fd36c8d42944f48208304faef24914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:03.090385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.091982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.103655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:03.104094 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2055/4127] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:02 2022] DELETE /identity/v3/projects/94fd36c8d42944f48208304faef24914 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:03.124687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b0405-f33c-4b7d-bc2c-0df278ed6bb1 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:03.193459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244244fc3962405b9465f70b4d26e087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4100ce5c4b834f6899a799713fa97721', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:03.194583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:03.194933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:03.195274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:03.196419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:03.200728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-3d1c271c-1ff5-4eeb-9ef1-bad019fefc87 tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Could not find domain: 839eff4e0ac842ddb2ac07d27e93fd38.: keystone.exception.DomainNotFound: Could not find domain: 839eff4e0ac842ddb2ac07d27e93fd38. Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 839eff4e0ac842ddb2ac07d27e93fd38. Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:03.216538 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:33:03.217675 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:33:03.218639 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:33:03.219620 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:33:03.219620 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:33:03.219620 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 839eff4e0ac842ddb2ac07d27e93fd38. Oct 30 01:33:03.219620 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:03.223600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:03.224213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2073/4128] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:03 2022] POST /identity/v3/users => generated 112 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:33:03.225311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:03.327013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb8909-e9f0-4b5f-b896-ffe13e18a40f tempest-UsersNegativeTest-1347183966 tempest-UsersNegativeTest-1347183966-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:03.332698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:03.333812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:03.334124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:03.335044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] PATH_INFO: `/v3/users/4957586edfb64031aa6cbb63226513f0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:03.336422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4957586edfb64031aa6cbb63226513f0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:03.340170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:03.573205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4957586edfb64031aa6cbb63226513f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.574567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4957586edfb64031aa6cbb63226513f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.605370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4957586edfb64031aa6cbb63226513f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.605370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4957586edfb64031aa6cbb63226513f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.709819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4957586edfb64031aa6cbb63226513f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:03.748038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d92e5-236c-4537-936f-f35729f91295 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:03.748327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d92e5-236c-4537-936f-f35729f91295 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:03.748604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d92e5-236c-4537-936f-f35729f91295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:03.765247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2056/4129] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:03 2022] DELETE /identity/v3/users/4957586edfb64031aa6cbb63226513f0 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:03.784332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-759d92e5-236c-4537-936f-f35729f91295 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:03.785616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-759d92e5-236c-4537-936f-f35729f91295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:03.885742 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2074/4130] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:03.901114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:03.907376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:03.985305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a0e6-777c-434d-b8af-237729cd37f6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:03.991135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:03.991135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:03.991135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:03.991135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:04.010329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:04.012070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:04.033678 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2057/4131] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:04.209475 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:04.547948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d92e5-236c-4537-936f-f35729f91295 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:04.550417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-759d92e5-236c-4537-936f-f35729f91295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:04.567824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d92e5-236c-4537-936f-f35729f91295 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:04.586501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:04.587327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:04.588218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:04.588742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] PATH_INFO: `/v3/projects/01f21ee9e19141a8a3db9504cea14c9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:04.590214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f21ee9e19141a8a3db9504cea14c9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:04.592625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:04.706423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f21ee9e19141a8a3db9504cea14c9f', 'request_id': 'req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:04.803430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f21ee9e19141a8a3db9504cea14c9f', 'request_id': 'req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:04.816380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f21ee9e19141a8a3db9504cea14c9f', 'request_id': 'req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:04.833524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] The token cache is being invalidate because project 01f21ee9e19141a8a3db9504cea14c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:04.833954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:04.834819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:04.837458 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2075/4132] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:04 2022] DELETE /identity/v3/projects/01f21ee9e19141a8a3db9504cea14c9f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:04.841922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:04.865291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cdd75-4ef3-432e-8315-3199316d616e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:04.962514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:04.962514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:04.962949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:04.963145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] PATH_INFO: `/v3/users/244244fc3962405b9465f70b4d26e087` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:04.966147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=244244fc3962405b9465f70b4d26e087)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:04.968438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:05.242980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244244fc3962405b9465f70b4d26e087'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:05.244299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244244fc3962405b9465f70b4d26e087'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:05.251961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244244fc3962405b9465f70b4d26e087'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:05.252910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244244fc3962405b9465f70b4d26e087'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:05.346548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7fbcbb51-ad1f-4472-a6b8-2d69798c93ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244244fc3962405b9465f70b4d26e087'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:05.393161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2058/4133] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:04 2022] DELETE /identity/v3/users/244244fc3962405b9465f70b4d26e087 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:05.583742 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:06.019564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:06.021364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:06.051327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44eff-da84-40ac-b3a7-7b05770e7d3f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:06.161547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:06.162191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:06.162487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:06.162740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] PATH_INFO: `/v3/projects/4100ce5c4b834f6899a799713fa97721` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:06.164804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4100ce5c4b834f6899a799713fa97721)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:06.166418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:06.304458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4100ce5c4b834f6899a799713fa97721', 'request_id': 'req-23d9e459-455b-4228-ba4c-1d17280ff93c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:06.454910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4100ce5c4b834f6899a799713fa97721', 'request_id': 'req-23d9e459-455b-4228-ba4c-1d17280ff93c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:06.462835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4100ce5c4b834f6899a799713fa97721', 'request_id': 'req-23d9e459-455b-4228-ba4c-1d17280ff93c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:06.479255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] The token cache is being invalidate because project 4100ce5c4b834f6899a799713fa97721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:06.479596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:06.497727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23d9e459-455b-4228-ba4c-1d17280ff93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:06.508063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2076/4134] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:06 2022] DELETE /identity/v3/projects/4100ce5c4b834f6899a799713fa97721 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:06.509039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:06.509608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:06.509713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:06.538167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:06.539429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:06.661217 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2059/4135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:06.670581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:06.670859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:06.671426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:06.699460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:06.700987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:06.710638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2077/4136] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:06.715495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:06.732801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9229d-0b31-4d46-b115-19b0b16b7498 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:06.745022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:06.746097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:06.746501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:06.746878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:06.747665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:06.750434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:06.752639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:06.785305 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2060/4137] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:06.789090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:06.799820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3875ff-7285-4b7a-95eb-5b6026b7437c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:06.805571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:06.812914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:06.813504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:06.814137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:06.815137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:06.817284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:06.926687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2078/4138] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:06 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:06.930732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:06.943020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8a05f-4206-41ba-b881-184b89ac4dfa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:07.025454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:07.027808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.028624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.029001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.029798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:07.032951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:07.150234 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2061/4139] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:06 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:07.152112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:07.168266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3cd68-41dc-4428-bcd5-0f35fb26a525 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:07.174462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:07.175099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.175377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.175644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.176297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:07.178064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:07.191434 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2079/4140] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:07.195588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:07.208535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7ceb3-df40-47ef-a30d-370d7491b5e4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:07.214328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:07.215357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.215805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.216103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.216960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:07.219048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623547c-958f-43d9-bb07-514e132aa402 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:07.233616 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2062/4141] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:07.237995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:07.249606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee969da5-9090-4b89-bc13-1fcd02ce71c6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:07.255569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:07.256587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.257314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.257887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] PATH_INFO: `/v3/projects/96e0b44c7db6428e98da74cfb09bbe31/users/eebcb83338764bb0b8e83a57b7c591d5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.373499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e0b44c7db6428e98da74cfb09bbe31, user_id=eebcb83338764bb0b8e83a57b7c591d5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:07.376189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:07.489827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2080/4142] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:07 2022] PUT /identity/v3/projects/96e0b44c7db6428e98da74cfb09bbe31/users/eebcb83338764bb0b8e83a57b7c591d5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:07.502056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.502591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.502911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.548440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] MFA Rules not processed for user `eebcb83338764bb0b8e83a57b7c591d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:07.550517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:07.621412 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:07.676186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2063/4143] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:07.676979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:07.754245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4131a-bdf2-4b60-a5b0-5398034e9c02 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:07.760070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:07.760818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:07.761247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:07.761710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:07.762551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:07.765078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:07.881658 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:07.898876 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2081/4144] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:07 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:07.902943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:07.926352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ae62e-7a6a-4164-8ef0-ee3c4c1e6a4a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:08.035838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:08.036763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.036972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.037300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.038102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:08.041565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:08.155147 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2064/4145] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:07 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:08.159256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:08.195662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07dd9c-e5e3-4194-a401-3cd3d6a74f32 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:08.211505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:08.213278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.213769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.214341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.215187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:08.217034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:08.245179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2082/4146] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:08.249290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:08.289782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fd917-5ec9-4134-b4ea-c70503756086 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:08.296459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:08.301279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.301279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.301279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] PATH_INFO: `/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc/users/64df5450ae90440a96388261173d8ca9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.325691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f96b477f974f13bc6a8b3ebe5a4fdc, user_id=64df5450ae90440a96388261173d8ca9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:08.338605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:08.498986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2065/4147] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:08 2022] PUT /identity/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc/users/64df5450ae90440a96388261173d8ca9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:08.503260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:08.541177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9fad8-08c0-4732-a909-8c8f6b6b9874 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:08.647036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:08.648020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.648452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.648951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.650603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:08.652763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89762139-b8bc-49d1-93c8-1a48f68254b4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:08.666692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2083/4148] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:08.671646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:08.684381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16906a76-d4b7-4c8d-84d2-ed3ccb40c412 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:08.697790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:08.700248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.700707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.701166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] PATH_INFO: `/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc/users/64df5450ae90440a96388261173d8ca9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.703356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f96b477f974f13bc6a8b3ebe5a4fdc, user_id=64df5450ae90440a96388261173d8ca9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:08.706646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:08.731486 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2066/4149] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:08 2022] PUT /identity/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc/users/64df5450ae90440a96388261173d8ca9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:08.745522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:08.745834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:08.746114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:08.811794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] MFA Rules not processed for user `64df5450ae90440a96388261173d8ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:08.813071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:08.970619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2084/4150] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:08.983857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:08.985718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:09.074753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fceff-983d-4a32-b632-80a25ac9e299 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:09.079278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:09.080029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:09.080314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:09.080588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:09.092965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:09.094572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c05e1-16f2-49b1-b468-d09464897872 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:09.105324 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2067/4151] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:09.645951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:09.649199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:09.775768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845d136-0717-4445-a8a9-d462beec3d28 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:09.784061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:09.785662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:09.787102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:09.787383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:09.792433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:09.861451 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:09.874130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:09.880864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:09.897820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2085/4152] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:09.927386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7406-aebb-4904-95a6-bc5ed2fa5ad5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:09.927860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7406-aebb-4904-95a6-bc5ed2fa5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:09.927940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c7406-aebb-4904-95a6-bc5ed2fa5ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:09.974863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ea1c7406-aebb-4904-95a6-bc5ed2fa5ad5 None None] MFA Rules not processed for user `0bce487302c24def8a8473b0725904f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:09.976529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea1c7406-aebb-4904-95a6-bc5ed2fa5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:10.057601 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2068/4153] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:10.277563 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:12.616637 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:12.930144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:13.083206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bf864-a7e8-4397-ab8d-981b2fa3c0f5 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:13.094631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:13.095464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:13.095841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:13.096208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] PATH_INFO: `/v3/users/eebcb83338764bb0b8e83a57b7c591d5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:13.097586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebcb83338764bb0b8e83a57b7c591d5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:13.100005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:13.343192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebcb83338764bb0b8e83a57b7c591d5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:13.431758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebcb83338764bb0b8e83a57b7c591d5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:13.432456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebcb83338764bb0b8e83a57b7c591d5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:13.452894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebcb83338764bb0b8e83a57b7c591d5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:13.468249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebcb83338764bb0b8e83a57b7c591d5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:13.478455 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2086/4154] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:12 2022] DELETE /identity/v3/users/eebcb83338764bb0b8e83a57b7c591d5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:13.482758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:13.483237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:13.483345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:13.527231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:13.531175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:13.668334 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2069/4155] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:13.685576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:13.687275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:13.775379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15457bb-1eb3-4483-a5b6-2b814c406b13 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:13.781909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:13.782833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:13.783132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:13.783405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:13.798815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:13.801363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:13.833259 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2087/4156] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:14.707396 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:15.032356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:15.033840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:15.069410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fee78-d3a6-41db-9192-bc8e23ec77a7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:15.100728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:15.104619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:15.104937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:15.106662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] PATH_INFO: `/v3/projects/96e0b44c7db6428e98da74cfb09bbe31` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:15.110865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e0b44c7db6428e98da74cfb09bbe31)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:15.114004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:15.116570 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:15.250670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e0b44c7db6428e98da74cfb09bbe31', 'request_id': 'req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.269045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e0b44c7db6428e98da74cfb09bbe31', 'request_id': 'req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.374766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e0b44c7db6428e98da74cfb09bbe31', 'request_id': 'req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.390499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] The token cache is being invalidate because project 96e0b44c7db6428e98da74cfb09bbe31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:15.391149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.392053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.394130 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2070/4157] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:15 2022] DELETE /identity/v3/projects/96e0b44c7db6428e98da74cfb09bbe31 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:15.398749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:15.412444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f8de3-0b7d-4c82-9a88-85c4d7f2f14b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:15.531623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:15.531623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:15.531881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:15.532083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] PATH_INFO: `/v3/users/64df5450ae90440a96388261173d8ca9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:15.534076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64df5450ae90440a96388261173d8ca9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:15.538064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:15.549631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:15.552271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:15.639342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b05a-9d62-4b95-a766-47ae2cda5ad7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:15.648538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:15.648538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:15.648538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:15.648538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:15.655208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:15.674211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:15.676125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:15.690495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2071/4158] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:15.845987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:15.847531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:15.867190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efe41-abb1-44d4-a5fb-d3f0cd7fed69 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:15.874635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:15.875512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:15.876150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:15.879633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] PATH_INFO: `/v3/users/fb30eee04535493c82a5f8d18d8bd6b8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:15.881157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb30eee04535493c82a5f8d18d8bd6b8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:15.884465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:15.888002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64df5450ae90440a96388261173d8ca9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.982341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64df5450ae90440a96388261173d8ca9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:15.983619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64df5450ae90440a96388261173d8ca9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.015684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64df5450ae90440a96388261173d8ca9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.031036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb54bf62-de22-4623-a101-2773103ac154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64df5450ae90440a96388261173d8ca9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.039050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2088/4159] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:15 2022] DELETE /identity/v3/users/64df5450ae90440a96388261173d8ca9 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:16.147849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb30eee04535493c82a5f8d18d8bd6b8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.149757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb30eee04535493c82a5f8d18d8bd6b8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.168497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb30eee04535493c82a5f8d18d8bd6b8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.169812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb30eee04535493c82a5f8d18d8bd6b8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.231252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb30eee04535493c82a5f8d18d8bd6b8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:16.264858 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2072/4160] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:15 2022] DELETE /identity/v3/users/fb30eee04535493c82a5f8d18d8bd6b8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:16.269260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:16.269588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:16.269870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:16.299109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:16.300597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:16.436898 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2089/4161] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:16.579719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:16.582879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:16.591404 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:16.615189 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:16.685713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239c35-2271-4665-9da7-5270d237bf86 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:16.690205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:16.690831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:16.691460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:16.691893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:16.702452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:16.704234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:16.718013 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2073/4162] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:17.177253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:17.178948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:17.193578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5f6b0-3a4b-4b25-ae79-664411325c29 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:17.242341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:17.243837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.244528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.245217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] PATH_INFO: `/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.246950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f96b477f974f13bc6a8b3ebe5a4fdc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:17.248978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:17.425913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f96b477f974f13bc6a8b3ebe5a4fdc', 'request_id': 'req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.432027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:17.434320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:17.467805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a822472-b1b7-4698-8a9d-70ac1a2694c2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:17.523036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f96b477f974f13bc6a8b3ebe5a4fdc', 'request_id': 'req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.531971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f96b477f974f13bc6a8b3ebe5a4fdc', 'request_id': 'req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.564825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] The token cache is being invalidate because project d9f96b477f974f13bc6a8b3ebe5a4fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:17.567604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.568751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f39a02-8ba8-4858-a2d8-5224b9b52c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.579283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2090/4163] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:17 2022] DELETE /identity/v3/projects/d9f96b477f974f13bc6a8b3ebe5a4fdc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:17.583468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9882-ed34-4555-b079-96eb11a65858 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.585318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9882-ed34-4555-b079-96eb11a65858 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.587544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b9882-ed34-4555-b079-96eb11a65858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.630690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a8b9882-ed34-4555-b079-96eb11a65858 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:17.633055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a8b9882-ed34-4555-b079-96eb11a65858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:17.645155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:17.645847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.646119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.646568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] PATH_INFO: `/v3/projects/7634181ad4b84c9784bd9e4cfa45e346` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.648026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7634181ad4b84c9784bd9e4cfa45e346)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:17.650166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:17.727509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2091/4164] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:17.727509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.727509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.727509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.761768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:17.763458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:17.776106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2092/4165] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:17.781265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:17.802698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6076bf8-9f14-493a-9ba6-04278cc6799f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:17.811785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7634181ad4b84c9784bd9e4cfa45e346', 'request_id': 'req-238c33ba-bc49-4b51-b625-043798629103'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.829140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7634181ad4b84c9784bd9e4cfa45e346', 'request_id': 'req-238c33ba-bc49-4b51-b625-043798629103'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.918773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7634181ad4b84c9784bd9e4cfa45e346', 'request_id': 'req-238c33ba-bc49-4b51-b625-043798629103'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.941648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] The token cache is being invalidate because project 7634181ad4b84c9784bd9e4cfa45e346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:17.941974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.943146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-238c33ba-bc49-4b51-b625-043798629103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:17.953992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2074/4166] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:17 2022] DELETE /identity/v3/projects/7634181ad4b84c9784bd9e4cfa45e346 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:17.954777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:17.955410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4bb34-8c7b-4ed5-b4fb-4af630159d0e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.955600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:17.955725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4bb34-8c7b-4ed5-b4fb-4af630159d0e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.955968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4bb34-8c7b-4ed5-b4fb-4af630159d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.956214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:17.956743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:17.957939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:17.958399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:17.960395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:17.986424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2093/4167] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:17.987904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:17.992169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:18.008649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-76b4bb34-8c7b-4ed5-b4fb-4af630159d0e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:18.010197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-76b4bb34-8c7b-4ed5-b4fb-4af630159d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:18.029043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2075/4168] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:18.033885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de07b-d308-4e11-89e0-566a1ce1a4bd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.037708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.038231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.046071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.046212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.050051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.050332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.050614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.052136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.054114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.066941 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:18.120972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:18.125496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:18.140214 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2076/4169] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:18.146192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.159883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95294a6-e6d9-425b-a23c-ccaa528b5747 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.177732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.178433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.178789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.179141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.179932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:18.180425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.184808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.208430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2077/4170] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:18.210254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.222770 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2094/4171] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:17 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:18.231017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9675a0-9ca3-4dd4-93e2-f62e39197778 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.231209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.265784 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:18.348147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.349837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.350892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.351338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.352275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.356643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.404057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4e83b-a970-42cb-825f-c66da5df689f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.414721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.416230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.416522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.418229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.418935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.421180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.473394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2078/4172] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:18 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:18.476096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.556269 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2095/4173] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:18 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:18.557320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.568768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718183c0-a3fd-4339-8480-cc410bc80f3a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.572105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce699-26d0-4228-a1c4-c3fc5d0a7010 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.573679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.574728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.575213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.575799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.577586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.581477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.592965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.593844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.594684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.595296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.596731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.599347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.616796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2096/4174] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:18.618900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.654180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b344ca8-80af-4dda-9688-e6030ea1b666 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.675724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.676350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.676630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.676902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.677572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.679171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.694939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2097/4175] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:18.712256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.712256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:18.717589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2079/4176] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:18 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:18.740048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8a1e-b6eb-4a96-8da8-22bac60d8b15 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.755992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.756667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.756949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.757226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] PATH_INFO: `/v3/users/b0d4603acbc846dcb2f523091cd78ae4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.758905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d4603acbc846dcb2f523091cd78ae4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.760572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:18.763136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:18.789074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262877-1717-4d39-9505-a142aceacc65 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:18.797592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:18.799323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:18.799842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:18.800342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] PATH_INFO: `/v3/projects/001e3e60f5544d2c81987793282f3206/users/e013b6bc2259430ea57af7182df9ac3a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:18.839385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=001e3e60f5544d2c81987793282f3206, user_id=e013b6bc2259430ea57af7182df9ac3a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:18.846749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.004121 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2080/4177] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:18 2022] PUT /identity/v3/projects/001e3e60f5544d2c81987793282f3206/users/e013b6bc2259430ea57af7182df9ac3a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:19.005283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.037738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d4603acbc846dcb2f523091cd78ae4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:19.152168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76579d4-6d6b-4fff-8844-ac673b06de78 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.156797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d4603acbc846dcb2f523091cd78ae4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:19.157639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d4603acbc846dcb2f523091cd78ae4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:19.163075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:19.164166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.165064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.165364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.166651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:19.168433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.175569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d4603acbc846dcb2f523091cd78ae4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:19.184701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fd7057da-a1b0-4da1-91d5-04744a2a9014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d4603acbc846dcb2f523091cd78ae4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:19.191834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2098/4178] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:18 2022] DELETE /identity/v3/users/b0d4603acbc846dcb2f523091cd78ae4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:19.193749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.194224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.198425 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2081/4179] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:19.202018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.202187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.204601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:19.228193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f2051-99e5-47f5-819d-b4ebb6d52077 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.272171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] MFA Rules not processed for user `e013b6bc2259430ea57af7182df9ac3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:19.273563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:19.374370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:19.375277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.375762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.376408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.378018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:19.382228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.404704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2082/4180] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:19.407455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.428545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780522-3419-4af6-b0d1-c07dcadfb5de admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.432912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2099/4181] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:19.442745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.446133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:19.448782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:19.449752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.450275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.451574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] PATH_INFO: `/v3/projects/f8b09ed07d944e85930002ff8bd6e1e6/users/3b493d5b36444c51a9edce806fcf092e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.475715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a17b3f-4c88-4c8a-808a-157b0b90cce3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.481937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b09ed07d944e85930002ff8bd6e1e6, user_id=3b493d5b36444c51a9edce806fcf092e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:19.485328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d08b9-e9eb-42ad-a8ae-de149f5c6fbf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.493142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:19.494679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.495378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.495772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.502562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:19.502562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.567147 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2083/4182] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:19 2022] PUT /identity/v3/projects/f8b09ed07d944e85930002ff8bd6e1e6/users/3b493d5b36444c51a9edce806fcf092e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:19.568781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.569070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.569384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.628968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] MFA Rules not processed for user `3b493d5b36444c51a9edce806fcf092e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:19.630728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:19.672546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2100/4183] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:19 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:19.673676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.787802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2084/4184] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:19.799393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.800057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:19.816263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3f478-c582-4b4b-82ed-258e873315b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.832507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:19.834652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:19.836417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:19.837067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:19.838641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:19.843440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:19.977980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b48d3-b4c4-4ff2-918c-0e8055d1695e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:19.981890 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2101/4185] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:19 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:19.990028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:19.990028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:20.017840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074058d2-687f-4650-9276-e29368b4b3f7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:20.032371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:20.032937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.033218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.033527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] PATH_INFO: `/v3/projects/8b25b290c8004e1f8f89e17b448f242a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.035784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b25b290c8004e1f8f89e17b448f242a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:20.039038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:20.066535 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:20.087575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:20.088360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.088744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.089120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.191093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:20.202895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:20.220414 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:20.226034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b25b290c8004e1f8f89e17b448f242a', 'request_id': 'req-9f667f83-116c-43f0-a862-922bdf3ba9b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.234857 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2085/4186] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:20.236551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:20.238323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:20.256935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b051-877c-4de3-ad57-b03af04187a0 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:20.329540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b25b290c8004e1f8f89e17b448f242a', 'request_id': 'req-9f667f83-116c-43f0-a862-922bdf3ba9b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.345985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b25b290c8004e1f8f89e17b448f242a', 'request_id': 'req-9f667f83-116c-43f0-a862-922bdf3ba9b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.373096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] The token cache is being invalidate because project 8b25b290c8004e1f8f89e17b448f242a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:20.373674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.376017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.379623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2102/4187] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:19 2022] DELETE /identity/v3/projects/8b25b290c8004e1f8f89e17b448f242a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:20.380803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:20.382229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:20.409933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:20.411122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.411411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.411686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] PATH_INFO: `/v3/users/ef5f8a3e6fef4d6393603575479b16a2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.414054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5f8a3e6fef4d6393603575479b16a2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:20.424567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:20.599722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f667f83-116c-43f0-a862-922bdf3ba9b3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:20.628287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:20.629067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.629315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.629626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.630291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:20.634491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97427d-ff16-4d2e-8b4b-6dc5e3b08904 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:20.660837 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2103/4188] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:20.660837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.664067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.664067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.728345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:20.729620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:20.735989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5f8a3e6fef4d6393603575479b16a2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.738435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5f8a3e6fef4d6393603575479b16a2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.761784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5f8a3e6fef4d6393603575479b16a2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.764093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5f8a3e6fef4d6393603575479b16a2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.766244 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2104/4189] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:20.769731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:20.803984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530b03b-2477-4740-a994-ab8d8072825e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:20.817290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:20.818092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.818370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.818688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] PATH_INFO: `/v3/projects/3451789e2e184f3499e338dd838b963e/users/081b7bb6de404bc7bad0eb0d9afa458b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:20.865003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-baca998c-0e94-44f8-b5a8-8c2166f1710b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5f8a3e6fef4d6393603575479b16a2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:20.873687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3451789e2e184f3499e338dd838b963e, user_id=081b7bb6de404bc7bad0eb0d9afa458b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:20.888846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:20.921248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2086/4190] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:20 2022] DELETE /identity/v3/users/ef5f8a3e6fef4d6393603575479b16a2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:20.928022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:20.931711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:20.932154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.006944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:21.011008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2105/4191] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:20 2022] PUT /identity/v3/projects/3451789e2e184f3499e338dd838b963e/users/081b7bb6de404bc7bad0eb0d9afa458b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:21.012387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:21.016136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.019144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:21.176248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2087/4192] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:21.178396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.190248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b8ea3-da6b-4aa3-ae66-20aa6485c7f7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.208950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccdc2d-62d9-4d9e-8185-1dc4b9f4bfc8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.213984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.216807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.217171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.219726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.222004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.228853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.229480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.230536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.230536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.230733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.235695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:21.237276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.241980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.264568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2106/4193] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:33:21.268708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.285885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2088/4194] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:33:21.290593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.302610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13062d-607c-482c-9a14-d51b760086b9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.318302 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:21.322414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.325295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.326828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6c6e0-ec0e-4ce6-9be4-2fecf30c29c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.329437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.329437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] PATH_INFO: `/v3/projects/3451789e2e184f3499e338dd838b963e/users/081b7bb6de404bc7bad0eb0d9afa458b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.343570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3451789e2e184f3499e338dd838b963e, user_id=081b7bb6de404bc7bad0eb0d9afa458b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.347682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f886ce-a35d-4d8b-8e27-e0507e1d9737 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.358105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.358840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.359129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.359405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.360183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.363416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.388670 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2107/4195] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:21 2022] PUT /identity/v3/projects/3451789e2e184f3499e338dd838b963e/users/081b7bb6de404bc7bad0eb0d9afa458b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:21.399471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.400109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.400444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.463964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] MFA Rules not processed for user `081b7bb6de404bc7bad0eb0d9afa458b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:21.465250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:21.504834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2089/4196] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:21 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:21.509909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.588438 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:21.628608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2108/4197] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:21.644222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.646436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:21.652970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedd3d-e3be-4aee-8c5e-2298eba2111f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.659096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.659716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.659998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.660367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.661011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.663141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.721106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758ae7a-783f-40a9-b06d-eb04f71532b1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.793453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.795449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.795835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.796240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.854321 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2090/4198] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:21 2022] POST /identity/v3/users => generated 290 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:21.854801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.864393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:21.905562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fcb6-b4e6-4aee-aaa2-d3ad92caef5d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.915792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.916750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.918074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.918506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] PATH_INFO: `/v3/projects/45fe1c50eaee40249b6c20cc91e52586` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.919868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fe1c50eaee40249b6c20cc91e52586)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.922237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.949046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.950564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:21.974283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2109/4199] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:21.975248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:21.988823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830a12-77a4-41aa-b165-a1583f35431e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:21.994570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:21.995535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:21.995535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:21.996337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:21.997810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:21.999709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.014492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2110/4200] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:22.018082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.034769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c118-0c4c-4e94-b0f7-6586d3366ad9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.040822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.041928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.042209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.042481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.043120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.044732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.055792 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2111/4201] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:22.059994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.070393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421a770-8e82-4962-a218-842dd9ca722e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.078078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fe1c50eaee40249b6c20cc91e52586', 'request_id': 'req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:22.084323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fe1c50eaee40249b6c20cc91e52586', 'request_id': 'req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:22.130788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.131622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.131902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.132173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] PATH_INFO: `/v3/projects/2b509d1b9c324201942dfeb350611a44/users/6f7675c0fa214588b71c04ca120557fc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.149443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b509d1b9c324201942dfeb350611a44, user_id=6f7675c0fa214588b71c04ca120557fc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.152090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdab8-9bb3-4648-a80c-a2a7ab3ed71c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.185883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fe1c50eaee40249b6c20cc91e52586', 'request_id': 'req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:22.199435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] The token cache is being invalidate because project 45fe1c50eaee40249b6c20cc91e52586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:22.199724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:22.200431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d42a1fbe-c6e0-465a-b66b-544e6677ffd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:22.201988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2091/4202] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:21 2022] DELETE /identity/v3/projects/45fe1c50eaee40249b6c20cc91e52586 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:22.206700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec76d-c014-40ff-b2bd-d1eea774e551 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.206979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec76d-c014-40ff-b2bd-d1eea774e551 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.207248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cec76d-c014-40ff-b2bd-d1eea774e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.226371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-38cec76d-c014-40ff-b2bd-d1eea774e551 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:22.228053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-38cec76d-c014-40ff-b2bd-d1eea774e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:22.235830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2092/4203] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:22.243717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.243987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.244260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.252240 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2112/4204] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:22 2022] PUT /identity/v3/projects/2b509d1b9c324201942dfeb350611a44/users/6f7675c0fa214588b71c04ca120557fc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:22.258934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.259300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.259638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.267568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:22.269169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:22.281260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:22.282792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:22.297987 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:22.396481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2093/4205] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:22.396481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.410635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b1fc9-c6f0-4a74-adbd-da91ccbbbfe4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.418336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.418961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.419460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.419830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.420497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:22.420796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.422520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.445841 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2094/4206] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:22.446746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.454526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2113/4207] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:22.463109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.464527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:22.479880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739eb7-4c85-4787-9eaa-6d4f67e5a6aa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.496716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.497357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.497847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.498342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.499049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.500952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.596936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945e33-32e6-433b-b01a-dcf881ec770d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.607755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.608380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.608655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.608924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.631432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.633603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.661962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2114/4208] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:22.669710 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2095/4209] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:22 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:22.673868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.689197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73566b53-1228-4a40-9618-e8b19522cf6e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.792943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.797624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.797624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.797624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.797624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.798325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.909241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2115/4210] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:22 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:22.910461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:22.930207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147f2c8-2012-48ed-a54e-25167d6db0a3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:22.944968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:22.947208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:22.948372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:22.949284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:22.954887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:22.962313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:22.982204 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2096/4211] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:33:22.985794 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:22.990483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:23.015672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfe53-2e86-4ad8-a33d-750bf7b17db6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:23.024716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:23.028067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:23.028412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:23.028674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:23.029433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:23.032603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13156e3-c041-46df-8a74-5dfa124a0723 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:23.051949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2116/4212] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:23.052576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:23.074679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310774b1-c39d-4ee6-a57b-e73d18f99ee9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:23.079995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:23.081683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:23.082728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:23.083367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] PATH_INFO: `/v3/projects/3f6da0fbf0024950b2c07a6db43ff3a3/users/94cab57fc5184fc6be1cfde72e9bab26/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:23.127204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6da0fbf0024950b2c07a6db43ff3a3, user_id=94cab57fc5184fc6be1cfde72e9bab26, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:23.130208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8b9c-42aa-46cd-9c6d-8f506cbdefd9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:23.207682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2097/4213] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:23 2022] PUT /identity/v3/projects/3f6da0fbf0024950b2c07a6db43ff3a3/users/94cab57fc5184fc6be1cfde72e9bab26/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:23.209596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:23.209877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:23.210291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:23.255468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] MFA Rules not processed for user `94cab57fc5184fc6be1cfde72e9bab26`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:23.257495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:23.428528 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:23.466001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2117/4214] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:23.479108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:23.480589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:23.481084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:23.512151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] MFA Rules not processed for user `94cab57fc5184fc6be1cfde72e9bab26`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:23.526545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:23.552943 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2098/4215] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:23.565595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:23.567492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:23.666544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485d8c-f865-4159-9bd2-5f72dc1f9e5e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:23.684492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:23.686992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:23.688229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:23.688783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:23.702772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:23.705957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:23.721620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2118/4216] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:23.807941 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:24.484590 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:25.706279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:25.708664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:25.779505 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:25.802099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd461423-0624-43be-aa52-2d64e64a3008 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:25.807809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:25.808663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:25.808946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:25.809217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] PATH_INFO: `/v3/users/6134c05549f14bc19962acea9c913f53` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:25.810395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6134c05549f14bc19962acea9c913f53)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:25.815650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:26.085051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6134c05549f14bc19962acea9c913f53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:26.086540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6134c05549f14bc19962acea9c913f53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:26.110204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6134c05549f14bc19962acea9c913f53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:26.115839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6134c05549f14bc19962acea9c913f53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:26.236401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6134c05549f14bc19962acea9c913f53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:26.257125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2099/4217] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:25 2022] DELETE /identity/v3/users/6134c05549f14bc19962acea9c913f53 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:26.627271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:26.653089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c9899-512b-439a-b763-1eece7852bcf service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:26.721129 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:26.796996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:26.797941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:26.798406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:26.798844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] PATH_INFO: `/v3/projects/470e235fb35840828d9a86028b72f5de` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:26.800842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470e235fb35840828d9a86028b72f5de)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:26.803768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:26.829307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:26.830959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:26.853125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2a0ff-d9ff-4e9c-8c97-e5fea9b06c9a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:26.862797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:26.863580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:26.864095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:26.864441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] PATH_INFO: `/v3/users/e013b6bc2259430ea57af7182df9ac3a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:26.866206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e013b6bc2259430ea57af7182df9ac3a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:26.869374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:26.972693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470e235fb35840828d9a86028b72f5de', 'request_id': 'req-e338e160-a5ea-4a49-8435-8323259c1de9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.100241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470e235fb35840828d9a86028b72f5de', 'request_id': 'req-e338e160-a5ea-4a49-8435-8323259c1de9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.113996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470e235fb35840828d9a86028b72f5de', 'request_id': 'req-e338e160-a5ea-4a49-8435-8323259c1de9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.123956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e013b6bc2259430ea57af7182df9ac3a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.127132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e013b6bc2259430ea57af7182df9ac3a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.130382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] The token cache is being invalidate because project 470e235fb35840828d9a86028b72f5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:27.136284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.136284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e338e160-a5ea-4a49-8435-8323259c1de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.137588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2119/4218] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:26 2022] DELETE /identity/v3/projects/470e235fb35840828d9a86028b72f5de => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:27.139475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e013b6bc2259430ea57af7182df9ac3a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.140281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e013b6bc2259430ea57af7182df9ac3a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.140955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce3dbf-f5ab-494b-9f5a-ba3d15dfd046 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.141242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce3dbf-f5ab-494b-9f5a-ba3d15dfd046 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.145934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce3dbf-f5ab-494b-9f5a-ba3d15dfd046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.176820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a7ce3dbf-f5ab-494b-9f5a-ba3d15dfd046 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:27.178247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7ce3dbf-f5ab-494b-9f5a-ba3d15dfd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:27.215531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-26ae65d3-db6c-4ee3-b780-0e7630540900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e013b6bc2259430ea57af7182df9ac3a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:27.251183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2100/4219] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:26 2022] DELETE /identity/v3/users/e013b6bc2259430ea57af7182df9ac3a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:27.253137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.253557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.254745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.309122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:27.311353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:27.319863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2120/4220] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:27.329276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.329924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.332797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.412620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:27.415830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:27.446264 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:27.483031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2101/4221] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:27.503924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:27.503924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:27.529960 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:27.556814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2121/4222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:27.561477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:27.572545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d120fd-8cf8-4b16-a35e-073fa6bda58b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:27.593066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:27.593726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.594029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.594303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.595437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:27.595437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:27.596221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec14b-279d-47fc-b9f2-912be90abc0a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:27.597046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:27.600482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:27.602116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.602494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.602864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.617622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:27.618946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:27.631460 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2102/4223] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:27.646809 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2122/4224] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:27.656870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:27.665595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f89ee-2f9e-4e0d-81d4-7703b42003f9 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:27.671504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:27.672235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:27.672615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:27.673296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:27.673891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:27.676759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:27.849968 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2103/4225] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:27.853921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:27.864338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcf6ce-43b9-4593-8b09-45b2971d8ce7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:27.998990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.000105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.006145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.006145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.006145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.006145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.164209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2123/4226] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:27 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:28.169090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.184059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975279-609b-434d-9e9e-a925f1bde35d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.192477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.193205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.193596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.193911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.195865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.198212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.215461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.218956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:28.255550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756fe24-fb61-48b4-9a02-f4eb079a1107 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.255759 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2104/4227] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:28.256793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.268552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.270151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.273729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.274016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] PATH_INFO: `/v3/projects/001e3e60f5544d2c81987793282f3206` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.275136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dd72c-4dbf-49ea-ac27-df71428952ce admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.278082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=001e3e60f5544d2c81987793282f3206)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.279996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.286033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.295912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.296683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.297087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.299052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.301076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.325981 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2105/4228] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:28.330309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.346638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c00d-98e4-4260-ad8e-932b4ce01182 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.353644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.354731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.355257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.355881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] PATH_INFO: `/v3/projects/6be552db3d5c4bb08a857af240021b26/users/de2601cd7465432284416c218b427db5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.377946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be552db3d5c4bb08a857af240021b26, user_id=de2601cd7465432284416c218b427db5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.383039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0c72a-7713-4601-a910-314086f6e1a7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.506486 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2106/4229] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:28 2022] PUT /identity/v3/projects/6be552db3d5c4bb08a857af240021b26/users/de2601cd7465432284416c218b427db5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:28.521435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.525170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.526719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.540790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001e3e60f5544d2c81987793282f3206', 'request_id': 'req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:28.610699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] MFA Rules not processed for user `de2601cd7465432284416c218b427db5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:28.613127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:28.681289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001e3e60f5544d2c81987793282f3206', 'request_id': 'req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:28.695721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001e3e60f5544d2c81987793282f3206', 'request_id': 'req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:28.721482 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2107/4230] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:28.722228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] The token cache is being invalidate because project 001e3e60f5544d2c81987793282f3206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:28.722524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:28.729607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:28.729607 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2124/4231] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:28 2022] DELETE /identity/v3/projects/001e3e60f5544d2c81987793282f3206 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:28.730219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.748857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:28.754362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:28.859008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214b61-a351-4b3b-9311-c88df556a424 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.869709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.872539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.872539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.872539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] PATH_INFO: `/v3/users/081b7bb6de404bc7bad0eb0d9afa458b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.874065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] RBAC: Authorizing `identity:delete_user(user_id=081b7bb6de404bc7bad0eb0d9afa458b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.877453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.894814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677172c-3dd7-4e3f-b8cf-7fcc4b36a3f6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:28.903554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:28.904372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:28.904672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:28.904949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:28.906934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:28.921523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:28.923317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:28.939621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2125/4232] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:29.107728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081b7bb6de404bc7bad0eb0d9afa458b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:29.108463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081b7bb6de404bc7bad0eb0d9afa458b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:29.123708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081b7bb6de404bc7bad0eb0d9afa458b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:29.124880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081b7bb6de404bc7bad0eb0d9afa458b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:29.186464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afb137c9-2212-4f5b-92e7-e90d616fadee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081b7bb6de404bc7bad0eb0d9afa458b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:29.214127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2108/4233] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:28 2022] DELETE /identity/v3/users/081b7bb6de404bc7bad0eb0d9afa458b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:29.427130 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:29.716778 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:30.131751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:30.134338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:30.216382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e8352-1c65-4289-bedc-5d561375c32c service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:30.368056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:30.368911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:30.381904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:30.381904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] PATH_INFO: `/v3/projects/3451789e2e184f3499e338dd838b963e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:30.381904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3451789e2e184f3499e338dd838b963e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:30.381904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:30.594579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3451789e2e184f3499e338dd838b963e', 'request_id': 'req-23c79361-e34e-4719-8d6a-e8a973bb3261'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:30.733125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3451789e2e184f3499e338dd838b963e', 'request_id': 'req-23c79361-e34e-4719-8d6a-e8a973bb3261'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:30.745838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3451789e2e184f3499e338dd838b963e', 'request_id': 'req-23c79361-e34e-4719-8d6a-e8a973bb3261'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:30.775524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] The token cache is being invalidate because project 3451789e2e184f3499e338dd838b963e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:30.776010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:30.778033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23c79361-e34e-4719-8d6a-e8a973bb3261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:30.784947 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2126/4234] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:30 2022] DELETE /identity/v3/projects/3451789e2e184f3499e338dd838b963e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:30.786197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:30.786986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:30.787431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:30.832487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:30.833771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:30.936015 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2109/4235] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:30.947218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:30.947218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:30.947218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:30.981152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:30.983313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:30.995722 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2127/4236] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:30.999962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.012043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c501a0-a958-4e62-870a-a6ec13539c0b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.021490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.022439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.023443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.024177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.024886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:31.025187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.027231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.035858 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:31.046280 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2110/4237] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:31.047026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.060262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f07-ce05-4ca9-bc46-5f97d2d50618 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.075181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.076003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.076342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.077641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.079010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.081903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.218908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2128/4238] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:31 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:31.222020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.248769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca2cce-0a98-43d3-a643-30d67ba8e6d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.347908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.348468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.352776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.354512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.355106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.357616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.535513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2111/4239] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:31 2022] POST /identity/v3/users => generated 286 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:31.539524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.552145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e356f-f4d7-43bf-b1ff-cdae1a7f7330 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.557837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.558653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.558999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.559343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.560756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.562662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.576871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2129/4240] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:31.578721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.601876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065e2e-a7e3-49b0-9eab-25c0a48cc62a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.608325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.609224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.609595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.609995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.610712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.614508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75a277-a3ff-4716-bc62-34401cfeeb8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.638105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2112/4241] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:31.638825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:31.675202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e75aa7-46ae-4cea-8146-66409e8e5438 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:31.681464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:31.682241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.682622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.683411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] PATH_INFO: `/v3/projects/521bab304a3c447e8ad28b137efa99a5/users/c92671d2db1e41eb904867efaf6bcddf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.746104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=521bab304a3c447e8ad28b137efa99a5, user_id=c92671d2db1e41eb904867efaf6bcddf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:31.746104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:31.883129 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2130/4242] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:31 2022] PUT /identity/v3/projects/521bab304a3c447e8ad28b137efa99a5/users/c92671d2db1e41eb904867efaf6bcddf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:31.900497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:31.900889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:31.901365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:31.949070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] MFA Rules not processed for user `c92671d2db1e41eb904867efaf6bcddf`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:31.950551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:32.078934 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2113/4243] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:32.083304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:32.093827 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:32.200770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7300-9190-46ef-ae36-290ef408ee2c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:32.205986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:32.208527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:32.208973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:32.209474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:32.210460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:32.213318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:32.351704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:32.384049 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2131/4244] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:32.395235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee420a46-3522-40db-959c-9cfcd14f4762 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:32.492504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:32.493480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:32.493773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:32.494144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:32.494963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:32.496997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:32.602954 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2114/4245] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:32 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:32.605286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:32.622514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebd895-848c-478a-83ea-2120b6c2d16a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:32.636066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:32.637109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:32.638611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:32.639127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:32.642748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:32.644700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:32.671162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2132/4246] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:33:32.676349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:32.693534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6ed2e-c4c4-40b4-9183-2659d1a48c23 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:32.711286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:32.712240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:32.712746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:32.713240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] PATH_INFO: `/v3/projects/9c51a16efe2847729dd831f5c5a7cffd/users/172f1f41115341f6a034facecf5c7c68/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:32.733072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c51a16efe2847729dd831f5c5a7cffd, user_id=172f1f41115341f6a034facecf5c7c68, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:32.736279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:32.858228 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2115/4247] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:32 2022] PUT /identity/v3/projects/9c51a16efe2847729dd831f5c5a7cffd/users/172f1f41115341f6a034facecf5c7c68/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:32.859007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:32.874211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339de4-5b13-4db2-96b8-49fbb3e5c01f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:32.979106 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:33.024004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:33.024788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.025078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.025364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.026052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:33.027703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3acff-3614-432f-88b5-44022199f21a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:33.041396 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2133/4248] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:33.043438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:33.106976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae258-40f6-48b1-96e7-99f2d366a635 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:33.128099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:33.130858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.133500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.134544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] PATH_INFO: `/v3/projects/9c51a16efe2847729dd831f5c5a7cffd/users/172f1f41115341f6a034facecf5c7c68/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.139924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c51a16efe2847729dd831f5c5a7cffd, user_id=172f1f41115341f6a034facecf5c7c68, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:33.173859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:33.204421 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2116/4249] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:33 2022] PUT /identity/v3/projects/9c51a16efe2847729dd831f5c5a7cffd/users/172f1f41115341f6a034facecf5c7c68/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:33.215287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.215495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.215778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.305188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] MFA Rules not processed for user `172f1f41115341f6a034facecf5c7c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:33.306500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:33.459461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2134/4250] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:33.464324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:33.512201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84427151-9436-4083-877f-df7a19c9f97c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:33.541010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172f1f41115341f6a034facecf5c7c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c51a16efe2847729dd831f5c5a7cffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:33.542000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.542503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.542994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.544290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:33.544858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:33.547074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:33.568311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2117/4251] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:33.570405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:33.598698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38bc6e-47bb-441a-8a79-74948a8636bd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:33.615304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172f1f41115341f6a034facecf5c7c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c51a16efe2847729dd831f5c5a7cffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:33.616070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.616914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.617230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.617906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:33.624674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:33.776041 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2135/4252] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:33 2022] POST /identity/v3/projects => generated 350 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:33.779179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:33.795161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb52da1-fa51-4628-956c-ef9cbf3d6391 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:33.925927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172f1f41115341f6a034facecf5c7c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c51a16efe2847729dd831f5c5a7cffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:33.926274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:33.926554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:33.926875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:33.928833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:33.929147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:33.933614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d62471-d276-4ffd-90f7-d4636ec9283a tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:33.962481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2118/4253] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:33.984840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:33.987265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:34.101970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffe608-4d20-43c6-9959-e50dd3aee260 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:34.107829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:34.108454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:34.108730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:34.108999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:34.122811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:34.125062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be820f11-f6bd-4952-8ca8-6e51c01ed024 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:34.139534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2136/4254] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:34.500689 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:34.957753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:34.958218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:34.960792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:35.086403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] MFA Rules not processed for user `6f7675c0fa214588b71c04ca120557fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:35.087669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:35.289869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2119/4255] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:35.300692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:35.301258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:35.301258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:35.335735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] MFA Rules not processed for user `6f7675c0fa214588b71c04ca120557fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:35.337597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:35.356069 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2137/4256] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:35.367475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:35.370624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:35.425311 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:35.517796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:35.520773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:35.532227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50fd8d-b524-488b-8de6-5510e6de77b5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:35.540249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56da25-1271-4fcc-8ee0-569b2947ef92 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:35.544182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:35.544974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:35.545633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:35.546020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:35.547495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:35.548115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:35.548396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:35.548802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:35.551350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:35.557802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:35.561433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:35.574929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:35.575266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2120/4257] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:35.576501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b393eeb-d371-49be-87ba-8d3ed0f7fa95 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:35.597962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2138/4258] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:33:37.044045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:37.045573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:37.316166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50cfed-c8c8-43ec-9a15-886b321aa405 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:37.367644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:37.371664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:37.372273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:37.372683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] PATH_INFO: `/v3/users/de2601cd7465432284416c218b427db5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:37.374116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2601cd7465432284416c218b427db5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:37.376742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:37.656480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2601cd7465432284416c218b427db5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:37.659471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2601cd7465432284416c218b427db5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:37.686770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2601cd7465432284416c218b427db5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:37.688014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2601cd7465432284416c218b427db5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:37.790454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2601cd7465432284416c218b427db5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:37.856227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2121/4259] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:37 2022] DELETE /identity/v3/users/de2601cd7465432284416c218b427db5 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:37.860606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841562-e977-48e6-92a6-4641fec4dc5c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:37.861066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841562-e977-48e6-92a6-4641fec4dc5c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:37.861429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4841562-e977-48e6-92a6-4641fec4dc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:37.908288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c4841562-e977-48e6-92a6-4641fec4dc5c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:37.909545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4841562-e977-48e6-92a6-4641fec4dc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:38.049473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2139/4260] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:38.065033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:38.067313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:38.230449 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:38.327361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6389b-4d4a-4709-83a4-91fcedad5ae8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:38.347563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:38.349020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:38.349723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:38.350807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:38.378427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:38.380699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:38.405709 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2122/4261] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:38.607147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:38.607428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:38.607696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:38.654429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:38.656360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:38.742211 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2140/4262] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:38.916700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:38.928926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:39.065393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba6067-e173-455f-9d19-9692eca97898 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:39.071579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:39.072277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:39.077666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:39.077666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:39.098620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:39.101035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:39.136991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2123/4263] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:33:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:33:39.822845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:39.824433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:39.847203 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:40.038241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491416a-1a5e-46c9-bf84-2b9f795829a5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:40.054524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '172f1f41115341f6a034facecf5c7c68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c51a16efe2847729dd831f5c5a7cffd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:40.057041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.058504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.059563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] PATH_INFO: `/v3/projects/260660731a594c7a930093c1c56886b2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.062999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorizing `identity:delete_project(project_id=260660731a594c7a930093c1c56886b2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:40.067217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:40.207320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:40.209402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:40.240146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e854e3-e3cc-4f92-939a-d9bb9e598cf7 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:40.249252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260660731a594c7a930093c1c56886b2', 'request_id': 'req-bdc31796-142b-4ab7-80d7-63f54ce32b47'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.322150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260660731a594c7a930093c1c56886b2', 'request_id': 'req-bdc31796-142b-4ab7-80d7-63f54ce32b47'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.333965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260660731a594c7a930093c1c56886b2', 'request_id': 'req-bdc31796-142b-4ab7-80d7-63f54ce32b47'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.360230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] The token cache is being invalidate because project 260660731a594c7a930093c1c56886b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:40.360898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.362109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.367208 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2141/4264] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:39 2022] DELETE /identity/v3/projects/260660731a594c7a930093c1c56886b2 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:40.370422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:40.371325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:40.371456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.371626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.372204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] PATH_INFO: `/v3/projects/6be552db3d5c4bb08a857af240021b26` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.373621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be552db3d5c4bb08a857af240021b26)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:40.375379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:40.376130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:40.409615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc31796-142b-4ab7-80d7-63f54ce32b47 tempest-QuotasNegativeTest-1856763145 tempest-QuotasNegativeTest-1856763145-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:40.434904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:40.437187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.437769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.438400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] PATH_INFO: `/v3/users/c92671d2db1e41eb904867efaf6bcddf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.440248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92671d2db1e41eb904867efaf6bcddf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:40.442889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:40.573790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be552db3d5c4bb08a857af240021b26', 'request_id': 'req-8bbf1d59-7b22-467c-8904-4810074c2866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.591174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be552db3d5c4bb08a857af240021b26', 'request_id': 'req-8bbf1d59-7b22-467c-8904-4810074c2866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.710686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be552db3d5c4bb08a857af240021b26', 'request_id': 'req-8bbf1d59-7b22-467c-8904-4810074c2866'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.714945 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:40.736499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] The token cache is being invalidate because project 6be552db3d5c4bb08a857af240021b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:40.736499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.737003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92671d2db1e41eb904867efaf6bcddf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.739997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bbf1d59-7b22-467c-8904-4810074c2866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.750560 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2124/4265] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:40 2022] DELETE /identity/v3/projects/6be552db3d5c4bb08a857af240021b26 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:40.754335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac96a4-7e18-491f-abeb-c04f3a1458c3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.754636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac96a4-7e18-491f-abeb-c04f3a1458c3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.754965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac96a4-7e18-491f-abeb-c04f3a1458c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.798430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b8ac96a4-7e18-491f-abeb-c04f3a1458c3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:40.807416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8ac96a4-7e18-491f-abeb-c04f3a1458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:40.825445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92671d2db1e41eb904867efaf6bcddf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.826869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92671d2db1e41eb904867efaf6bcddf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.860622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92671d2db1e41eb904867efaf6bcddf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.874028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-537073f9-affb-4e69-863e-08ae2607dcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92671d2db1e41eb904867efaf6bcddf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:40.883609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2142/4266] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:40 2022] DELETE /identity/v3/users/c92671d2db1e41eb904867efaf6bcddf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:40.894281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.894947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.896157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.975991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2125/4267] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:40.985976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:40.986762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:40.987012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:40.992078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:40.994367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:41.007925 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:41.026410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:41.027655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:41.175050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2126/4268] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:41.180616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.189650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2143/4269] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:41.212063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6730d-ed4a-466a-b352-ec72d5a1c11f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.216142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.217582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:41.229015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.229665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.229945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.230223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.234133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:41.234500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.236171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:41.284456 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2127/4270] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:41.286550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.320384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9013a-2484-423f-8f5c-60c339bcbc6b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.335518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.342608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.349607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.349607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.349607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.349607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:41.354480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60ff9-c9ac-4284-b5d3-2bbc175fc5d8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.361901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.363610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.363894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.364160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.390114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.391580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:41.418752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2144/4271] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:33:41.528367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2128/4272] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:41 2022] POST /identity/v3/projects => generated 391 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:41.533594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.545797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0069c17-dbd6-4028-8504-81752bd6fba1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.756906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.757581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.761592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.762915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.770075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.775417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:41.884841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2145/4273] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:41 2022] POST /identity/v3/users => generated 296 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:41.888580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.909222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdbe24-65c5-43a0-8cfd-b695cfdcd8d5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.916492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.917378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.919062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.919062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.919062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.920668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:41.952332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:41.957778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2129/4274] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:41.967587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690996ad-e9ca-4145-8600-a44efd19d1b5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:41.981407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:41.982287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:41.982722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:41.983199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:41.984002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:41.985827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a23a2-8a6f-4359-857f-87e3e98d8e65 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:42.017084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:42.018043 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2146/4275] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:33:42.034282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a74f70-5cf0-4def-887b-ab790849ab81 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:42.049593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:42.050354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:42.050729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:42.051113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] PATH_INFO: `/v3/projects/525a68e12ff74264b3989e5cc41d7d0b/users/a4c35b07ccda405bb23014bf014fa33a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:42.085049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525a68e12ff74264b3989e5cc41d7d0b, user_id=a4c35b07ccda405bb23014bf014fa33a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:42.088207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:42.226185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2130/4276] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:42 2022] PUT /identity/v3/projects/525a68e12ff74264b3989e5cc41d7d0b/users/a4c35b07ccda405bb23014bf014fa33a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:42.236757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:42.237433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:42.237764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:42.303704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] MFA Rules not processed for user `a4c35b07ccda405bb23014bf014fa33a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:42.305319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:42.360427 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:42.502215 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2147/4277] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:42.507135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:42.579158 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:42.649132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e6d3-e95a-42f5-aa45-9eb00adca932 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:42.661067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:42.662197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:42.663774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:42.665224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:42.668435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:42.673110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:42.830373 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2131/4278] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:42 2022] POST /identity/v3/projects => generated 391 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:42.830932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:42.847149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa699b-76e5-4678-b0cd-3f4e6381ade9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:43.016674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:43.018139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.021058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.021058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.021058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:43.022579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:43.139675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2148/4279] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:42 2022] POST /identity/v3/users => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:43.140963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:43.161983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942478e-2c3f-45fd-8c21-a6c7021a52c4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:43.173116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:43.173878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.176144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.176506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.177763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:43.180015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:43.208829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:43.215166 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2132/4280] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:43.231416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f72d77-2945-453f-8bbf-851dd118b500 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:43.260550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:43.263409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.263695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.263972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] PATH_INFO: `/v3/projects/b192651a74ef4875a3e3febf87ed5e13/users/55c5f22715c645cd9183eefbe3f1ee26/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.313103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b192651a74ef4875a3e3febf87ed5e13, user_id=55c5f22715c645cd9183eefbe3f1ee26, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:43.320365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:43.435124 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2149/4281] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:43 2022] PUT /identity/v3/projects/b192651a74ef4875a3e3febf87ed5e13/users/55c5f22715c645cd9183eefbe3f1ee26/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:43.440171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:43.475938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb7e7-71b2-42d5-a480-fdf25abedb04 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:43.687363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:43.688096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.688718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.689092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.690053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:43.705681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24e67c-25dc-4c08-9216-5f26d309b895 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:43.742251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:43.753737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2133/4282] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:43.757112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266cf1-2549-453f-a481-9dad893d534e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:43.769010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:43.769748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.770029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.770301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] PATH_INFO: `/v3/projects/b192651a74ef4875a3e3febf87ed5e13/users/55c5f22715c645cd9183eefbe3f1ee26/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.775901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b192651a74ef4875a3e3febf87ed5e13, user_id=55c5f22715c645cd9183eefbe3f1ee26, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:43.782156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:43.842472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:43.842742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:43.843023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:43.846882 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2150/4283] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:43 2022] PUT /identity/v3/projects/b192651a74ef4875a3e3febf87ed5e13/users/55c5f22715c645cd9183eefbe3f1ee26/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:43.932148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] MFA Rules not processed for user `55c5f22715c645cd9183eefbe3f1ee26`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:43.934686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:44.040156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:44.042622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:44.171715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6e93-3083-4d6f-8fbd-1df1479add84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:44.179279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:44.179279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:44.179279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:44.179279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] PATH_INFO: `/v3/projects/521bab304a3c447e8ad28b137efa99a5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:44.181787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521bab304a3c447e8ad28b137efa99a5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:44.183378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:44.206708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2134/4284] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:44.211555 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:44.212006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:44.237048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482c353-8ff2-4ab9-ab4f-7daba8b6d38f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:44.242905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:44.247423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:44.247719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:44.247977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:44.248675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:44.250753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:44.373268 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2135/4285] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:33:44 2022] POST /identity/v3/domains => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:44.379135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:44.407361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521bab304a3c447e8ad28b137efa99a5', 'request_id': 'req-e4a3b00e-bbd4-46fa-875c-75765af286c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:44.415057 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:44.502148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42428d9c-b7d8-4753-b890-8d50b70e0bf8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:44.508314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:44.509214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:44.510006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:44.518330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:44.518330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:44.519408 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:44.519408 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:44.519408 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:44.521130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:44.589248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521bab304a3c447e8ad28b137efa99a5', 'request_id': 'req-e4a3b00e-bbd4-46fa-875c-75765af286c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:44.598054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521bab304a3c447e8ad28b137efa99a5', 'request_id': 'req-e4a3b00e-bbd4-46fa-875c-75765af286c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:44.636813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] The token cache is being invalidate because project 521bab304a3c447e8ad28b137efa99a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:44.637051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:44.658549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:44.660690 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2151/4286] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:44 2022] DELETE /identity/v3/projects/521bab304a3c447e8ad28b137efa99a5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:44.666077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:44.669738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:44.852029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3b00e-bbd4-46fa-875c-75765af286c8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:44.925079 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2136/4287] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:33:44 2022] PUT /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config => generated 138 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:44.929274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:44.934302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:44.994351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdad7c-b429-4cc4-9cfa-0728ac5930be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.016057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.017143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.017143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.017389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.024456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539, group=identity)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.025762 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:45.025762 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:45.025762 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:45.026695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.050474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2137/4288] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:33:44 2022] GET /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/identity => generated 45 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:45.057952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.079505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1573e-7145-498d-b256-2acb4c67c1e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.082620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.085300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.086321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.086988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] PATH_INFO: `/v3/users/172f1f41115341f6a034facecf5c7c68` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.088555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.089461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.097775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.097775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/identity/driver` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.097996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=172f1f41115341f6a034facecf5c7c68)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.098085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539, group=identity, option=driver)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.098168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.098255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.101551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2138/4289] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:33:45 2022] GET /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/identity/driver => generated 31 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:45.105805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.122910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab9d9-1660-4123-ae9a-069d267f2803 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.129158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.129950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.130249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.130531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.132451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539, group=ldap)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.134217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.140927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2139/4290] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:33:45 2022] GET /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap => generated 106 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:45.149714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.161161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579687-2f8a-4692-a41f-f36205bd90be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.178448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.178448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.178448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.178789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap/url` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.178789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539, group=ldap, option=url)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.180790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.190275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2140/4291] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:33:45 2022] GET /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap/url => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:45.194804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.208845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae104f-7369-4d01-99a9-dd4031e0912e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.215597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.216434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.216793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.217580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap/user_tree_dn` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.244855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539, group=ldap, option=user_tree_dn)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.246281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.252391 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2141/4292] 10.222.0.13 () {58 vars in 1302 bytes} [Sun Oct 30 01:33:45 2022] GET /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config/ldap/user_tree_dn => generated 63 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:45.257794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.271591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bde307-e975-49d4-8b78-e07cf2e9cfdf tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.278028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.278893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.279255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.279621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.280342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=02748a5f2e9b4f909a08a0adcd244539)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.281612 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:45.281612 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:45.281612 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:45.282624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.347008 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2142/4293] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:45 2022] DELETE /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539/config => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:45.348076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.352530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172f1f41115341f6a034facecf5c7c68'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.369092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea335-31d7-497e-9af5-2c3585cb87c3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.387007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.387931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.388213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.388486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.393144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=02748a5f2e9b4f909a08a0adcd244539)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.396935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.420456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172f1f41115341f6a034facecf5c7c68'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.420968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172f1f41115341f6a034facecf5c7c68'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.445809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172f1f41115341f6a034facecf5c7c68'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.463631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.465135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.470779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172f1f41115341f6a034facecf5c7c68'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.487904 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2152/4294] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:44 2022] DELETE /identity/v3/users/172f1f41115341f6a034facecf5c7c68 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:45.574337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.575736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.588254 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2143/4295] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:45 2022] PATCH /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539 => generated 276 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:45.589038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:45.590599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:45.748870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246fc03-6e93-4e15-827f-2559a28cbc6b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:45.758093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:45.758753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:45.759030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:45.759725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:45.776049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=02748a5f2e9b4f909a08a0adcd244539)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:45.784552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:45.819936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:45.838201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.001180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.097723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.107306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.134473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] The token cache is being invalidate because project 02748a5f2e9b4f909a08a0adcd244539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:46.135077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.139625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.182102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.194912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.194912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '02748a5f2e9b4f909a08a0adcd244539', 'request_id': 'req-76d4dc03-a909-4652-a2c1-e20c375b152f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:46.217849 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2153/4296] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:45 2022] DELETE /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:46.222951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:46.229491 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:46.229778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:46.371193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeea82d-9b0f-4928-9d59-dc90fc5d665f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:46.586094 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:46.611256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:46.612714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:46.687292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:46.719329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:46.725650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:46.725650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:46.725650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:46.735869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:46.799294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4dc03-a909-4652-a2c1-e20c375b152f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:46.815302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:46.816243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:46.816628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:46.817005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] PATH_INFO: `/v3/projects/9c51a16efe2847729dd831f5c5a7cffd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:46.820434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c51a16efe2847729dd831f5c5a7cffd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:46.822549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:46.843136 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2144/4297] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:33:46 2022] POST /identity/v3/domains => generated 274 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:46.847430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:46.850466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.030859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05383c5-8d70-4937-8166-cfd88dd72b9d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.051478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c51a16efe2847729dd831f5c5a7cffd', 'request_id': 'req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:47.133159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c51a16efe2847729dd831f5c5a7cffd', 'request_id': 'req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:47.148878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c51a16efe2847729dd831f5c5a7cffd', 'request_id': 'req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:47.157310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.158099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.158748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.159265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.159939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.171321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.204518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] The token cache is being invalidate because project 9c51a16efe2847729dd831f5c5a7cffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:47.207037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:47.211193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0a9c6e39-2962-4bc4-9411-8b3f991a47f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:47.213712 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2154/4298] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:46 2022] DELETE /identity/v3/projects/9c51a16efe2847729dd831f5c5a7cffd => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:47.218453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad2f0-6803-4f5a-bcea-60498182ae3f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.218934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad2f0-6803-4f5a-bcea-60498182ae3f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.219411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad2f0-6803-4f5a-bcea-60498182ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.268612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3b4ad2f0-6803-4f5a-bcea-60498182ae3f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:47.269911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3b4ad2f0-6803-4f5a-bcea-60498182ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.350157 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2145/4299] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:33:46 2022] PUT /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 138 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:47.351731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.353912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.372285 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2155/4300] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:47.381754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.383244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.385978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.425905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0fb08-2dee-4ccf-9629-ae411524426d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.443248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.443871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.444150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.444429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.445122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.459451 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:47.459451 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:47.459451 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:47.460973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.468934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:47.475232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.510601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2156/4301] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:47.515648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.519865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.705205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd1a6f-bbac-4a84-ba36-9474d66638c3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.715887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.716646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.716931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.717202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.721224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:47.732935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2146/4302] 10.222.0.13 () {60 vars in 1271 bytes} [Sun Oct 30 01:33:47 2022] PATCH /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 141 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:47.732935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.756578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.759994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.767369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44665d4d-a9f8-4935-8266-419f7528da46 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.783971 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2157/4303] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:47.784848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.799133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.799772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.800058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.800328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.806555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:47.811350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.815271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cfc39-907a-457a-9148-ce6a04411e89 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.824397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.830609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.830609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.830609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:47.830948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.844290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2158/4304] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:47 2022] GET /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 141 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:47.845698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.859526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a76399-8223-4e74-af1f-a797b15cb9b8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.864636 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2147/4305] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:47.865850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:47.871290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.872935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.873915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.874255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.883904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.886633 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:47.886633 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:47.886633 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:47.889305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc079fd-4216-49b6-af9b-d635928324bb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:47.889598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:47.904603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:47.905294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:47.905666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:47.906846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:47.906846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:47.911212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.001407 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2159/4306] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:47 2022] DELETE /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:48.006642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.018533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf4cd4-0516-4e2b-8afb-555f91b1c478 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.025533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.026448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.026939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.027456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.028951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.030905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.041395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2148/4307] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:47 2022] POST /identity/v3/projects => generated 397 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find any options in domain configuration for domain 26dda262251f42f39b4e5ac023ddb3f7.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 26dda262251f42f39b4e5ac023ddb3f7. Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:48.042883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 26dda262251f42f39b4e5ac023ddb3f7. Oct 30 01:33:48.043794 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:48.044583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.051137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2160/4308] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:48 2022] GET /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 151 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:33:48.057760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.197606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5777f50-e4d4-42b3-bb13-7be7220a557f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.205213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.205914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.206245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.207180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.207945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.210576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.277705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400b83-dff6-4298-9c7c-a547ab387137 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.322576 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2149/4309] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:48 2022] POST /identity/v3/users => generated 299 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:48.332029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.364703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298ad78-8404-498e-a79a-1101188505e8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.390371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.392497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.392952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.393236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.395720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.399621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.407999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.408664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.408946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.409220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.409838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.411504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.429119 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2161/4310] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:48 2022] DELETE /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7/config => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:48.433177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.439595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2150/4311] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:48.440872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.452369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7a895-4d7a-4bc9-90c9-2d42daddee8e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.464214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.464828 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:48.465367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.465804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.466076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.468510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a7bbb-4907-4cc2-88e8-4b525cb874a6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.469012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.470938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.486157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.488668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.488668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.488668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.488668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.497360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.520718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.521460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.530492 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2151/4312] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:48.538621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.557655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:48.593773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82db0-0f4f-428d-949b-165d3e22d8a1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.650794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.651547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.664830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2162/4313] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:48 2022] PATCH /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:48.666266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:48.667721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:48.800262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20488b-9f9a-4352-8fc3-143f8d301200 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:48.811961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.814874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.814874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.814874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] PATH_INFO: `/v3/projects/36ab4b8e0767439e87ac2f2838e4353d/users/8c6df6929b09426585b9bd64b804d8a7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.818553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:48.819227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.819513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.819784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:48.852078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ab4b8e0767439e87ac2f2838e4353d, user_id=8c6df6929b09426585b9bd64b804d8a7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.853176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=26dda262251f42f39b4e5ac023ddb3f7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:48.854820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.858986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9831b3e-4ba5-48ee-8ca9-c43112da6167 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:48.918665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.944581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:48.964628 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2152/4314] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:48 2022] PUT /identity/v3/projects/36ab4b8e0767439e87ac2f2838e4353d/users/8c6df6929b09426585b9bd64b804d8a7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:48.966310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:48.966669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:48.967010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.007478 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:49.018547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] MFA Rules not processed for user `8c6df6929b09426585b9bd64b804d8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:49.018547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:49.122605 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2153/4315] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:49.126891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.129643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:49.135036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.196945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.210315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.242032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736dc1a-0952-4c0e-9487-f2d21355a5e9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.247005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] The token cache is being invalidate because project 26dda262251f42f39b4e5ac023ddb3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:49.247252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.251170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.261250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.263128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.263128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '26dda262251f42f39b4e5ac023ddb3f7', 'request_id': 'req-c0ba7b8e-a15e-4cef-a58a-260cb006414b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:49.278924 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2163/4316] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:48 2022] DELETE /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:49.285443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.287073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:49.375396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:49.376018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:49.380963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:49.383904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.383904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:49.388325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:49.411675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba7b8e-a15e-4cef-a58a-260cb006414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.417361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:49.417361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:49.417608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:49.418106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.419672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:49.421958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:49.501857 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2154/4317] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:49 2022] POST /identity/v3/projects => generated 399 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:49.507350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.509139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2164/4318] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:33:49 2022] POST /identity/v3/domains => generated 276 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:49.509614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:49.513803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.619265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c59f0-5ea5-4d2c-bde0-d032aafae252 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.752903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e3d5c-6543-4eb0-9e1c-70333e7912c1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.767652 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:49.770044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:49.771438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:49.772473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:49.772943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.775828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:49.775828 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:49.775828 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:49.775828 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:49.780089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:49.809368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:49.811510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:49.811816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:49.812091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.812735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:49.818735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:49.939239 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2165/4319] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:33:49 2022] PUT /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config => generated 138 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:49.944031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.962161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d3337-1183-4d94-98ec-5605872469dc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.963627 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2155/4320] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:49 2022] POST /identity/v3/users => generated 306 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:49.967888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:49.973872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:49.975624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:49.979166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:49.979732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:49.980948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:49.985741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd137-392f-45af-9f21-adf3f3ccf3d5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:49.986735 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:49.986735 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:49.986735 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:49.991578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:49.996788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.001577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.001867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.002143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.002809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.004426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.027564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2156/4321] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:33:50.041165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.068596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bcf0d-e94e-44a2-974b-b1a0d38725c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.078010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.078959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.079421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.079845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] PATH_INFO: `/v3/projects/9a0bae30895747149372f01a8070095c/users/48cff5af998042df820262c6d8b7c232/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.109296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0bae30895747149372f01a8070095c, user_id=48cff5af998042df820262c6d8b7c232, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.113538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.126920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2166/4322] 10.222.0.13 () {60 vars in 1297 bytes} [Sun Oct 30 01:33:49 2022] PATCH /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity => generated 177 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:33:50.131671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.164178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8279-e067-4afd-94f2-a6a51e9840bb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.183626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.184728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.185217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.185660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.186611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity, option=driver)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.191212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.227824 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2157/4323] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:50 2022] PUT /identity/v3/projects/9a0bae30895747149372f01a8070095c/users/48cff5af998042df820262c6d8b7c232/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:50.231174 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=6,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:50.233006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.352411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2167/4324] 10.222.0.13 () {60 vars in 1318 bytes} [Sun Oct 30 01:33:50 2022] PATCH /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver => generated 176 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:33:50.356591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.381479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35634d-c88a-4a50-aac7-ddad5fce7d3a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.445391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ff5f3-c94e-4699-ac66-609ad28333c4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.461976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.462611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.463189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.463189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.463883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.469076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.494171 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2158/4325] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:50.501961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.508272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:50.553513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.554458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.557921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.559606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.560540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity, option=driver)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.564764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.641932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c82b-b6e7-4dff-8fc9-600a3d1d18b7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.647373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.648121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.648495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.649365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.651588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:50.683184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2168/4326] 10.222.0.13 () {58 vars in 1299 bytes} [Sun Oct 30 01:33:50 2022] DELETE /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:50.684282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.713776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9f37-25e4-40f1-9bac-0b7a5cc516f4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:50.727980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:50.728662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.729876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.729876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] PATH_INFO: `/v3/projects/9a0bae30895747149372f01a8070095c/users/48cff5af998042df820262c6d8b7c232/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.737179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0bae30895747149372f01a8070095c, user_id=48cff5af998042df820262c6d8b7c232, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.753160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.784908 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2169/4327] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:50 2022] PUT /identity/v3/projects/9a0bae30895747149372f01a8070095c/users/48cff5af998042df820262c6d8b7c232/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:50.786938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:50.824691 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:50.870418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:50.872313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b713546-040f-4f43-be27-ba14fbaff52e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:50.910342 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2159/4328] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:50.911787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:50.912069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:50.912341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:50.966890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] MFA Rules not processed for user `48cff5af998042df820262c6d8b7c232`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:50.968149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:51.010855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ae9f-686d-4799-a154-fcd5a9b05dee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.028372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.029371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.029895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.030384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.032771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity, option=driver)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.035622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find option driver in group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:51.055264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:51.056211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:51.064411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2170/4329] 10.222.0.13 () {58 vars in 1296 bytes} [Sun Oct 30 01:33:50 2022] GET /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity/driver => generated 171 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:33:51.069062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.094057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b3e-3183-4fd3-a01e-6997acf685b9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.110067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.111337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.111994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.112384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.113094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.115765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.184446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2160/4330] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:51.210129 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2171/4331] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:33:51 2022] DELETE /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:51.215642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.215775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.215775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:51.257239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60e097-0f33-4a61-b23f-811bcecb2344 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.280894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.281592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.284430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.284430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.295364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff, group=identity)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.300130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.317423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5558c-4861-46bb-8444-0719bad1ba85 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.326915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.330319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.330319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.330319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.344754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:51.351877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:51.352963 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:33:51.359678 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2161/4332] 10.222.0.13 () {58 vars in 1275 bytes} [Sun Oct 30 01:33:51 2022] GET /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config/identity => generated 154 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:33:51.362633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.377513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcd862-4751-4b5d-876a-c232241297e8 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.392521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.394340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.397842 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:51.398752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.400323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.401097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0e8bfab9b7c74f259834df77c73f4bff)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.404464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.521444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2162/4333] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:51 2022] DELETE /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff/config => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:51.525930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.527819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.529299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.542012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541ddc-2a5e-4e25-8a2c-28d70fa3624d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:51.555719 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2172/4334] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:51.556314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:51.557215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:51.559772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:51.563676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:51.563676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e8bfab9b7c74f259834df77c73f4bff)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:51.568007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:51.630569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:51.631354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:51.834035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:51.835643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:51.891545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2163/4335] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:51 2022] PATCH /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff => generated 277 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:51.896691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:51.919655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc03e9-725a-4233-936c-f6ecd0ac0d8e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.113720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.114514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.116433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.117234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.143524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e8bfab9b7c74f259834df77c73f4bff)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.146279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.201496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.250345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.408609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.416576 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:52.471160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.490878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.499787 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:52.506916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] The token cache is being invalidate because project 0e8bfab9b7c74f259834df77c73f4bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:52.507576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.508469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.524819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.526169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.527103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e8bfab9b7c74f259834df77c73f4bff', 'request_id': 'req-01ac3598-484c-4206-a500-f9e9dabe5288'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:52.545250 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2173/4336] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:51 2022] DELETE /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:52.552102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.553848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:52.580857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae2f5-c233-490c-810c-63fe85db3bc9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.753105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.754019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.754453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.754876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.755925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.757559 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:52.757559 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:33:52.757559 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:33:52.759751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.771563 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2164/4337] 10.222.0.13 () {58 vars in 1173 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:52.779033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.779033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:52.803920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac3598-484c-4206-a500-f9e9dabe5288 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.814209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.815135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.815573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.815991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.817464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.818885 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:33:52.818885 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:33:52.818885 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:33:52.820901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.823384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2174/4338] 10.222.0.13 () {58 vars in 1200 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:52.827115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.842844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130e5c7-39ef-491d-b58a-08a7a1c78c79 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.856224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.857008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.857421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.859263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.863945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.866229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.874630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.875614 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2165/4339] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:52.893592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646daa45-e7f5-4de6-892b-560034e2aadc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.906704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.907749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.908153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.908534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.909239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.913655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.917715 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2175/4340] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:52.921891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.942647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981c7c-c6e2-48c6-adab-f2ef13595731 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.949366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:52.950050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:52.950332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:52.950756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:52.951529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:52.955225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:52.961141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2166/4341] 10.222.0.13 () {58 vars in 1188 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:52.965581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:52.983913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc40a-6d15-4c9f-888b-4ff68ce78a58 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:52.999077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.001114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.001114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.001114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.001896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.003612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.006062 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2176/4342] 10.222.0.13 () {58 vars in 1200 bytes} [Sun Oct 30 01:33:52 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.010937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.025486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b273-498d-44d8-a1ff-fde4b3fefece tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.039893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.040276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.040669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.041048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.041776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.043645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.046858 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2167/4343] 10.222.0.13 () {58 vars in 1203 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.050699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.068371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e679e-73f5-468f-b7a8-561cfd7a99e2 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.081305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.082103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.082506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.083006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.084575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.086133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.094391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2177/4344] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.096334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.108936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81410c3-559d-4f6b-a343-e1416ba7650d tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.118553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.119372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.119910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.120203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.120899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.122625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.124184 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2168/4345] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.128104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.132921 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:53.141806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd8ea8-de58-4c4f-be20-c3974b63c773 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.148332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.149156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.149573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.149952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.150645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.152350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.154201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2178/4346] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.157847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.171203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d068f1-fd66-46ab-bfc2-93337208a158 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.176910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.177712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.178121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.181489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.181489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.181489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.183088 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2169/4347] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:53.187136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.221454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ee1b3-3bb0-45bd-a1ee-2328bfe115b5 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.234579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.235630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.236152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.236868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.237757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.240464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.244705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2179/4348] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:53.247864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.270671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dbf07-4421-404e-8ae4-3fface1ad3ea tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.278369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.279528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.280032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.280525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.281490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.286196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.288152 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2170/4349] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.294786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.313240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f4a44-597b-4908-b7cf-ee653538b76e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.325589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.327276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.327849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.328365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.329282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.332007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.335473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2180/4350] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.339249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.340099 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:53.371201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d95e24-615e-4ad5-adfc-70a28bed46cb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.381711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.382531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.384104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.384500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.386616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.398762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.405130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.412744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2171/4351] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.443457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aaf40-3ad7-4a95-b16e-73f08e73414b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.485149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.487413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.487413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.487413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.488109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.490606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.506073 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2181/4352] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.506495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.527192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23109bf-a62c-4a5a-bd9a-f5d5c17e48bc tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.551977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.556456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.557641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.558847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.562323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.576640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.576640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2172/4353] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.576812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.595832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596eec5-83f4-44c8-b481-e4da210f2209 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.619105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.620928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.621204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.621509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.623913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.626936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.632978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2182/4354] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.637399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.653285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354e20b-d6f3-48e0-81f5-f69935129f44 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.667038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.669828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.671069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.671377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.674110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.675743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.682686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2173/4355] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.686879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.702372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a811-d526-43be-979a-8deebcc6eda0 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.708109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.709031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.709308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.709612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.710248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.712031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.743494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.751945 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2183/4356] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.759002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc0fc9-2fec-4a69-ab83-447c7cdca75e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.773907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.774794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.778839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.779316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.780116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.782266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.796583 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2174/4357] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.799049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.816343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf5b13-d68f-4419-8e17-5e9506eff88b tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.872340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.873991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.875340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.876226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.877814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.879491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.884146 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2184/4358] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.891656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.915644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb952a-7610-4e9f-a113-7e52dfb8eab9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.954083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.954083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.954083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.954918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.954918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.954918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:53.954918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2175/4359] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:53.955239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:53.986285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9533e-79dc-4205-9641-fe11fcdd9ff1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:53.993425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:53.993679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:53.994006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:53.994499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:53.995441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:53.998727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.008166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.028282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2185/4360] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:33:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.036171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e517-51ae-4b88-a045-1bc5ef54a920 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.185827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.185827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.185827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.186942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.186942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.186942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.186942 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2176/4361] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.189806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.206045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0424b7-41a8-4085-9a0a-0c8a26105b7e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.211393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.212085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.212372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.212675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.213296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.216060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.218415 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2186/4362] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.221381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.234238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8ef03-0a40-43d1-acd3-df9ef807cfb1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.239404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.240551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.240834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.241111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.241754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.244216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.245412 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2177/4363] 10.222.0.13 () {58 vars in 1290 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.249936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.263111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbf896-8b73-483a-9aa9-66e038f48343 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.267793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.268422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.268707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.269029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.269679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.271368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.272553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2187/4364] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.276476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.286891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ed925-5dad-4a20-898a-c1eae37234d4 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.291500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.292126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.292400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.292672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.293251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.294865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.295908 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2178/4365] 10.222.0.13 () {58 vars in 1266 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.299667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.310067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c34839-51a7-42b9-90d7-eec525f4e44f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.314654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.317169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.317169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.317169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.317169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.318522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.319638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2188/4366] 10.222.0.13 () {58 vars in 1308 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.323511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.333506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f7af4-55d6-4d2d-bb9b-7a405c64f524 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.338366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.338986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.339259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.339529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.340110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.341693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.342734 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2179/4367] 10.222.0.13 () {58 vars in 1290 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.349637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.370442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd05fd-eac9-473f-9c77-86a5fb061872 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.381099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.381099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.381099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.381669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.381669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.394296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.398332 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2189/4368] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:54.400762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.412217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a92dc-c99d-40ad-b9de-4b6c90ff0333 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.442118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.443346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.444181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.444470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.446196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.457962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.457962 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2180/4369] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.458992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.482323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34e7a7-4062-4362-9f08-4f24962eae68 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.485559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.487273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:54.521544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.522215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.534451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.536103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.536103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.539672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.549194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2190/4370] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.550495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.581293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95974ad-d46c-4899-8242-4d6a0682794f tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.610967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.620249 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:54.620960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.627242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.627242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.627242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.627242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.630335 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2191/4371] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.631108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.667440 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:54.674978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55be3c-acd1-42f8-b5ac-460a41470f69 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.678949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0c839-9a94-4719-b963-b9a3dbc55967 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.683479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.684667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.685107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.685632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.687720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:54.708255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.708841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.709124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.709421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.710019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.725171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.725171 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2192/4372] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.728723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.775591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d64e-de62-40ad-a037-dc57c8dbc8aa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.798263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.798939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.799223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.799500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.800097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.801914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.807707 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2193/4373] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.814625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.846016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac394969-afe7-4a0e-8738-c7186ae9c1f1 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.859262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.859815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.860099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.860375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.861040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.862666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.870086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.871578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2194/4374] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.872460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.872578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.892819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c2376-7f46-44af-8346-c9f543fcea38 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.909106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.909902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.910180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.910453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.916755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.917033 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2181/4375] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:54.919869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.924073 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2195/4376] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.925611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:54.955312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e09b-33eb-457e-83fb-0484a4ff046c service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:54.967537 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:54.972781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:54.975677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:54.977743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:54.978038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:54.978730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:54.986590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:54.991421 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2182/4377] 10.222.0.13 () {58 vars in 1257 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:54.992444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.007305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e048-f133-425c-b033-edefbe40d1fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.022085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.022968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.023561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.023912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.024596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.028902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.030445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2196/4378] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:33:54 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:33:55.039660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.054554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c5975-a390-4f28-b74e-5955b71a7856 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.063235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.063902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.065366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.069548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.070276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.071940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.073235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2183/4379] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.077069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.096970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9f5e2-efd7-45e0-a9b8-f0e58b43f4be tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.115379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.116065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.116353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.116607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.117208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.118938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.122509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2197/4380] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.124338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.145046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfbd5a-7f6f-4583-9cf0-a3f26924ac7a tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.160525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.161201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.162092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.162384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.163765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.167285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.176323 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2184/4381] 10.222.0.13 () {58 vars in 1212 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.177692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.204213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a60b74-55ea-48bc-842f-85a5b3d0cffe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.211210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.211417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.211672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.211943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.213456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.215522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.219915 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2198/4382] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.221549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.243604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e349da-0c4b-4274-90e6-26c7b9c26bdd tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.249848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.250550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.251187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.251428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.252140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.254018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.255771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2185/4383] 10.222.0.13 () {58 vars in 1215 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.259792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.278536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59db27-900f-4c72-9ee1-aa64df74d0fa tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.290981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.291957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.292420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.292979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.293781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.295568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.303527 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2199/4384] 10.222.0.13 () {58 vars in 1218 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.307446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.329255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7ac7c-6ac3-4700-a907-adacab5d3961 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.342276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.343281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.343750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.344207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.345051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.351410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.353236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2186/4385] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.357115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.373858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4bf5-ca66-4ac8-9548-ea357fd56631 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.379598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.381177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.381736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.382346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.383197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.385038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.386993 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2200/4386] 10.222.0.13 () {58 vars in 1239 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.391120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.407006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d0e94-a3f3-48d8-89dd-9adb55150efb tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.411099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.411962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.412152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.412465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.413120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.414908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.419457 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2187/4387] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.420834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.455395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08ebf5-92b0-4a5f-a073-0e9824ddd11e tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.478293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.478905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.479188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.479465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.486091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.495509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.501399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.502113 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2201/4388] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.519397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cb02f-f2e9-4ade-b0c2-a6ab673ea5fe tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.534100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.535569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.536112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.536112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.538937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.541655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.549663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.549912 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2188/4389] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.566147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207560f6-c5da-45df-88e3-2f82c95050ac tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.582205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.582815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.583120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.583941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.584519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.586212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.587873 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2202/4390] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.593072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.638251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25009b7-72c1-4450-9597-ffdc7c091dd3 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.655336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.656017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.656303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.656582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.657184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:55.672778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:55.681170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2189/4391] 10.222.0.13 () {58 vars in 1278 bytes} [Sun Oct 30 01:33:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 30 01:33:55.687235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.706448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18b6f6-887e-44f6-94c3-8ce315746c05 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.725001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.726044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.735314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.735314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/0e8bfab9b7c74f259834df77c73f4bff` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.746169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find domain: 0e8bfab9b7c74f259834df77c73f4bff.: keystone.exception.DomainNotFound: Could not find domain: 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:55.759963 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:55.772044 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:33:55.773366 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0e8bfab9b7c74f259834df77c73f4bff. Oct 30 01:33:55.775264 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.775264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2203/4392] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:55 2022] PATCH /identity/v3/domains/0e8bfab9b7c74f259834df77c73f4bff => generated 112 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:33:55.775530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.782933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606a17-d8c0-4510-b902-9b6b96e1e838 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.791069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.792480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.792773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.793053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/26dda262251f42f39b4e5ac023ddb3f7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.808621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find domain: 26dda262251f42f39b4e5ac023ddb3f7.: keystone.exception.DomainNotFound: Could not find domain: 26dda262251f42f39b4e5ac023ddb3f7. Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 26dda262251f42f39b4e5ac023ddb3f7. Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:55.817199 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:55.818190 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:33:55.819090 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 26dda262251f42f39b4e5ac023ddb3f7. Oct 30 01:33:55.823244 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:33:55.823244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2190/4393] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:55 2022] PATCH /identity/v3/domains/26dda262251f42f39b4e5ac023ddb3f7 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:33:55.828153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.842981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08d774-b3d8-4272-8c7d-1fe9f4a79151 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:55.851091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55c5f22715c645cd9183eefbe3f1ee26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b192651a74ef4875a3e3febf87ed5e13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:55.851783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:55.852810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:55.853100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] PATH_INFO: `/v3/domains/02748a5f2e9b4f909a08a0adcd244539` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:55.866624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Could not find domain: 02748a5f2e9b4f909a08a0adcd244539.: keystone.exception.DomainNotFound: Could not find domain: 02748a5f2e9b4f909a08a0adcd244539. Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 02748a5f2e9b4f909a08a0adcd244539. Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:33:55.881116 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:33:55.886014 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:33:55.886934 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 02748a5f2e9b4f909a08a0adcd244539. Oct 30 01:33:55.887909 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:33:55.887909 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2204/4394] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:33:55 2022] PATCH /identity/v3/domains/02748a5f2e9b4f909a08a0adcd244539 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:33:55.888043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:55.888043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:55.996972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0890f42-e78f-4592-93e2-86401d9bd2f7 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:56.004119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:56.004774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:56.005602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:56.005918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] PATH_INFO: `/v3/users/a4c35b07ccda405bb23014bf014fa33a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:56.010836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c35b07ccda405bb23014bf014fa33a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:56.013644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:56.276310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c35b07ccda405bb23014bf014fa33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.277559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c35b07ccda405bb23014bf014fa33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.293542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c35b07ccda405bb23014bf014fa33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.299980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c35b07ccda405bb23014bf014fa33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.308252 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:56.341743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:56.343869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:56.374276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73e22-db7b-4f34-b5c6-3c0de60da3f9 tempest-DomainConfigurationTestJSON-1453746049 tempest-DomainConfigurationTestJSON-1453746049-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:56.394855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49d3-8a7d-43d1-89ed-a03dacf664c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c35b07ccda405bb23014bf014fa33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.397445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:56.398108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:56.398384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:56.398662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] PATH_INFO: `/v3/users/88ac5422c8f048148aac2c9b62e0482e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:56.402066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ac5422c8f048148aac2c9b62e0482e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:56.410079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:56.440322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2191/4395] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:55 2022] DELETE /identity/v3/users/a4c35b07ccda405bb23014bf014fa33a => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:56.445243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:56.445583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:56.448355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:56.492824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:56.494216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:56.638193 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2192/4396] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:56.683256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:56.686754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:56.708608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ac5422c8f048148aac2c9b62e0482e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.845633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ac5422c8f048148aac2c9b62e0482e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.847671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ac5422c8f048148aac2c9b62e0482e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.874943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ac5422c8f048148aac2c9b62e0482e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.894102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ac5422c8f048148aac2c9b62e0482e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:56.899814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc0d3-99fa-439b-9e9d-d439fa848e44 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:56.910098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:56.913047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:56.913492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:56.913839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:56.915634 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2205/4397] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:56 2022] DELETE /identity/v3/users/88ac5422c8f048148aac2c9b62e0482e => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:33:56.921242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:56.936015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:56.937781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd437-7121-4fe4-bb36-afd918d5f6eb service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:56.968111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2193/4398] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:57.394020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:57.396908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:57.561836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3d3c-2127-499c-8a0b-17af49ebc1e1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:57.566903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:57.568192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:57.568872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:57.569735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] PATH_INFO: `/v3/projects/09d179276dbf4e4d9cb780b18e7a22c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:57.571368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d179276dbf4e4d9cb780b18e7a22c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:57.573918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:57.609519 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:57.782894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d179276dbf4e4d9cb780b18e7a22c7', 'request_id': 'req-86086cc2-cf72-426f-9ef2-e00eb6b17a85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:57.886883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d179276dbf4e4d9cb780b18e7a22c7', 'request_id': 'req-86086cc2-cf72-426f-9ef2-e00eb6b17a85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:57.910378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d179276dbf4e4d9cb780b18e7a22c7', 'request_id': 'req-86086cc2-cf72-426f-9ef2-e00eb6b17a85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:57.925065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] The token cache is being invalidate because project 09d179276dbf4e4d9cb780b18e7a22c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:57.925472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:57.927714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86086cc2-cf72-426f-9ef2-e00eb6b17a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:57.939783 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2206/4399] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:57 2022] DELETE /identity/v3/projects/09d179276dbf4e4d9cb780b18e7a22c7 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:57.939965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:57.939965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:57.939965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:57.984368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:57.985832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:58.127597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2194/4400] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:58.135373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.135715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.135932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.150816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.152658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:58.176592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd184-039e-49c3-a447-bde59dd5e0d8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.186853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.187708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.188089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.188460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] PATH_INFO: `/v3/projects/525a68e12ff74264b3989e5cc41d7d0b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.189834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525a68e12ff74264b3989e5cc41d7d0b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.190636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:58.192006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.196290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:58.218421 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:58.221215 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2207/4401] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:33:58.225721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.244515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d7b41-ad58-4ac9-bae0-b958b9febebc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.259290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.260190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.260624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.261180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.262288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:33:58.262766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.268358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.305077 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2208/4402] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:33:58.309148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.332601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58877-0948-4340-bb21-19fb973cc36a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.349575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.350352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.350738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.351114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.352025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.354204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.411296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525a68e12ff74264b3989e5cc41d7d0b', 'request_id': 'req-bf05676a-903c-455b-97f4-b0df9c4ebad1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:58.438188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525a68e12ff74264b3989e5cc41d7d0b', 'request_id': 'req-bf05676a-903c-455b-97f4-b0df9c4ebad1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:58.478902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2209/4403] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:33:58 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:33:58.483186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.515535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525a68e12ff74264b3989e5cc41d7d0b', 'request_id': 'req-bf05676a-903c-455b-97f4-b0df9c4ebad1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:58.539047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] The token cache is being invalidate because project 525a68e12ff74264b3989e5cc41d7d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:33:58.539570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:58.540420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:58.543106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2195/4404] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:33:58 2022] DELETE /identity/v3/projects/525a68e12ff74264b3989e5cc41d7d0b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:58.548579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.552551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:58.628697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c87c-fbc0-4473-8893-0fd65d90b3fa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.639518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.640486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.640984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.642688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.646241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.649101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.792752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2210/4405] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:33:58 2022] POST /identity/v3/users => generated 281 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:33:58.794689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05676a-903c-455b-97f4-b0df9c4ebad1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.796781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.798609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:58.810324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.811021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.815038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.815038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] PATH_INFO: `/v3/users/55c5f22715c645cd9183eefbe3f1ee26` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.815038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c5f22715c645cd9183eefbe3f1ee26)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.815610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.827047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d4a0f-cb47-45f6-87d4-b5cdc43393c3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.843603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.843603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.843603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.843603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.844087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.845078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.870099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2211/4406] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:58.874275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.899091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed98c6-f87f-4085-b8fa-55edb030a3a8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:58.923469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:58.924306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:58.924589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:58.924862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:58.925580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:58.927740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:58.962285 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2212/4407] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:33:58.966490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:58.985458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89094bae-e63b-46cf-b292-a4bde1941ae2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:59.003767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:59.004491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:59.005302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:59.005642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] PATH_INFO: `/v3/projects/b3e50d7861d244e7b10332e62f7ce3c5/users/a7901850432f4e54a9e8823425d1c037/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:59.056159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e50d7861d244e7b10332e62f7ce3c5, user_id=a7901850432f4e54a9e8823425d1c037, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:59.061989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744c8b-a5dd-4d2f-8e76-3d3b2a88f074 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:59.065117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c5f22715c645cd9183eefbe3f1ee26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:59.066164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c5f22715c645cd9183eefbe3f1ee26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:59.077350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c5f22715c645cd9183eefbe3f1ee26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:59.080545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c5f22715c645cd9183eefbe3f1ee26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:59.163491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c5f22715c645cd9183eefbe3f1ee26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:33:59.186598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2213/4408] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:33:58 2022] PUT /identity/v3/projects/b3e50d7861d244e7b10332e62f7ce3c5/users/a7901850432f4e54a9e8823425d1c037/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:59.202064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:59.202640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:59.203959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:59.251216 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2196/4409] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:58 2022] DELETE /identity/v3/users/55c5f22715c645cd9183eefbe3f1ee26 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:33:59.258125 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:59.299900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] MFA Rules not processed for user `a7901850432f4e54a9e8823425d1c037`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:33:59.302728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:59.409678 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2214/4410] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:33:59.424196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:59.425823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:59.532353 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:33:59.595794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee98b32-7e58-40a4-a3b4-211d85262cda admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:59.605715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:59.606353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:59.606636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:59.606911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:59.616609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:59.618288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:33:59.636574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2197/4411] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:33:59.760187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:33:59.762359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:33:59.947767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a061c-ea6f-4f94-abd4-97f02bed54f8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:33:59.955291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:33:59.956862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:33:59.958090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:33:59.958553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] PATH_INFO: `/v3/users/a7901850432f4e54a9e8823425d1c037` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:33:59.959919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7901850432f4e54a9e8823425d1c037)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:33:59.963774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:00.152023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:00.153514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:00.183814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd398a3-10e6-499a-8ceb-9c2b9d9a83c3 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:00.190740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:00.192776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.193365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.194553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] PATH_INFO: `/v3/projects/b192651a74ef4875a3e3febf87ed5e13` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.197123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b192651a74ef4875a3e3febf87ed5e13)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:00.219135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:00.263579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7901850432f4e54a9e8823425d1c037'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.355447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7901850432f4e54a9e8823425d1c037'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.356405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7901850432f4e54a9e8823425d1c037'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.381221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7901850432f4e54a9e8823425d1c037'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.398448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b5b46ac0-8a97-40f9-8f79-0c9e3e7f7d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7901850432f4e54a9e8823425d1c037'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.415082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2215/4412] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:33:59 2022] DELETE /identity/v3/users/a7901850432f4e54a9e8823425d1c037 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:00.418897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b192651a74ef4875a3e3febf87ed5e13', 'request_id': 'req-61c95755-44d0-4022-93df-07eb9b5aab50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.419504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.420013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.420393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.435837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b192651a74ef4875a3e3febf87ed5e13', 'request_id': 'req-61c95755-44d0-4022-93df-07eb9b5aab50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.447125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:00.448869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:00.469492 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:00.497910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b192651a74ef4875a3e3febf87ed5e13', 'request_id': 'req-61c95755-44d0-4022-93df-07eb9b5aab50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.518768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] The token cache is being invalidate because project b192651a74ef4875a3e3febf87ed5e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:00.519324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.520224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-61c95755-44d0-4022-93df-07eb9b5aab50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:00.522832 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2198/4413] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:00 2022] DELETE /identity/v3/projects/b192651a74ef4875a3e3febf87ed5e13 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:00.528621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff976-88f6-467f-8378-0da48dd43f33 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.528898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff976-88f6-467f-8378-0da48dd43f33 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.529175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff976-88f6-467f-8378-0da48dd43f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.570374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-59fff976-88f6-467f-8378-0da48dd43f33 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:00.575766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-59fff976-88f6-467f-8378-0da48dd43f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:00.653028 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2216/4414] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:00.686778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:00.690749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:00.723356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2199/4415] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:00.727470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.727815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.728102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.766370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:00.767597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:00.806298 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2200/4416] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:00.807525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:00.839546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2b46e-899e-4e09-9d58-66abc37ce988 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:00.863891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:00.865061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a791-5955-49c7-b94c-423e35884850 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:00.865554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.866129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.869149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.869149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:00.870325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:00.881110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:00.881110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.881110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.881110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.886330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:00.904990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:00.913366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:00.932933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2201/4417] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:00.936195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:00.947927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2217/4418] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:00.963389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107825ef-18c5-4da5-8ac7-0f99a16c462f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:00.978252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525505-9d23-4437-8270-79697e118cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:00.978792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525505-9d23-4437-8270-79697e118cda admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:00.979071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525505-9d23-4437-8270-79697e118cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:00.979344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525505-9d23-4437-8270-79697e118cda admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:00.982342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525505-9d23-4437-8270-79697e118cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:00.986127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525505-9d23-4437-8270-79697e118cda admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:01.001947 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:01.145197 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2202/4419] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:00 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:01.151104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:01.171039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06de8-8907-4250-b24c-d734299e305e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:01.374937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:01.376558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:01.388170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:01.388170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:01.388170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:01.388170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:01.562820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2218/4420] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:01 2022] POST /identity/v3/users => generated 294 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:01.568023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525505-9d23-4437-8270-79697e118cda admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:01.593806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525505-9d23-4437-8270-79697e118cda admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:01.623023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:01.624071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:01.624570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:01.645883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:01.645883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:01.645883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:01.677180 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2203/4421] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:01.682219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:01.708370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47ebd1-86b5-40d7-9807-48d88248c6c1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:01.729304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:01.730353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:01.730943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:01.731545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:01.732893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:01.736046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaa25e-08a0-42fa-8b45-f68bc5695e8e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:01.752231 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2219/4422] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:01.755905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:01.771253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc3c4-48aa-4f95-a836-3995ebe453f9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:01.776460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:01.777434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:01.777979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:01.778429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] PATH_INFO: `/v3/projects/e85541187f604e5880f8ba14d4b16096/users/efcef9fe993d4b36b6aa65485bc27fe4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:01.824014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85541187f604e5880f8ba14d4b16096, user_id=efcef9fe993d4b36b6aa65485bc27fe4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:01.828430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:01.976348 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2204/4423] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:01 2022] PUT /identity/v3/projects/e85541187f604e5880f8ba14d4b16096/users/efcef9fe993d4b36b6aa65485bc27fe4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:02.008824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.010145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.011598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.150126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] MFA Rules not processed for user `efcef9fe993d4b36b6aa65485bc27fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:02.151548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:02.251647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:02.253904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:02.317496 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2220/4424] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:02.322603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:02.419675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367a56-515e-4909-b016-9cc19c0739eb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:02.426279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:02.428244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.428685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.429111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.429963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:02.432325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:02.506651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682c8c-76d8-42c3-8653-1021c121850e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:02.512848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:02.514510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.514944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.515420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] PATH_INFO: `/v3/projects/b3e50d7861d244e7b10332e62f7ce3c5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.518065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e50d7861d244e7b10332e62f7ce3c5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:02.521624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:02.619098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2221/4425] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:02.623096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:02.744068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:02.744800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e50d7861d244e7b10332e62f7ce3c5', 'request_id': 'req-ff3735cd-a475-4568-8550-b66bb890fdaf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:02.760839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e50d7861d244e7b10332e62f7ce3c5', 'request_id': 'req-ff3735cd-a475-4568-8550-b66bb890fdaf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:02.795855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87373c3f-fd49-444f-b794-4b576677ff3d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:02.857328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e50d7861d244e7b10332e62f7ce3c5', 'request_id': 'req-ff3735cd-a475-4568-8550-b66bb890fdaf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:02.873422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] The token cache is being invalidate because project b3e50d7861d244e7b10332e62f7ce3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:02.874112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:02.874879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff3735cd-a475-4568-8550-b66bb890fdaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:02.877376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2205/4426] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:02 2022] DELETE /identity/v3/projects/b3e50d7861d244e7b10332e62f7ce3c5 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:02.882927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3577-3411-4f00-961e-074cda3b2350 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.883476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3577-3411-4f00-961e-074cda3b2350 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.885084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3577-3411-4f00-961e-074cda3b2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.896838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:02.897614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.897899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.898593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.898853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:02.900746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:02.928223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8fab3577-3411-4f00-961e-074cda3b2350 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:02.929488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8fab3577-3411-4f00-961e-074cda3b2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:02.945939 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2206/4427] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:02.949328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:02.949501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:02.952532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:02.972805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:02.977878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:02.991465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2207/4428] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:03.003660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.007248 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2222/4429] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:02 2022] POST /identity/v3/users => generated 299 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:03.016322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.018524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:03.030919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f97ea-642d-4b92-8fc0-0b01554ee973 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.039568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef38ab-264f-4ac9-917f-168140c6b277 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.049509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.051292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.052650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.053098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.053210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.053785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.054068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.054345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.055184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:03.056919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.060977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.064101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.070038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.084757 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2223/4430] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:03.088635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.094138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2208/4431] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:03.100145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.118618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ee2d-d6de-451f-bc79-ebf4f2b4dcd5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.119455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6db147-cf94-41d7-96b2-62fa472fc650 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.126831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.127730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.128380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.130155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.132482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.139935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.141024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.142391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.145947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.146582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] PATH_INFO: `/v3/projects/e6323b9888834b8fa85e9f89220e2f24/users/23b5959adbb8485694ea3329bcebc197/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.171476 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:03.176153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6323b9888834b8fa85e9f89220e2f24, user_id=23b5959adbb8485694ea3329bcebc197, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.181099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.272888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2224/4432] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:03 2022] PUT /identity/v3/projects/e6323b9888834b8fa85e9f89220e2f24/users/23b5959adbb8485694ea3329bcebc197/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:03.273044 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2209/4433] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:03 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:03.278167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.278365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.476043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5935c-15fe-4c42-9ecd-bf91420f0233 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.487657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.490996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.491878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.492902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.493699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.497165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.499330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12908a4-1dcb-43df-bcd0-c59462634820 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.521268 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2210/4434] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:03.522314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.525305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.528119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.528470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.530883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.532552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.535154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.547719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214e0d4-1c04-4510-8b2c-bbb98b3bf590 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.564484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.565619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.566262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.566744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] PATH_INFO: `/v3/projects/e6323b9888834b8fa85e9f89220e2f24/users/23b5959adbb8485694ea3329bcebc197/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.570961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6323b9888834b8fa85e9f89220e2f24, user_id=23b5959adbb8485694ea3329bcebc197, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.574822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc5215-0b57-4fa9-a930-57941fcca113 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.590868 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2211/4435] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:03 2022] PUT /identity/v3/projects/e6323b9888834b8fa85e9f89220e2f24/users/23b5959adbb8485694ea3329bcebc197/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:03.605724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ff09-332e-4071-9114-1d7391624408 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.606197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ff09-332e-4071-9114-1d7391624408 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.606651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ff09-332e-4071-9114-1d7391624408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.611831 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:03.648486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2225/4436] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:03 2022] POST /identity/v3/users => generated 295 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:03.652429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.686371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d81b-1ac5-4817-a5a6-21b92fa230e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.693028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0863ff09-332e-4071-9114-1d7391624408 None None] MFA Rules not processed for user `23b5959adbb8485694ea3329bcebc197`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:03.698470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0863ff09-332e-4071-9114-1d7391624408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:03.859145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.859834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.860111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.860435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.861077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.866881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.895048 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2226/4437] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:03.899119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.908442 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2212/4438] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:03.914495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ff09-332e-4071-9114-1d7391624408 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.924391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8747b-a51b-4e06-b431-d8cb12e5a827 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.934030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.936587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.936871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.937169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.938305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.941163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ff09-332e-4071-9114-1d7391624408 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:03.943016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.951618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:03.952976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:03.967653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:03.971181 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2227/4439] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:03.972172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:03.972305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:03.975040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:03.979377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:03.994743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47981e53-bb78-4dac-8156-69224b89257e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.008078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.008760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.009036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.009304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] PATH_INFO: `/v3/projects/01acf8e8ee774c008833d5aff937b676/users/02d9c8a493ab4fc1bdac4ab6494bec15/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.070644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01acf8e8ee774c008833d5aff937b676, user_id=02d9c8a493ab4fc1bdac4ab6494bec15, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.073939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6ac4c-73fb-474c-a32c-70de20d203d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:04.230519 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2228/4440] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:03 2022] PUT /identity/v3/projects/01acf8e8ee774c008833d5aff937b676/users/02d9c8a493ab4fc1bdac4ab6494bec15/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:04.235155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.237645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.237645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.242694 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2213/4441] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:03 2022] POST /identity/v3/projects => generated 360 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:04.247192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:04.288467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:04.300687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:04.320895 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:04.361972 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:04.367042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043867e-19bb-4c33-a8c0-6d8adba10c0c tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.380324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.381368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.381368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.381573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1227489052` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.383064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=68d508cca4b742d2afd4f9b8b665d360, value=tempest-tag-1227489052)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.385905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:04.421810 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2229/4442] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:04.465289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:04.467094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:04.545070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df30ef-34e1-42ae-a79b-b47c81358a96 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.555854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.556588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.556836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.557111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.558831 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1227489052. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:34:04.558831 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:34:04.558831 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:34:04.568440 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2214/4443] 10.222.0.13 () {60 vars in 1333 bytes} [Sun Oct 30 01:34:04 2022] PUT /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1227489052 => generated 0 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 30 01:34:04.572741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:04.577068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.578542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:04.590277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2230/4444] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:04.590654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bc073-8660-42f0-80d7-c8a71d01c82a tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.595949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.597407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.597909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.598884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1227489052` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.648614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=68d508cca4b742d2afd4f9b8b665d360, value=tempest-tag-1227489052)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.650743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:04.677021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2215/4445] 10.222.0.13 () {58 vars in 1314 bytes} [Sun Oct 30 01:34:04 2022] GET /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1227489052 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:04.681372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:04.696436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800aaff-5b38-439a-bf29-d9bbfd9ec941 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.707004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.708427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.708783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.709126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.710605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=68d508cca4b742d2afd4f9b8b665d360)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.714060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:04.895423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2231/4446] 10.222.0.13 () {60 vars in 1265 bytes} [Sun Oct 30 01:34:04 2022] PUT /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags => generated 141 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:04.895571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:04.917712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4f63-296d-48ab-bc80-1ab9959e6f63 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:04.932176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:04.932789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:04.933194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:04.933515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:04.979395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=68d508cca4b742d2afd4f9b8b665d360)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:04.983870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.015383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2216/4447] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:34:04 2022] GET /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags => generated 141 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:05.019170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.060919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f6783-6e88-4003-9ee4-3d8cf5605ecf tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:05.068248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:05.069031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:05.070161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:05.070673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1539758474` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:05.071904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=68d508cca4b742d2afd4f9b8b665d360, value=tempest-tag-1539758474)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:05.074709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.262193 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1539758474. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:34:05.262193 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:34:05.262193 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:34:05.274313 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2232/4448] 10.222.0.13 () {58 vars in 1317 bytes} [Sun Oct 30 01:34:05 2022] DELETE /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1539758474 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:05.276320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.295504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96fc0c-a5c2-4f8f-8420-6922cceb11c0 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:05.296753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:05.297489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:05.298183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:05.298457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1539758474` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:05.318602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=68d508cca4b742d2afd4f9b8b665d360, value=tempest-tag-1539758474)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:05.323527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Could not find project tag: tempest-tag-1539758474.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1539758474. Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 30 01:34:05.341532 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1539758474. Oct 30 01:34:05.342483 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:34:05.342851 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2217/4449] 10.222.0.13 () {58 vars in 1314 bytes} [Sun Oct 30 01:34:05 2022] GET /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags/tempest-tag-1539758474 => generated 107 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:34:05.347133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.365301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429030e4-d707-4f93-8df1-d6bbaf139474 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:05.375298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:05.376081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:05.376367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:05.376643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:05.381101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=68d508cca4b742d2afd4f9b8b665d360)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:05.382589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.419375 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:05.523491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2233/4450] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:34:05 2022] DELETE /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:05.529019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.545618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d49d8-a629-4f40-8a52-46f25058ec33 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:05.557210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:05.559082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:05.560039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:05.560795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:05.588045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=68d508cca4b742d2afd4f9b8b665d360)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:05.590811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.610727 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2218/4451] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:34:05 2022] GET /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360/tags => generated 66 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 30 01:34:05.611550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.624995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1cf09-a7c3-46eb-9789-39d45eb0334e tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:05.634212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23b5959adbb8485694ea3329bcebc197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6323b9888834b8fa85e9f89220e2f24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:05.635321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:05.635837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:05.636291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] PATH_INFO: `/v3/projects/68d508cca4b742d2afd4f9b8b665d360` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:05.637991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68d508cca4b742d2afd4f9b8b665d360)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:05.639957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:05.791385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d508cca4b742d2afd4f9b8b665d360', 'request_id': 'req-9872d90a-59ce-43e5-a786-3a01f3823bf5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:05.857293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d508cca4b742d2afd4f9b8b665d360', 'request_id': 'req-9872d90a-59ce-43e5-a786-3a01f3823bf5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:05.872592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d508cca4b742d2afd4f9b8b665d360', 'request_id': 'req-9872d90a-59ce-43e5-a786-3a01f3823bf5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:05.907580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] The token cache is being invalidate because project 68d508cca4b742d2afd4f9b8b665d360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:05.907580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:05.907580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9872d90a-59ce-43e5-a786-3a01f3823bf5 tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:05.915616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:05.916525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2234/4452] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:05 2022] DELETE /identity/v3/projects/68d508cca4b742d2afd4f9b8b665d360 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:05.918223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:05.944065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96bdc8-1328-44f5-9c6e-a1b42d827fba tempest-IdentityV3ProjectTagsTest-155784661 tempest-IdentityV3ProjectTagsTest-155784661-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:06.064707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:06.065664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:06.067174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:06.067466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] PATH_INFO: `/v3/users/efcef9fe993d4b36b6aa65485bc27fe4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:06.068682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efcef9fe993d4b36b6aa65485bc27fe4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:06.071037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:06.083793 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:06.311938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efcef9fe993d4b36b6aa65485bc27fe4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:06.314038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efcef9fe993d4b36b6aa65485bc27fe4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:06.328421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efcef9fe993d4b36b6aa65485bc27fe4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:06.338752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efcef9fe993d4b36b6aa65485bc27fe4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:06.399849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efcef9fe993d4b36b6aa65485bc27fe4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:06.439194 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2219/4453] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:05 2022] DELETE /identity/v3/users/efcef9fe993d4b36b6aa65485bc27fe4 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:06.442019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:06.443926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:06.444530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:06.484755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:06.485995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:06.565203 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2235/4454] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:06.612935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:06.614514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:06.682110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb03c9-8a28-4181-8006-b273ab2db932 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:06.687061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:06.687888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:06.688318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:06.688765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:06.700608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:06.702313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:06.714221 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2220/4455] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:08.343161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:08.344965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:08.366082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616adde4-82dd-4c5b-8467-4a7a89e98725 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:08.381405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:08.381405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:08.381405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:08.381405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] PATH_INFO: `/v3/projects/e85541187f604e5880f8ba14d4b16096` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:08.386371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85541187f604e5880f8ba14d4b16096)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:08.389464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:08.557808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85541187f604e5880f8ba14d4b16096', 'request_id': 'req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:08.638969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85541187f604e5880f8ba14d4b16096', 'request_id': 'req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:08.646581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85541187f604e5880f8ba14d4b16096', 'request_id': 'req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:08.652912 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:08.659310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] The token cache is being invalidate because project e85541187f604e5880f8ba14d4b16096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:08.659818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:08.660935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f4a6798-7a39-4005-8bd4-d7299cdfadb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:08.663651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2236/4456] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:08 2022] DELETE /identity/v3/projects/e85541187f604e5880f8ba14d4b16096 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:08.667779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:08.684500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c674dd-c73e-4e8c-a78b-c6661b28653c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:08.826716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:08.826716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:08.826716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:08.826716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] PATH_INFO: `/v3/users/23b5959adbb8485694ea3329bcebc197` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:08.827215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b5959adbb8485694ea3329bcebc197)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:08.829804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:09.075933 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:09.089068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b5959adbb8485694ea3329bcebc197'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:09.090005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b5959adbb8485694ea3329bcebc197'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:09.097418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b5959adbb8485694ea3329bcebc197'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:09.099234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b5959adbb8485694ea3329bcebc197'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:09.193709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b5959adbb8485694ea3329bcebc197'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:09.235352 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2221/4457] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:08 2022] DELETE /identity/v3/users/23b5959adbb8485694ea3329bcebc197 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:09.239707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764375-386b-449f-a624-4b0e704418d9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:09.240474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764375-386b-449f-a624-4b0e704418d9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:09.240474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97764375-386b-449f-a624-4b0e704418d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:09.279988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-97764375-386b-449f-a624-4b0e704418d9 None None] MFA Rules not processed for user `6f7675c0fa214588b71c04ca120557fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:09.281684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-97764375-386b-449f-a624-4b0e704418d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:09.450144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2237/4458] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:10.915784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:10.917651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:11.041624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae79db-952b-4d0a-9ae6-4e42d8540a36 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:11.047482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:11.048600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.049127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.049660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] PATH_INFO: `/v3/projects/e6323b9888834b8fa85e9f89220e2f24` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.055869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6323b9888834b8fa85e9f89220e2f24)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:11.055869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:11.202415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6323b9888834b8fa85e9f89220e2f24', 'request_id': 'req-bd2d1290-04f6-44f2-b228-d54538955f45'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:11.217231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6323b9888834b8fa85e9f89220e2f24', 'request_id': 'req-bd2d1290-04f6-44f2-b228-d54538955f45'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:11.284592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6323b9888834b8fa85e9f89220e2f24', 'request_id': 'req-bd2d1290-04f6-44f2-b228-d54538955f45'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:11.303786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] The token cache is being invalidate because project e6323b9888834b8fa85e9f89220e2f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:11.304541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:11.306585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd2d1290-04f6-44f2-b228-d54538955f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:11.329290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2222/4459] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:10 2022] DELETE /identity/v3/projects/e6323b9888834b8fa85e9f89220e2f24 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:11.330093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.330576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.330673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.370658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:11.371905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:11.492943 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2238/4460] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:11.502200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.509526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.509526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.544755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:11.546555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:11.561371 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2223/4461] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:11.562753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:11.588478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e07e2-88d7-4947-a343-46839d554c0f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:11.600224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:11.601923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.602770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.603625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.605261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:11.608615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:11.611172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:11.643020 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2239/4462] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:11.647962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:11.658872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a146acb-134e-4496-9cb2-cd4b0b30ffe9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:11.672113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:11.672796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.673697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.675246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.676575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:11.695319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:11.788330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:11.792237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:11.818513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb114e8-c714-4cfe-9f08-cda42494cc85 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:11.824034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:11.829606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.830162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.830604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] PATH_INFO: `/v3/users/8c6df6929b09426585b9bd64b804d8a7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.833178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6df6929b09426585b9bd64b804d8a7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:11.835485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:11.848516 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2224/4463] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:11 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:11.853299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:11.899865 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:11.961233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635d27-e1ef-4a25-be43-7d8c449f28f3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:11.966540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:11.967766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:11.968059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:11.968559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:11.969244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:11.971359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.102469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6df6929b09426585b9bd64b804d8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:12.130513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2225/4464] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:11 2022] POST /identity/v3/users => generated 306 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:12.130513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.135925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.210505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6df6929b09426585b9bd64b804d8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:12.212053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6df6929b09426585b9bd64b804d8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:12.239002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6df6929b09426585b9bd64b804d8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:12.250723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6df6929b09426585b9bd64b804d8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:12.255073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:12.261417 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2240/4465] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:11 2022] DELETE /identity/v3/users/8c6df6929b09426585b9bd64b804d8a7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:12.261947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.263643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.284044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd6cb-c3f5-4975-a65d-3e7b9bb1eadc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.346956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3ca30-d588-4c6c-951b-bb3a8a98a281 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.359346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.359346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.359346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.359346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.359773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.359773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519710d5-ff2f-4feb-8158-7f6d55664f7a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.369126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2241/4466] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:12.370562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.371021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.371481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.389935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.394021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.394021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.394021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.394021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.395896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:12.397285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.406445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2242/4467] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:12.407572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.416926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.421449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebf13e-203c-4027-8468-a2294da3514f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.422312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.427499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.428142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.428422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.429126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] PATH_INFO: `/v3/projects/05ae0e4ffb994a428e26fcaf85908f13/users/19bcb8d60a9c41659bb5b579a804a964/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.449448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae0e4ffb994a428e26fcaf85908f13, user_id=19bcb8d60a9c41659bb5b579a804a964, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.462073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.473398 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2226/4468] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:12.474777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.476733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.537065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2243/4469] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:12 2022] PUT /identity/v3/projects/05ae0e4ffb994a428e26fcaf85908f13/users/19bcb8d60a9c41659bb5b579a804a964/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:12.540952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.572967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2a12-3f28-43d9-b13c-a2d4fd992f1e service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.659181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c35e4f-23c3-4916-9a24-eff47374e320 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.666469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.667087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.667362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.667808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.671244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.671992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.672270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.672543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.673242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.675048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.687581 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2244/4470] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:34:12.692894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.693077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.694415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668a4fc-b913-490c-8b53-67e991a2b4b1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.704322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe584a4-da9b-41b4-8097-8df0a8c8e5d9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.712208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.727208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.727208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.727208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] PATH_INFO: `/v3/projects/05ae0e4ffb994a428e26fcaf85908f13/users/19bcb8d60a9c41659bb5b579a804a964/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.727208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae0e4ffb994a428e26fcaf85908f13, user_id=19bcb8d60a9c41659bb5b579a804a964, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.727208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:12.727787 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2227/4471] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:12.739768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2245/4472] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:12 2022] PUT /identity/v3/projects/05ae0e4ffb994a428e26fcaf85908f13/users/19bcb8d60a9c41659bb5b579a804a964/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:12.751250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.751538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.752154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.798899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] MFA Rules not processed for user `19bcb8d60a9c41659bb5b579a804a964`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:12.805451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.808330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.810485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:12.943465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1586b6-b6f0-4f8a-a4ae-ea4326330f17 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:12.952166 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2228/4473] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:12.954295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:12.955375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:12.956825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:12.957473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] PATH_INFO: `/v3/users/94cab57fc5184fc6be1cfde72e9bab26` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:12.962053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:12.963823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] RBAC: Authorizing `identity:delete_user(user_id=94cab57fc5184fc6be1cfde72e9bab26)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:12.973494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.001024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84217c54-af3d-4c86-b72e-cdd975ef2d63 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.011122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.011812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.016144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.016144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.016144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:13.017607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.145012 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2229/4474] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:12 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:13.146572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:13.149206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.237959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94cab57fc5184fc6be1cfde72e9bab26'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.275002 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:13.287976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e7c95-9b7d-4bbb-a13b-e2287f32e8f3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.293100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.293799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.294083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.294359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] PATH_INFO: `/v3/projects/36ab4b8e0767439e87ac2f2838e4353d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.296177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ab4b8e0767439e87ac2f2838e4353d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:13.298220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.305208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94cab57fc5184fc6be1cfde72e9bab26'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.306866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94cab57fc5184fc6be1cfde72e9bab26'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.325158 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:13.336115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94cab57fc5184fc6be1cfde72e9bab26'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.350569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94cab57fc5184fc6be1cfde72e9bab26'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.363112 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2246/4475] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:12 2022] DELETE /identity/v3/users/94cab57fc5184fc6be1cfde72e9bab26 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:13.364914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:13.367500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.455681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ab4b8e0767439e87ac2f2838e4353d', 'request_id': 'req-5d237e46-8c29-4264-a835-378445fceffe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.471347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ab4b8e0767439e87ac2f2838e4353d', 'request_id': 'req-5d237e46-8c29-4264-a835-378445fceffe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.483222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b034f-30f5-4d5f-9b24-30743e38dcef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.568023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.568758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.569088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.569386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.570017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:13.571975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.579528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ab4b8e0767439e87ac2f2838e4353d', 'request_id': 'req-5d237e46-8c29-4264-a835-378445fceffe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.609112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] The token cache is being invalidate because project 36ab4b8e0767439e87ac2f2838e4353d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:13.610971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.612983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5d237e46-8c29-4264-a835-378445fceffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:13.618919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2230/4476] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:13 2022] DELETE /identity/v3/projects/36ab4b8e0767439e87ac2f2838e4353d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:13.622638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.627804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.627804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.694509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:13.697556 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2247/4477] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:13 2022] POST /identity/v3/users => generated 300 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:13.697556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:13.699363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.699664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.737685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2231/4478] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:13.737685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:13.738252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9a14-608a-4805-9ccc-343c5459c3e4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.740267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.750733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.752553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.752859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.753123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] PATH_INFO: `/v3/users/48cff5af998042df820262c6d8b7c232` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.757106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cff5af998042df820262c6d8b7c232)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:13.762373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.773304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12318ddf-bd51-46be-8aff-556a3b07a385 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.795597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.798321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.798599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.798878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.799543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:13.801205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:13.841292 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2232/4479] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:13.842405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:13.846686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:13.935919 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:13.976499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63d5d9-8f54-464b-a30d-3fbe5344c25b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:13.980850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:13.981765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:13.982313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:13.982735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:13.999501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:14.001203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:14.014722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cff5af998042df820262c6d8b7c232'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:14.021595 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:14.031826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2233/4480] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:14.033001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:14.049416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45ba1-a10d-491e-af8d-8e1da2f281cd service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:14.055040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:14.057404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:14.061443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:14.063368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:14.064233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:14.066940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:14.088297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2234/4481] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:14.092043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:14.104132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cff5af998042df820262c6d8b7c232'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:14.105080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301262d1-0ea0-41b4-abc0-cb18559cba58 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:14.107111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cff5af998042df820262c6d8b7c232'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:14.112714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:14.113967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:14.114576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:14.114948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] PATH_INFO: `/v3/projects/23e0aa18f4c540c3882a46cfa4eaf02a/users/9ec67b9ee612454481df597cb11da4fc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:14.143713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e0aa18f4c540c3882a46cfa4eaf02a, user_id=9ec67b9ee612454481df597cb11da4fc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:14.147110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:14.152908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cff5af998042df820262c6d8b7c232'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:14.174005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-139a2541-cec4-4650-bdc4-ea2e1444597d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cff5af998042df820262c6d8b7c232'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:14.182723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2248/4482] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:13 2022] DELETE /identity/v3/users/48cff5af998042df820262c6d8b7c232 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:14.286062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2235/4483] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:14 2022] PUT /identity/v3/projects/23e0aa18f4c540c3882a46cfa4eaf02a/users/9ec67b9ee612454481df597cb11da4fc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:14.296834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:14.297776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:14.298067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:14.382613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] MFA Rules not processed for user `9ec67b9ee612454481df597cb11da4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:14.384464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:14.542916 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2249/4484] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:14.560036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:14.562364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:14.568307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:14.570725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:14.732787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e188b-a9e4-4468-a3d1-c2db104d2d6c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:14.737716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:14.739781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:14.740584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:14.741287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:14.743788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:14.806028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429d4f-266f-4fe0-992a-f39fe4dcdb83 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:14.834083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:14.835234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:14.835666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:14.836092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:14.844194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:14.924906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:14.927616 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:14.932202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:14.969068 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2250/4485] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:14.999683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:15.002506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:15.016763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2236/4486] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:15.330394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:15.332550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:15.510565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950c129-f01d-484e-81d3-d4360003ac93 service glance] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:15.522238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:15.523056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:15.523341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:15.523613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:15.528663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:15.567850 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:15.567850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:15.567850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:15.574746 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2251/4487] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:15.638823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:15.640565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:15.658726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc40187-8913-4e3c-8822-c9c405b490a1 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:15.665079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:15.666015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:15.666313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:15.666930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:15.668923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:15.691789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:15.693456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:15.714334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:15.715953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:15.736541 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2237/4488] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:15.908527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775d335-d726-4458-b04e-80046c2ec966 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:15.916839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:15.917635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:15.920750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:15.920750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] PATH_INFO: `/v3/projects/9a0bae30895747149372f01a8070095c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:15.920750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0bae30895747149372f01a8070095c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:15.922315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:16.034806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:16.034806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:16.071790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6ecbd-98ce-4eb2-b7a5-9d3650e09df8 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:16.084018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:16.084642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.084918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.085189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.088138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:16.115223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:16.116713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552c17-e8e2-4e5e-a615-701edd6cf550 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:16.144028 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2238/4489] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:16.162860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0bae30895747149372f01a8070095c', 'request_id': 'req-6fe2cff6-f163-42a9-a052-10c787ff52f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:16.255666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0bae30895747149372f01a8070095c', 'request_id': 'req-6fe2cff6-f163-42a9-a052-10c787ff52f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:16.265297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0bae30895747149372f01a8070095c', 'request_id': 'req-6fe2cff6-f163-42a9-a052-10c787ff52f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:16.308880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] The token cache is being invalidate because project 9a0bae30895747149372f01a8070095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:16.309223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:16.313167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6fe2cff6-f163-42a9-a052-10c787ff52f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:16.320545 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2252/4490] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:15 2022] DELETE /identity/v3/projects/9a0bae30895747149372f01a8070095c => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:16.326157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.326718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.327188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.369473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:16.370163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:16.523098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2239/4491] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:16.531686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.533543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.534044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.593120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:16.600507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:16.633263 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2253/4492] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:16.634667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:16.651873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bdd23-adef-4db4-b7c4-2e76ac4cd8ba None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:16.671182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:16.671182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.671182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.671182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.672241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:16.672867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:16.675055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:16.710547 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2240/4493] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:16.714778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:16.727870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df3d1-875e-4ca6-97db-a0b80a808298 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:16.749059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:16.752078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.752367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.752646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.755857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:16.765499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:16.770185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:16.776557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:16.801721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9515-aba4-4089-ace0-f8ecf2550580 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:16.818798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:16.819487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:16.819948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:16.820137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] PATH_INFO: `/v3/users/19bcb8d60a9c41659bb5b579a804a964` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:16.823166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bcb8d60a9c41659bb5b579a804a964)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:16.830043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:16.995504 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2254/4494] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:16 2022] POST /identity/v3/projects => generated 395 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:16.997312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:17.049152 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:17.108488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bcb8d60a9c41659bb5b579a804a964'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:17.109446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bcb8d60a9c41659bb5b579a804a964'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:17.127136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bcb8d60a9c41659bb5b579a804a964'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:17.130172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bcb8d60a9c41659bb5b579a804a964'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:17.154448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999b85e-0b89-4b0e-8a75-9974afc427e7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:17.201086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:17.201924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.202209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.202481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.203637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:17.206298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:17.222660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a8204135-fcd6-4f19-9600-a0c5d89c465f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bcb8d60a9c41659bb5b579a804a964'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:17.254174 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2241/4495] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:16 2022] DELETE /identity/v3/users/19bcb8d60a9c41659bb5b579a804a964 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:17.259053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.259722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.260377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.331131 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:17.353371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:17.354970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:17.424184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2255/4496] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:16 2022] POST /identity/v3/users => generated 298 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:17.429048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:17.432091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:17.471778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea910e0f-b201-48e5-b65e-0dd383e4b283 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:17.558940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2242/4497] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:17.604476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:17.605740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.606206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.607192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.608023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:17.610056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:17.632762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2256/4498] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:34:17.636922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:17.649930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:17.649930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:17.658914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81492-1acc-4b99-b7e0-5aa2d97c2ce1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:17.670827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:17.672963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.672963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.674821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.676959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:17.679822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:17.701789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2243/4499] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:17.708140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:17.728294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466227f-cfb8-4fae-b3d8-043c526a07aa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:17.740728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:17.741842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.742560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.742991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] PATH_INFO: `/v3/projects/5ec1af43d24a4c9a9ec72686113b045f/users/83a42fb6fe574e7791b826c7aba66e54/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.788515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec1af43d24a4c9a9ec72686113b045f, user_id=83a42fb6fe574e7791b826c7aba66e54, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:17.798321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:17.812619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de136e2f-d6a9-4fb0-ad6b-71d28f0189de admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:17.823046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:17.823920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.827241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.827241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.844467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:17.846414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117a56c-4faa-4d48-93d6-183526ef41df service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:17.869425 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2257/4500] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:17.871569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2244/4501] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:17 2022] PUT /identity/v3/projects/5ec1af43d24a4c9a9ec72686113b045f/users/83a42fb6fe574e7791b826c7aba66e54/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:17.882029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:17.882900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:17.883417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:17.936470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] MFA Rules not processed for user `83a42fb6fe574e7791b826c7aba66e54`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:17.939345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:18.001264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:18.004902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:18.104626 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2258/4502] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:18.136902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:18.183335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a15e9-c585-42ce-b04a-ebc27b2a2621 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:18.197208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:18.197874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.198227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.198896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] PATH_INFO: `/v3/projects/3f6da0fbf0024950b2c07a6db43ff3a3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.202706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6da0fbf0024950b2c07a6db43ff3a3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:18.207027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:18.278370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e280704-2e98-4a78-961a-36d83905ea47 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:18.287342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:18.288042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.289074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.289074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.304203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:18.306144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74de7a0-165f-4572-a5fc-8b3842b2f97b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:18.321002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2259/4503] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:18.421104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6da0fbf0024950b2c07a6db43ff3a3', 'request_id': 'req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:18.444355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6da0fbf0024950b2c07a6db43ff3a3', 'request_id': 'req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:18.547861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6da0fbf0024950b2c07a6db43ff3a3', 'request_id': 'req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:18.567110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] The token cache is being invalidate because project 3f6da0fbf0024950b2c07a6db43ff3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:18.567424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:18.568634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-10820f6b-8b0e-432a-8a7c-efbfd63ffdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:18.573924 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2245/4504] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:17 2022] DELETE /identity/v3/projects/3f6da0fbf0024950b2c07a6db43ff3a3 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:18.579164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.582645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.582645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.649671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:18.657777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:18.685509 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:18.752752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2260/4505] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:18.762453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.763187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.763479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.791229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:18.794304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:18.809572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2246/4506] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:18.814332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:18.827995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7f54-ce8f-4ca9-8606-96b5fe211923 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:18.834226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:18.834900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.836606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.837064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.838442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:18.838442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:18.840138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:18.872331 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2261/4507] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:18.878029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:18.891869 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:18.901374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036030-a86f-4635-90ad-c3c9831428ce None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:18.905792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:18.906418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:18.906998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:18.907283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:18.907932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:18.910527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.030185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2247/4508] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:18 2022] POST /identity/v3/projects => generated 405 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:19.035933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:19.048701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644aba1d-eb97-418d-acab-7c2fe2445698 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:19.131168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:19.132995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.133716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.134428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.135337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:19.138690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.277947 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2262/4509] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:19 2022] POST /identity/v3/users => generated 303 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:19.279714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:19.292904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869e3ef-8c46-45f8-a797-dff75c5f40a0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:19.308151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:19.308725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.309011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.309281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.312378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:19.316975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.341583 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2248/4510] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:19.346640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:19.364897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbdd50-a38b-4dc8-a0c5-4ab73a7ab1ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:19.379326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:19.380085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.380459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.380825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.381628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:19.386827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bb056-6d63-4054-bf7b-fa12bd5c883e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.419861 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2263/4511] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:19.421986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:19.432384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6db9-2c77-41f4-b054-638f5441228d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:19.437644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:19.438319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.438600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.438877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] PATH_INFO: `/v3/projects/109772076b1d4aed99db960f295ac4e0/users/dcdd7b99e5a94490b604d2e10545a658/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.466626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109772076b1d4aed99db960f295ac4e0, user_id=dcdd7b99e5a94490b604d2e10545a658, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:19.472007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.576275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2249/4512] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:19 2022] PUT /identity/v3/projects/109772076b1d4aed99db960f295ac4e0/users/dcdd7b99e5a94490b604d2e10545a658/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:19.582580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.583055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.584213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.616484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:19.618037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:19.747200 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2264/4513] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:19.776147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:19.780153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:19.885811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38a90-175d-4fef-9ff9-1007c3182be1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:19.896944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:19.897675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:19.897957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:19.898231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:19.944042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:19.953792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:19.990992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2250/4514] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:20.220213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:20.241363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3466eb9-534f-4a6d-a858-040340a4c2f4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:20.252557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:20.253573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:20.254081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:20.254561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:20.258975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:20.292820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:20.294944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:20.320777 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2265/4515] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:21.106815 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:21.448516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:21.450268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:21.475362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da9c-a345-4a45-99c9-657eead194d7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:21.519058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:21.520097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:21.521907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:21.522435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] PATH_INFO: `/v3/projects/05ae0e4ffb994a428e26fcaf85908f13` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:21.523831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ae0e4ffb994a428e26fcaf85908f13)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:21.525961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:21.680324 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:21.698207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ae0e4ffb994a428e26fcaf85908f13', 'request_id': 'req-3a91a779-9b8a-4c3b-b978-1664a233fa86'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:21.711043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ae0e4ffb994a428e26fcaf85908f13', 'request_id': 'req-3a91a779-9b8a-4c3b-b978-1664a233fa86'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:21.827470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ae0e4ffb994a428e26fcaf85908f13', 'request_id': 'req-3a91a779-9b8a-4c3b-b978-1664a233fa86'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:21.843198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] The token cache is being invalidate because project 05ae0e4ffb994a428e26fcaf85908f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:21.844383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:21.845636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:21.855096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2251/4516] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:21 2022] DELETE /identity/v3/projects/05ae0e4ffb994a428e26fcaf85908f13 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:21.860086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:21.902059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4078-7ea8-4d49-96a8-303cab0427dc service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:22.048054 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:22.077189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:22.078754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:22.079261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:22.079748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] PATH_INFO: `/v3/users/9ec67b9ee612454481df597cb11da4fc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:22.091537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec67b9ee612454481df597cb11da4fc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:22.095872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:22.401256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec67b9ee612454481df597cb11da4fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:22.489631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec67b9ee612454481df597cb11da4fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:22.490282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec67b9ee612454481df597cb11da4fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:22.530833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec67b9ee612454481df597cb11da4fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:22.541083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe290376-bde7-412b-b922-9f50f414f5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec67b9ee612454481df597cb11da4fc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:22.560924 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2266/4517] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:21 2022] DELETE /identity/v3/users/9ec67b9ee612454481df597cb11da4fc => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:24.508774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:24.514062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:24.542296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a779-9b8a-4c3b-b978-1664a233fa86 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:24.648921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:24.651466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:24.651984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:24.652511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] PATH_INFO: `/v3/projects/23e0aa18f4c540c3882a46cfa4eaf02a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:24.654286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e0aa18f4c540c3882a46cfa4eaf02a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:24.656463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:24.878533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e0aa18f4c540c3882a46cfa4eaf02a', 'request_id': 'req-54cce142-9006-4f4c-993b-150b43536a1d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:24.888542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e0aa18f4c540c3882a46cfa4eaf02a', 'request_id': 'req-54cce142-9006-4f4c-993b-150b43536a1d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:24.995505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e0aa18f4c540c3882a46cfa4eaf02a', 'request_id': 'req-54cce142-9006-4f4c-993b-150b43536a1d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:25.019606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] The token cache is being invalidate because project 23e0aa18f4c540c3882a46cfa4eaf02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:25.025526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:25.025526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54cce142-9006-4f4c-993b-150b43536a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:25.025526 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2252/4518] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:24 2022] DELETE /identity/v3/projects/23e0aa18f4c540c3882a46cfa4eaf02a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:25.027104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.027551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.027656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.066646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:25.068260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:25.193541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2267/4519] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:25.201373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.201651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.202035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.253327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:25.259338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:25.278180 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2253/4520] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:25.282613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.310337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b410b-b07e-4ae2-84cb-67489d3cde5c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.317811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.318783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.319289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.319736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.338658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:25.338658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.338658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:25.338658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2268/4521] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:25.342512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.354662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08701d-7f85-4080-ba2d-c1b5f190ba43 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.362525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.363493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.364003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.364531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.365532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.368933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:25.509579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2254/4522] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:25 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:25.515590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.530076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad573-f3f1-43a9-8467-f31cb40f4535 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.618893 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:25.631986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.632598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.633070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.633370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.634089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.636112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:25.736476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2269/4523] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:25 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:25.738291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.767699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eff30-64f9-4b13-aaa8-94a17dd099e6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.781880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.782812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.783896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.784380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.785193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.787027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:25.822568 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2255/4524] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:25.826348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.841298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51902e-6281-455f-85dc-fd91f025a28b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.851385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.852333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.852795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.853603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.854460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.856866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dd059-1a88-44b4-94ab-63dfe8396f0d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:25.871087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2270/4525] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:25.878640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:25.887307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788c7a-a03f-42b8-a321-f81d47f37a0b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:25.908196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:25.909196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:25.909758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:25.910729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] PATH_INFO: `/v3/projects/1ca70c2b87994d128f42dfd458056e3e/users/e32cde3baf704adda1f5069f9eeec8a5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:25.936587 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:25.942227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca70c2b87994d128f42dfd458056e3e, user_id=e32cde3baf704adda1f5069f9eeec8a5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:25.946872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5328fc-63bf-4e4f-b1de-4c56bf0a94bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:26.053273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2256/4526] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:25 2022] PUT /identity/v3/projects/1ca70c2b87994d128f42dfd458056e3e/users/e32cde3baf704adda1f5069f9eeec8a5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:26.064278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:26.064763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:26.064852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:26.068944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:26.069785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:26.070181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:26.128984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] MFA Rules not processed for user `e32cde3baf704adda1f5069f9eeec8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:26.130469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:26.161061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:26.162349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:26.292330 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2271/4527] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:26.299916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:26.302929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:26.322728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2257/4528] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:26.338411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:26.340112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:26.434471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253a648-ab9e-43ff-ae17-7453401f4853 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:26.446823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:26.447717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:26.448285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:26.448756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:26.467595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:26.469643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbca6e-0f78-4f13-8f4f-4f70ebbc02c7 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:26.496151 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2272/4529] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:26.521154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8933b0-744c-4ba4-8094-8712f8bf16bd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:26.528064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:26.529101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:26.529591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:26.530039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:26.540329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:26.542222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:26.552726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2258/4530] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:26.880072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de7fe-6726-4517-be57-d4c549237bca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:26.880827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de7fe-6726-4517-be57-d4c549237bca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:26.881363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9de7fe-6726-4517-be57-d4c549237bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:26.925701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cf9de7fe-6726-4517-be57-d4c549237bca None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:26.927539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf9de7fe-6726-4517-be57-d4c549237bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:26.956648 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2273/4531] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:26.987640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:27.013237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1fd20-44c2-46dd-8087-adda287bae38 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:27.030697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:27.031465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:27.031886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:27.032265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:27.053225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:27.055283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:27.104400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2259/4532] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:28.079739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7087-ac4f-43e2-aa11-288736e5c598 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:28.080867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7087-ac4f-43e2-aa11-288736e5c598 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:28.082896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7087-ac4f-43e2-aa11-288736e5c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:28.173348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1f3c7087-ac4f-43e2-aa11-288736e5c598 None None] MFA Rules not processed for user `02d9c8a493ab4fc1bdac4ab6494bec15`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:28.174649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1f3c7087-ac4f-43e2-aa11-288736e5c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:28.332802 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:28.385624 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2274/4533] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:28.392166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:28.395213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:28.466485 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:28.556518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:28.557556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:28.557556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:28.599767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:28.601202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:28.634799 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2275/4534] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:28.644143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a9e7-b79c-4355-b20e-bde2ea45335c service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:28.676185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:28.676710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:28.678565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:28.678950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:28.679316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:28.681261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:28.683686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:28.711048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712983-6079-41f5-bbac-7f34e1827b6e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:28.732527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:28.737913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:28.738609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:28.738838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:28.773760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:28.776377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:28.801662 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2276/4535] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:28.848092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2260/4536] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:28 2022] POST /identity/v3/projects => generated 387 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:28.849295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:28.869411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9ee83-19ee-400d-a2d6-67fae84b99c6 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:29.110224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:29.111602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:29.112084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:29.112536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:29.114930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:29.115572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:29.225557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2277/4537] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:28 2022] POST /identity/v3/users => generated 300 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:29.227513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:29.247914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09db3-25b5-4b3e-9f84-bf905d7a8367 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:29.261425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:29.263062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:29.263413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:29.264271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:29.265913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:29.271831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:29.300059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2261/4538] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:29.304107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:29.327606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060496e-1f1b-4770-9606-d3cb69fcbf91 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:29.353992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:29.354798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:29.355802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:29.356012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] PATH_INFO: `/v3/projects/1a3c7147acf242179270d967518641f1/users/01e5e100d57a4513b10a601644e242c9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:29.470372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c7147acf242179270d967518641f1, user_id=01e5e100d57a4513b10a601644e242c9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:29.473851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:29.608794 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2278/4539] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:29 2022] PUT /identity/v3/projects/1a3c7147acf242179270d967518641f1/users/01e5e100d57a4513b10a601644e242c9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:29.610124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:29.635158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab383f1-aa71-440d-960f-a409adc2c7f4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:29.867209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:29.875091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:29.875253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:29.878036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:29.880771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:29.902211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b508-a057-4fdc-b262-1da31dfd0cfd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:29.946459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2262/4540] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:29.947465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:29.966549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd49e-9b5a-4f27-b9ca-08ad9927c90b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:29.988089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:29.989166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:29.990260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:29.995993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] PATH_INFO: `/v3/projects/1a3c7147acf242179270d967518641f1/users/01e5e100d57a4513b10a601644e242c9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:29.995993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3c7147acf242179270d967518641f1, user_id=01e5e100d57a4513b10a601644e242c9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:30.008652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:30.096051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2279/4541] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:29 2022] PUT /identity/v3/projects/1a3c7147acf242179270d967518641f1/users/01e5e100d57a4513b10a601644e242c9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:30.584806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532ff-9c1f-4adc-92cc-f2369d48ffd9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:30.585366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532ff-9c1f-4adc-92cc-f2369d48ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:30.585677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714532ff-9c1f-4adc-92cc-f2369d48ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:30.654176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-714532ff-9c1f-4adc-92cc-f2369d48ffd9 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:30.655486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-714532ff-9c1f-4adc-92cc-f2369d48ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:30.790724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2263/4542] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:30.824111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:30.986435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83eaca2-ed4d-4d16-8ef6-4d9671e6f981 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:31.000298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:31.000985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:31.001420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:31.001901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:31.021755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:31.023552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:31.048128 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2280/4543] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:32.134836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba59fa-e281-4b1b-976b-d0d39b088dc7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:32.135424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba59fa-e281-4b1b-976b-d0d39b088dc7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:32.135424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba59fa-e281-4b1b-976b-d0d39b088dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:32.191162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0dba59fa-e281-4b1b-976b-d0d39b088dc7 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:32.192650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0dba59fa-e281-4b1b-976b-d0d39b088dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:32.202401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2264/4544] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:32.263206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:32.303602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6cc9-597a-470a-997d-4b61ac5a0258 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:32.323367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:32.324608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:32.325246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:32.325893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:32.351791 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:32.363144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:32.365797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:32.392001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2281/4545] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:33.739200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:33.740299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:33.740781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:33.798877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:33.801064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:33.832368 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2265/4546] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:33.866115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:33.885833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b316d-384f-4f5e-978c-3ec89a026093 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:33.901431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:33.902264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:33.902632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:33.903003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:33.925602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:33.929461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd9015-909e-4ead-8a73-cfe977707b06 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:33.970167 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2282/4547] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:34.744136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:34.744136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:34.818559 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:34.909786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864ba9-6e40-42d2-a17b-4d56d7f826af None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:34.928503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:34.929574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:34.932232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:34.932720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] PATH_INFO: `/v3/users/3b493d5b36444c51a9edce806fcf092e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:34.940615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b493d5b36444c51a9edce806fcf092e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:34.947552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:35.177528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b493d5b36444c51a9edce806fcf092e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:35.178246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b493d5b36444c51a9edce806fcf092e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:35.220478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b493d5b36444c51a9edce806fcf092e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:35.220478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b493d5b36444c51a9edce806fcf092e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:35.295072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8c250b2f-e4f5-49ef-af69-20e4fbbd44a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b493d5b36444c51a9edce806fcf092e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:35.338211 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2266/4548] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:34 2022] DELETE /identity/v3/users/3b493d5b36444c51a9edce806fcf092e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:35.339799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:35.340380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:35.340380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:35.400513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:35.402473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:35.744002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:35.744417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:35.745002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:35.755840 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2283/4549] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:35.839770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:35.845698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:35.947315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:35.948884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:36.073135 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2267/4550] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:36.150690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:36.155548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:36.267056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b764e2-3919-401b-b966-2c07b85261e1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:36.300238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:36.302197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:36.304566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:36.306625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:36.323006 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:36.367855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:36.369401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:36.416634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7b40c-57ea-4c86-bcdc-9ca8f2155d8e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:36.435883 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2284/4551] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:36.438531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:36.443201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:36.443749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:36.444302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:36.466670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:36.469281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ea598-487c-4c7a-a0fe-0a696235cba1 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:36.498449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2268/4552] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:34:37.556057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:37.560239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:37.596026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c701212-4bbf-49c2-9935-eec44d197a4f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:37.609323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:37.611836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:37.615672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:37.616691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] PATH_INFO: `/v3/users/e32cde3baf704adda1f5069f9eeec8a5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:37.621043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32cde3baf704adda1f5069f9eeec8a5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:37.626433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:37.886576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32cde3baf704adda1f5069f9eeec8a5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:37.980720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32cde3baf704adda1f5069f9eeec8a5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:37.985041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32cde3baf704adda1f5069f9eeec8a5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:38.013696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32cde3baf704adda1f5069f9eeec8a5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:38.034291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32cde3baf704adda1f5069f9eeec8a5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:38.037482 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:38.065953 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2285/4553] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:34:37 2022] DELETE /identity/v3/users/e32cde3baf704adda1f5069f9eeec8a5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:38.067840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:38.068349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:38.068468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:38.115761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:38.117362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:38.299329 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2269/4554] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:38.369900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:38.371828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:38.642054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7353a-3917-4fe8-bed7-e022f0048004 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:38.661765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:38.662418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:38.665089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:38.665432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:38.683927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:38.685636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8211b-35a1-4967-bb74-5bd64114a547 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:38.699411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2286/4555] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:39.285590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:39.288842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:39.338775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd952d88-b78f-45b7-b31c-40c568762196 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:39.374749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:39.379990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:39.382945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:39.386008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] PATH_INFO: `/v3/projects/f8b09ed07d944e85930002ff8bd6e1e6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:39.390711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b09ed07d944e85930002ff8bd6e1e6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:39.400549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:39.619154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b09ed07d944e85930002ff8bd6e1e6', 'request_id': 'req-8778cb2c-804e-4265-a9e0-316f48bdafeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:39.643756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b09ed07d944e85930002ff8bd6e1e6', 'request_id': 'req-8778cb2c-804e-4265-a9e0-316f48bdafeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:39.758145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b09ed07d944e85930002ff8bd6e1e6', 'request_id': 'req-8778cb2c-804e-4265-a9e0-316f48bdafeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:39.802948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] The token cache is being invalidate because project f8b09ed07d944e85930002ff8bd6e1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:39.803571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:39.806368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8778cb2c-804e-4265-a9e0-316f48bdafeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:39.810218 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2270/4556] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:39 2022] DELETE /identity/v3/projects/f8b09ed07d944e85930002ff8bd6e1e6 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:39.815435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:39.816043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:39.816043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:39.858143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:39.859327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:40.000786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.001069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.001388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.005517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2287/4557] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:40.053153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:40.059943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.061757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:40.068361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:40.102188 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2271/4558] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:40.103461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.136998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc457330-211e-43ad-883f-c05882524bc9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.156920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.159222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.159667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.160092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.161177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:40.163039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.166119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.191640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2272/4559] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:40.203499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.231708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04813e-cf96-480b-ab81-8c88edbe331c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.252801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.253767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.254219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.254645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.255574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.257696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.280387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a8533-a3c5-47e6-a31d-f4b3dd2854bd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.298980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.299918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.300441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.300942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.305090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:40.331484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.336286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.381661 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2288/4560] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:40.406299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2273/4561] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:40 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:40.411039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.432826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd044956-9b0a-4fa3-b3a9-31f2a9921bd7 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.516564 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:40.606147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.607019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.607401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.607796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.608546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.613098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.706586 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2289/4562] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:40 2022] POST /identity/v3/users => generated 281 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:40.707830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.723271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22228481-3cc5-4d3e-9cee-95e3f83b34d0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.741686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.742961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.743339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.743714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.744473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.747157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.775808 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2274/4563] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:40.778114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.794161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ef298-b785-4955-b4d7-ac65ad9b9cf0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.806817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.807658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.810085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.815498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.815498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.819081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16fedb-f2ac-4fa8-9e32-38c87e33d1da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:40.857403 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2290/4564] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:40.858501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:40.877400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dfcd7-e9e0-4333-8f28-78904ef19b24 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:40.904119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:40.905189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:40.907211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:40.907600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] PATH_INFO: `/v3/projects/f4e9ecaa1e4a46feb57fded718c153d8/users/97d274873bcf459aa6fc1dcb3f678ff9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:40.912922 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:40.959726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e9ecaa1e4a46feb57fded718c153d8, user_id=97d274873bcf459aa6fc1dcb3f678ff9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:40.973267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:41.072602 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2275/4565] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:40 2022] PUT /identity/v3/projects/f4e9ecaa1e4a46feb57fded718c153d8/users/97d274873bcf459aa6fc1dcb3f678ff9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:41.076542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:41.078121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:41.080383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:41.182977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] MFA Rules not processed for user `97d274873bcf459aa6fc1dcb3f678ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:41.184365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:41.390838 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2291/4566] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:41.444472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:41.446589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:41.524409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:41.524409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:41.644332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74990152-3fc7-410e-876f-9fbb1af02ddf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:41.652640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:41.653530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:41.653860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:41.654186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:41.679144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:41.680728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2dcc-ea05-4605-8efa-58bb5b75357e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:41.728784 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2276/4567] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:41.774067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4897ae-ebca-42c4-965d-709ecc4a6c8e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:41.796199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:41.800023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:41.801955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:41.802399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] PATH_INFO: `/v3/projects/1ca70c2b87994d128f42dfd458056e3e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:41.804359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca70c2b87994d128f42dfd458056e3e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:41.807870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:41.980478 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:42.010539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca70c2b87994d128f42dfd458056e3e', 'request_id': 'req-25a5119d-e8f0-4983-bf88-4d5d5b007e17'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:42.069414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca70c2b87994d128f42dfd458056e3e', 'request_id': 'req-25a5119d-e8f0-4983-bf88-4d5d5b007e17'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:42.107146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca70c2b87994d128f42dfd458056e3e', 'request_id': 'req-25a5119d-e8f0-4983-bf88-4d5d5b007e17'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:42.176567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] The token cache is being invalidate because project 1ca70c2b87994d128f42dfd458056e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:34:42.177698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:42.190998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-25a5119d-e8f0-4983-bf88-4d5d5b007e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:34:42.200557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2292/4568] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:34:41 2022] DELETE /identity/v3/projects/1ca70c2b87994d128f42dfd458056e3e => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:42.208574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:42.208866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:42.209266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:42.252861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:42.254718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:42.481822 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2277/4569] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:42.490143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:42.490502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:42.490782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:42.541692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:42.547765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:42.619522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2293/4570] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:34:42.623121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:42.639852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a91342-d878-42a4-9037-467e3695d073 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:42.675365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:42.676166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:42.676446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:42.678075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:42.681279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:34:42.685057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:42.688265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:42.749556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:42.750092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2278/4571] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:34:42.779889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3e086-b26d-4602-8285-06e8d2f6a431 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:42.792554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:42.793247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:42.802306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:42.802501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:42.809751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:42.810553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:43.070996 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2294/4572] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:42 2022] POST /identity/v3/projects => generated 407 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:34:43.075086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:43.088098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1989c-f8a8-4334-ab23-bcaa9cc99261 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:43.342600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:43.343234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:43.343508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:43.343777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:43.344413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:43.350780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:43.457716 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2279/4573] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:43 2022] POST /identity/v3/users => generated 304 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:43.461725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:43.491063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47505d-5f93-4dd7-ad31-80b03e5c2a4d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:43.522852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:43.523487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:43.523766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:43.524039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:43.525814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:43.531068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:43.581991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2295/4574] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:43.583499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:43.590275 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:43.606630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ba14c-77f2-4961-90ae-8e734e7d202f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:43.631527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:43.638757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:43.638757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:43.638757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:43.638757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:43.640712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a1183-1406-40b6-a64a-eaba2f76d4bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:43.689797 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2280/4575] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:34:43.692659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:43.720214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b53a1-a73f-4b43-9ded-5b923c04ca6a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:43.740524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:43.743465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:43.744629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:43.745169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] PATH_INFO: `/v3/projects/2df1ea5044f445529d2e4f91ed7d28e5/users/b134d7db20ea4ecdb6dac5ce88138fb7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:43.836859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df1ea5044f445529d2e4f91ed7d28e5, user_id=b134d7db20ea4ecdb6dac5ce88138fb7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:43.840167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:43.969956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2296/4576] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:43 2022] PUT /identity/v3/projects/2df1ea5044f445529d2e4f91ed7d28e5/users/b134d7db20ea4ecdb6dac5ce88138fb7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:43.972707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:43.973032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:43.973570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:44.077021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] MFA Rules not processed for user `b134d7db20ea4ecdb6dac5ce88138fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:44.078808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:44.317317 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2281/4577] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:43 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:44.322890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:44.551902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551675d0-094e-4da0-a42a-33269e59cd44 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:44.567303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:44.568269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:44.568714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:44.569267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:44.570094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:44.575052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:44.712724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2297/4578] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:44 2022] POST /identity/v3/projects => generated 405 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:44.717037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:44.740761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f7f9-124c-4c25-aab9-2b7af2f90766 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:44.912611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:44.916873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:44.919887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:44.920295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:44.922904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:44.934461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:45.026651 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2282/4579] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:44 2022] POST /identity/v3/users => generated 309 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:45.030763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:45.067053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bd0d-15a8-45c8-a488-dcf2b673eb9a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:45.077235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:45.078844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.079522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.080582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:45.082582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:45.088094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:45.141990 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2298/4580] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:45.144500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:45.159043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba7dc6-dc3f-4fd1-99d6-ae53d907308b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:45.172922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:45.174431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.174879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.175317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] PATH_INFO: `/v3/projects/95f74471363d4a53909fd1fb08afd569/users/d537f65678fc43359f5d3263f1f3d082/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:45.234289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f74471363d4a53909fd1fb08afd569, user_id=d537f65678fc43359f5d3263f1f3d082, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:45.241831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:45.320624 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2283/4581] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:45 2022] PUT /identity/v3/projects/95f74471363d4a53909fd1fb08afd569/users/d537f65678fc43359f5d3263f1f3d082/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:45.325099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:45.346902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afa7f5-efd0-4c9b-800d-e2717d3dcc56 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:45.432164 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:45.498817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:45.499429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.499694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.499963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:45.502890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:45.509484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9057eb-16b0-434e-8f00-0c1628d00605 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:45.525888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2299/4582] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:45.530208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:45.541402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373a49a-751d-4619-b492-70fad16de16e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:45.566517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:45.566856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.567152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.567413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] PATH_INFO: `/v3/projects/95f74471363d4a53909fd1fb08afd569/users/d537f65678fc43359f5d3263f1f3d082/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:45.569756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f74471363d4a53909fd1fb08afd569, user_id=d537f65678fc43359f5d3263f1f3d082, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:45.572734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:45.602065 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2284/4583] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:45 2022] PUT /identity/v3/projects/95f74471363d4a53909fd1fb08afd569/users/d537f65678fc43359f5d3263f1f3d082/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:34:45.604242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daa5f5-0c45-4adc-9ff1-7c6c24f8cd9b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.604529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daa5f5-0c45-4adc-9ff1-7c6c24f8cd9b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.604805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daa5f5-0c45-4adc-9ff1-7c6c24f8cd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:45.672746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-66daa5f5-0c45-4adc-9ff1-7c6c24f8cd9b None None] MFA Rules not processed for user `d537f65678fc43359f5d3263f1f3d082`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:45.674591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-66daa5f5-0c45-4adc-9ff1-7c6c24f8cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:45.827560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2300/4584] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:45.846530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:45.849372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:45.931859 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:45.973429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8699-e646-407e-99e3-9fc6f2821c4b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:45.992897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:45.993618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:45.993910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:45.994156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:46.161936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:46.163397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:46.185725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2285/4585] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:45 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:47.227680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:47.228229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:47.228229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:47.315772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] MFA Rules not processed for user `dcdd7b99e5a94490b604d2e10545a658`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:47.317316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:47.532609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2301/4586] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:47.537034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:47.544446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:47.649296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f1ac9-9bbc-4555-935f-bbe3ad3b1933 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:47.654893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:47.655532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:47.656129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:47.656411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:47.657109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:47.659630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:47.764921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2286/4587] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:34:47 2022] POST /identity/v3/projects => generated 405 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:47.766128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:47.800587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d394-0922-4249-9cc6-c3fa96f79c34 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:47.959764 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:48.010213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:48.010213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:48.010213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:48.010213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:48.010699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:48.010792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:48.139938 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2302/4588] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:34:47 2022] POST /identity/v3/users => generated 303 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:34:48.141186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:48.154940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce455de-80eb-43f6-8dd6-adfe7eefe393 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:48.168030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:48.168841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:48.169300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:48.169970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:48.170977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:48.173004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:48.206460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:48.207136 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2287/4589] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:34:48.229327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df395378-1a9f-4e60-89f8-5baf7285531a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:48.247635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:48.249913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:48.250971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:48.251728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:48.252730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:48.256027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:48.274318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:48.281770 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2303/4590] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:34:48.287526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365ae8d-d6fe-43db-b3a8-0a1ae11d3d84 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:48.302021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:48.303032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:48.303306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:48.303614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] PATH_INFO: `/v3/projects/7f95b6c505774d48a442b9b2ce22de13/users/7f9d7169927f4bc2b7ff51ba20cc70a7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:48.322980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f95b6c505774d48a442b9b2ce22de13, user_id=7f9d7169927f4bc2b7ff51ba20cc70a7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:48.326854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45051db-8036-4557-a94e-29ff2567a9ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:48.419677 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2288/4591] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:34:48 2022] PUT /identity/v3/projects/7f95b6c505774d48a442b9b2ce22de13/users/7f9d7169927f4bc2b7ff51ba20cc70a7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:34:48.667558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:48.669367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:48.825492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a938-38bf-4781-8af6-da32c2caa637 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:48.967674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:48.968642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:48.969293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:48.969845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:49.124454 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:49.131832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:49.133214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:49.166923 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2304/4592] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:52.900588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f853be5-96cb-4d42-9d7a-7f447364fb7f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:52.902176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f853be5-96cb-4d42-9d7a-7f447364fb7f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:52.902696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f853be5-96cb-4d42-9d7a-7f447364fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:52.961705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6f853be5-96cb-4d42-9d7a-7f447364fb7f None None] MFA Rules not processed for user `01e5e100d57a4513b10a601644e242c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:52.967983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f853be5-96cb-4d42-9d7a-7f447364fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.035732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:53.040321 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:34:53.063148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbd499-b7f9-450c-8d81-416d69a9af7b service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:53.084288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:53.085503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:53.094027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:53.094027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:53.094027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.126947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:53.128938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:53.161933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2305/4593] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:34:53.273311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2289/4594] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:53.273542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:53.273542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.283387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823c04-f624-4305-8907-747fe95be905 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:53.283691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823c04-f624-4305-8907-747fe95be905 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:53.283973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823c04-f624-4305-8907-747fe95be905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:53.345888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d7823c04-f624-4305-8907-747fe95be905 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:34:53.352272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7823c04-f624-4305-8907-747fe95be905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.495571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd517369-db95-48c0-8a49-bfb31c1434fa service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:53.505233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:53.505958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:53.506279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:53.506562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:53.508620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.515362 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2290/4595] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:34:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:34:53.543084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7823c04-f624-4305-8907-747fe95be905 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:34:53.544549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7823c04-f624-4305-8907-747fe95be905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:34:53.722750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:53.724977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cf0da-1c24-4fcf-ba97-090848bf8d50 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:53.742682 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2306/4596] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:34:53.785580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7823c04-f624-4305-8907-747fe95be905 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:34:53.794348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:34:53.795260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:34:53.795607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:34:53.795881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:34:53.809664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:34:53.812833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95869-9196-4dce-91a8-d3911a29532b service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:34:53.853208 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2291/4597] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:35:03.731588 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=65 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:03.820723 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=74 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:09.539432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:09.542738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:09.542738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:09.622080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] MFA Rules not processed for user `7f9d7169927f4bc2b7ff51ba20cc70a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:09.627681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:09.801721 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2307/4598] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:09.811575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:09.812669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:09.813464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:09.838480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] MFA Rules not processed for user `dcdd7b99e5a94490b604d2e10545a658`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:09.842742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:09.882882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:09.884775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.044899 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2292/4599] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:10.044899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:10.047281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.094115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4e02-c60a-4754-b733-e662340e1016 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:10.103699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:10.104797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:10.107234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:10.107600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] PATH_INFO: `/v3/users/83a42fb6fe574e7791b826c7aba66e54` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:10.112532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a42fb6fe574e7791b826c7aba66e54)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:10.114588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:10.278840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7924b-1dce-48de-811b-77b25187f8ab None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:10.295162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:10.297818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:10.298103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:10.298382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] PATH_INFO: `/v3/users/6f7675c0fa214588b71c04ca120557fc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:10.301877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7675c0fa214588b71c04ca120557fc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:10.305914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a42fb6fe574e7791b826c7aba66e54'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.307979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:10.372970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a42fb6fe574e7791b826c7aba66e54'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.377942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a42fb6fe574e7791b826c7aba66e54'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.396825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a42fb6fe574e7791b826c7aba66e54'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.413152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a42fb6fe574e7791b826c7aba66e54'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.426405 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2308/4600] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:09 2022] DELETE /identity/v3/users/83a42fb6fe574e7791b826c7aba66e54 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:35:10.427902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:10.431738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.465362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:10.596866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7675c0fa214588b71c04ca120557fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.598157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7675c0fa214588b71c04ca120557fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.616278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7675c0fa214588b71c04ca120557fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.618296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7675c0fa214588b71c04ca120557fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.630552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f55a56-e1ee-417e-b6c9-db708fcd1c2e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:10.657439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:10.658344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:10.658805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:10.659249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:10.667265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.693402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7675c0fa214588b71c04ca120557fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:10.736788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2293/4601] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:10 2022] DELETE /identity/v3/users/6f7675c0fa214588b71c04ca120557fc => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:10.737973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:10.746822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.838886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:10.840358 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:10.841230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e8585-eb04-4b38-836f-fe6f877d1100 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:10.860555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2309/4602] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:10.863564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:10.863677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:10.863886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:10.951481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b0c9-386e-486f-a0bf-a5f1aa306fde admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:10.957730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:10.960874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:10.961704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:10.962227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:10.962611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] PATH_INFO: `/v3/users/b134d7db20ea4ecdb6dac5ce88138fb7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:10.967789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:10.969496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b134d7db20ea4ecdb6dac5ce88138fb7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:10.980728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:11.019904 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2310/4603] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:11.031316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:11.032867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:11.210885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712b55-587e-4c47-9521-5c05b4392c0a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:11.221150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:11.223728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:11.224055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:11.224338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:11.282681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b134d7db20ea4ecdb6dac5ce88138fb7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.286520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b134d7db20ea4ecdb6dac5ce88138fb7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.294702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:11.305634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:11.312795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b134d7db20ea4ecdb6dac5ce88138fb7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.316906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b134d7db20ea4ecdb6dac5ce88138fb7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.344772 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2311/4604] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:11.347228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:11.354197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:11.393230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220ea0e-a691-4a92-8670-b1e046b2aea9 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:11.407415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:11.408065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:11.408345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:11.408618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] PATH_INFO: `/v3/projects/2b509d1b9c324201942dfeb350611a44` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:11.409813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b509d1b9c324201942dfeb350611a44)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:11.411750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:11.415694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35e94bd8-02d9-42f5-a5e1-416dc4cbbc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b134d7db20ea4ecdb6dac5ce88138fb7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.479348 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2294/4605] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:10 2022] DELETE /identity/v3/users/b134d7db20ea4ecdb6dac5ce88138fb7 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:11.484676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:11.484973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:11.485248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:11.510135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:11.511373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:11.576311 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:11.598272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b509d1b9c324201942dfeb350611a44', 'request_id': 'req-7aa60d43-78cb-4963-a1a2-788e052e2463'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.667649 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2295/4606] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:11.697705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:11.700562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:11.704020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b509d1b9c324201942dfeb350611a44', 'request_id': 'req-7aa60d43-78cb-4963-a1a2-788e052e2463'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.721593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b509d1b9c324201942dfeb350611a44', 'request_id': 'req-7aa60d43-78cb-4963-a1a2-788e052e2463'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.748810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] The token cache is being invalidate because project 2b509d1b9c324201942dfeb350611a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:11.749181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.749942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7aa60d43-78cb-4963-a1a2-788e052e2463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:11.752258 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2312/4607] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:11 2022] DELETE /identity/v3/projects/2b509d1b9c324201942dfeb350611a44 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:11.757180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337d1c-2945-497b-ac2c-f528520902c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:11.757654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337d1c-2945-497b-ac2c-f528520902c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:11.757994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337d1c-2945-497b-ac2c-f528520902c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:11.841097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a2337d1c-2945-497b-ac2c-f528520902c3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:11.845775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a2337d1c-2945-497b-ac2c-f528520902c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:11.882941 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:11.916355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137977-6e4c-4fdf-8870-c5ba54c815b1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.115436 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2313/4608] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:12.127674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.129206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.129979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.149116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.149845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.150149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.150452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.161982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:12.186847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.189486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.201816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:12.208571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:12.226781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2296/4609] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:12.241279 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2314/4610] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:12.247593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.272283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207aadb-6a3a-4ab8-931c-3f320568b6ab service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.291099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.310702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.332461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2297/4611] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:12.337123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.350954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971557b-ee66-4e55-bf75-663574e54e0a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.370623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.371450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.371852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.372257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.372994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.375649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.485821 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2315/4612] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:12 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:12.489940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.516159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017eb4-15f4-4f8a-8e8f-16b878a3c6a1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.609905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.610955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.611315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.611484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.612228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.618741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.776115 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2298/4613] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:12 2022] POST /identity/v3/users => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:12.789390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.813143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330e27-61df-44a0-a83f-cf1e4d95a0e0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.821280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.821970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.822448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.822720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.823378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.825491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.847424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2316/4614] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:12.848780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.860524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f9fa5-dc44-4ce9-92aa-2b303caed73c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.866051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.866767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.867130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.867549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.868320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.870404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:12.886723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2299/4615] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:12.888034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:12.910407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cac51-7901-4be2-a31a-e3037282b751 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:12.920622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:12.921385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:12.921674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:12.921956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] PATH_INFO: `/v3/projects/3681dc37f3034258ae3182a07012bddc/users/d8ced0434b2841c5986fdf30906055a2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:12.959268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3681dc37f3034258ae3182a07012bddc, user_id=d8ced0434b2841c5986fdf30906055a2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:12.959268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105e3e8-ceb9-4ad9-b76a-d6b89e2f7b22 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:13.002599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:13.005738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:13.055203 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2317/4616] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:12 2022] PUT /identity/v3/projects/3681dc37f3034258ae3182a07012bddc/users/d8ced0434b2841c5986fdf30906055a2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:13.057899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0a4a6-06c0-4dd4-b1a2-030d4cc6903a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:13.070350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.070648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.070923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.152129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] MFA Rules not processed for user `d8ced0434b2841c5986fdf30906055a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:13.156822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:13.190449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:13.191730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.192025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.193538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] PATH_INFO: `/v3/projects/5ec1af43d24a4c9a9ec72686113b045f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.204259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec1af43d24a4c9a9ec72686113b045f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:13.215729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:13.253804 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:13.331888 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:13.418603 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2318/4617] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:13.427654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:13.446066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec1af43d24a4c9a9ec72686113b045f', 'request_id': 'req-4e7955c4-6964-4116-9694-4b7a12705f4e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.463692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec1af43d24a4c9a9ec72686113b045f', 'request_id': 'req-4e7955c4-6964-4116-9694-4b7a12705f4e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.464643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bae182-17ef-4ae6-a763-abb895cf6188 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:13.518927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec1af43d24a4c9a9ec72686113b045f', 'request_id': 'req-4e7955c4-6964-4116-9694-4b7a12705f4e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.541297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] The token cache is being invalidate because project 5ec1af43d24a4c9a9ec72686113b045f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:13.541637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.543483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e7955c4-6964-4116-9694-4b7a12705f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.547634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2300/4618] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:13 2022] DELETE /identity/v3/projects/5ec1af43d24a4c9a9ec72686113b045f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:35:13.553706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56394-aabb-4863-b6e2-bf625f3f61a4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.554235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56394-aabb-4863-b6e2-bf625f3f61a4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.554810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56394-aabb-4863-b6e2-bf625f3f61a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.617443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-69d56394-aabb-4863-b6e2-bf625f3f61a4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:13.617443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-69d56394-aabb-4863-b6e2-bf625f3f61a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:13.647077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:13.648022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.648453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.649438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] PATH_INFO: `/v3/users/d8ced0434b2841c5986fdf30906055a2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.650199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ced0434b2841c5986fdf30906055a2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:13.652459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:13.788654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2301/4619] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:13.811747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.815521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.815521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.864027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:13.865308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:13.879144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2302/4620] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:13.880530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:13.890961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aca1e-4195-4b6b-b857-f8112e0fee16 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:13.902965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:13.903710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.904629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.904629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.905386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:13.906374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:13.908217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:13.943712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ced0434b2841c5986fdf30906055a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:13.947641 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2303/4621] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:13.952251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:13.973150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451f030-c11c-46f9-ac4c-fa0103286093 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:13.988402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:13.988974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:13.989250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:13.989549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:13.990191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:13.992116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0babc-d662-4816-9044-40e3cff4cf64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:14.029933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ced0434b2841c5986fdf30906055a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.031698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ced0434b2841c5986fdf30906055a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.072970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ced0434b2841c5986fdf30906055a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.109376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ced0434b2841c5986fdf30906055a2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.124806 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2319/4622] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:13 2022] DELETE /identity/v3/users/d8ced0434b2841c5986fdf30906055a2 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:14.126241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:14.132042 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2304/4623] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:13 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:14.133773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:14.134237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:14.138116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:14.142199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:14.188062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:14.194849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:14.344472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58afa2-a9c3-4b7c-96e7-da7ca0ec92c1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:14.386883 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:14.415704 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:14.448564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2305/4624] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:14.451321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:14.455799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:14.494225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:14.494923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc252-8549-497e-a8d8-ab4a6c6be708 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:14.495420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:14.495816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:14.496179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] PATH_INFO: `/v3/projects/2df1ea5044f445529d2e4f91ed7d28e5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:14.497875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df1ea5044f445529d2e4f91ed7d28e5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:14.511451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:14.514022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:14.540119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:14.540119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:14.540119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:14.540119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:14.540119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:14.676018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df1ea5044f445529d2e4f91ed7d28e5', 'request_id': 'req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.716895 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2306/4625] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:14 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:14.720237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:14.725770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:14.772638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df1ea5044f445529d2e4f91ed7d28e5', 'request_id': 'req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.782155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df1ea5044f445529d2e4f91ed7d28e5', 'request_id': 'req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.827223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] The token cache is being invalidate because project 2df1ea5044f445529d2e4f91ed7d28e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:14.827223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.827554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:14.837377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2320/4626] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:14 2022] DELETE /identity/v3/projects/2df1ea5044f445529d2e4f91ed7d28e5 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:14.837377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:14.837957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:14.961133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07460f2-a261-4e79-892e-95d27f4e1346 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.050830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c520-8926-499e-a7bd-0c9c5db46cf8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.052074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.052943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.055909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.055909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.055909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.058417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.081191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2321/4627] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:15.081877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:15.087280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:15.117769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.118409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.120056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.120330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.140470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:15.143454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610509b-132c-48db-aab6-3ca26285861a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.163858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.167493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.167493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.167493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] PATH_INFO: `/v3/users/d537f65678fc43359f5d3263f1f3d082` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.172091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d537f65678fc43359f5d3263f1f3d082)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.175253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.213790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.215355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.248287 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2307/4628] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:15.250540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:15.266518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c6064-87fc-4704-9562-1dec4a61dd3c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.271688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.272315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.272595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.273315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.274057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.275739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.295366 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2308/4629] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:15.302220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:15.317861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3fa6c-1f1d-46d7-8316-204ef3ca271f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.336109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.337220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.337755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.338547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] PATH_INFO: `/v3/projects/176c24f936764c29b222d96c3864ad90/users/b8970624bde14a879846362e124c9c80/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.373345 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:15.386925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd537f65678fc43359f5d3263f1f3d082'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:15.390026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176c24f936764c29b222d96c3864ad90, user_id=b8970624bde14a879846362e124c9c80, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.393510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53141d9c-0081-4630-8de0-4be740eee957 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.453032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd537f65678fc43359f5d3263f1f3d082'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:15.453747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd537f65678fc43359f5d3263f1f3d082'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:15.483145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd537f65678fc43359f5d3263f1f3d082'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:15.488223 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2309/4630] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:15 2022] PUT /identity/v3/projects/176c24f936764c29b222d96c3864ad90/users/b8970624bde14a879846362e124c9c80/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:15.495365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd537f65678fc43359f5d3263f1f3d082'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:15.501011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.501766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.502308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.533125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2322/4631] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:15 2022] DELETE /identity/v3/users/d537f65678fc43359f5d3263f1f3d082 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:15.582674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] MFA Rules not processed for user `b8970624bde14a879846362e124c9c80`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:15.584275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:15.698674 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:15.717809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2310/4632] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:15.733611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:15.737606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:15.815166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706ca22-bbaa-436c-9774-bfc6be5d0432 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:15.820317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:15.820929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:15.821219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:15.821511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:15.872349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:15.874132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:15.919814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2323/4633] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:15.928142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:15.932414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.126479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b8bf3-7845-4c09-9212-1723f9700179 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.159148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.160000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.160344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.160633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] PATH_INFO: `/v3/projects/95f74471363d4a53909fd1fb08afd569` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.163739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f74471363d4a53909fd1fb08afd569)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.165857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:16.231489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:16.231489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.264610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784e47c-bc19-4cb2-9148-fc74298bdc39 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.271707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.277192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.277192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.277192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] PATH_INFO: `/v3/projects/3681dc37f3034258ae3182a07012bddc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.277192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3681dc37f3034258ae3182a07012bddc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.277743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:16.369108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f74471363d4a53909fd1fb08afd569', 'request_id': 'req-96dc6e80-8c83-4c62-9bea-2aa26b150faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.384595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f74471363d4a53909fd1fb08afd569', 'request_id': 'req-96dc6e80-8c83-4c62-9bea-2aa26b150faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.503992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f74471363d4a53909fd1fb08afd569', 'request_id': 'req-96dc6e80-8c83-4c62-9bea-2aa26b150faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.510914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3681dc37f3034258ae3182a07012bddc', 'request_id': 'req-4b61abdc-2088-4505-b456-7cc986f6faa6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.528088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] The token cache is being invalidate because project 95f74471363d4a53909fd1fb08afd569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:16.530748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.533714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96dc6e80-8c83-4c62-9bea-2aa26b150faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.542536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2311/4634] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:15 2022] DELETE /identity/v3/projects/95f74471363d4a53909fd1fb08afd569 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:16.544931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224450-0c10-45c2-af99-b91242c1dffe None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.546166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224450-0c10-45c2-af99-b91242c1dffe None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.546646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224450-0c10-45c2-af99-b91242c1dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.586575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2e224450-0c10-45c2-af99-b91242c1dffe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:16.588413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e224450-0c10-45c2-af99-b91242c1dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.618394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3681dc37f3034258ae3182a07012bddc', 'request_id': 'req-4b61abdc-2088-4505-b456-7cc986f6faa6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.628309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3681dc37f3034258ae3182a07012bddc', 'request_id': 'req-4b61abdc-2088-4505-b456-7cc986f6faa6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.659684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] The token cache is being invalidate because project 3681dc37f3034258ae3182a07012bddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:16.660492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.662078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b61abdc-2088-4505-b456-7cc986f6faa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:16.667966 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2324/4635] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:16 2022] DELETE /identity/v3/projects/3681dc37f3034258ae3182a07012bddc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:16.675726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335bc8-4b1c-4002-8e61-c728e0e2cbef None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.682439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2312/4636] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:16.684763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.685317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.685801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.685949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335bc8-4b1c-4002-8e61-c728e0e2cbef None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.687472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335bc8-4b1c-4002-8e61-c728e0e2cbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.714854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:16.716563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.728699 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2313/4637] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:16.735264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f9335bc8-4b1c-4002-8e61-c728e0e2cbef None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:16.759461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9335bc8-4b1c-4002-8e61-c728e0e2cbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.759461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2325/4638] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:16.759709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:16.765585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.765945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.766284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.791371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4140-67c1-42f8-9b8e-ff2b75201205 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.800619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.801412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.801963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.802345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.803132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:16.803547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.805591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:16.822738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:16.824336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:16.839405 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2314/4639] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:16.841069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:16.848896 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2326/4640] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:16.855373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:16.860664 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:16.884849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbb044-d326-4b29-9b0d-e762171c2023 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.892730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc01d56-88c0-45e7-ab4e-0a01dadc9c21 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.899166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.900092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.900488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.900857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.903477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.911093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:16.916812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.917497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.917831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.918442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.919194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:16.919635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.921946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:16.940802 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2327/4641] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:16.945304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:16.968921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf69d75-8e13-4fbe-9606-2abc9af37825 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:16.985979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:16.986613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:16.987527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:16.987527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:16.988137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:16.990166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:17.016152 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:17.819731 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2328/4642] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/projects => generated 377 bytes in 875 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:17.823985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:17.836026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2315/4643] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:16 2022] POST /identity/v3/projects => generated 391 bytes in 996 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:17.839227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:17.982476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07419-a8e4-4bbc-bfba-2ea4360f7601 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.060031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f5e13-6fcb-4d95-a265-ffa6063c6925 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.068181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.069496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.069936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.070378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.071629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.073997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.088142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.092516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.092903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.093212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.097320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.099493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.253027 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2316/4644] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:17 2022] POST /identity/v3/users => generated 296 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:18.261997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.266399 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2329/4645] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:17 2022] POST /identity/v3/users => generated 289 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:18.275228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.290782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31f0fe-ef3b-4181-918d-023550d9d29e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.302331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.304136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7dfd-de73-483d-8f19-9419c1b30713 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.304250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.304250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.304250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.304643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.306420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.313240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.314142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.314584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.315067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.315993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.318671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.343321 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2330/4646] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:35:18.344303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.368934 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2317/4647] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:18.373193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.384478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3367b9-54d0-4f58-be38-b7f710d37a09 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.386794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cad5-08bc-4edf-ac5a-ca65531bcb6c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.390107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.390924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.391594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.392020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.393195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.397131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.401653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.403298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.403995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.405086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.408649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.412251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.430177 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2331/4648] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:18.431336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.446940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2318/4649] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:35:18.457237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.466343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88ef3b-8c19-4ce3-af9e-00414d947e49 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.473857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c1f52-1d7f-4935-ac4d-48d06d97ba49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.478285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.479708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.480827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.481909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] PATH_INFO: `/v3/projects/7c1e4ce82aba40a2a013f2d107877b72/users/aba3c4de99ec4a5aae6fb006ab89fdb9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.487217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.495550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.495550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.495550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] PATH_INFO: `/v3/projects/9f7b356c884a4706822ce5e8768c0bc9/users/6043c4ed6bee4acbb037ab0e833ef9be/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.518741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1e4ce82aba40a2a013f2d107877b72, user_id=aba3c4de99ec4a5aae6fb006ab89fdb9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.526215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c247b7-b314-4ffe-91d2-ecc5c470456e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.531946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7b356c884a4706822ce5e8768c0bc9, user_id=6043c4ed6bee4acbb037ab0e833ef9be, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:18.535257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb26f7-77db-4d90-9ca9-9399f1035324 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:18.656669 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2332/4650] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:18 2022] PUT /identity/v3/projects/7c1e4ce82aba40a2a013f2d107877b72/users/aba3c4de99ec4a5aae6fb006ab89fdb9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:35:18.661654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.662126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.664616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.668305 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2319/4651] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:18 2022] PUT /identity/v3/projects/9f7b356c884a4706822ce5e8768c0bc9/users/6043c4ed6bee4acbb037ab0e833ef9be/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:18.672013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.672013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.672411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.742576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:18.743979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:18.759597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] MFA Rules not processed for user `6043c4ed6bee4acbb037ab0e833ef9be`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:18.763801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:18.912981 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2333/4652] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:18.943562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.949500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2320/4653] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:18.956904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da150f8-cc83-4409-9c6a-a47c7583f2f7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:18.973691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:18.975235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:18.989214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:18.997721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:18.998037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:18.998447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:18.999053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.003304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.071187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65202b3-582a-4461-8d6a-b1699207aaf1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.076280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.076981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.077391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.077672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.098480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.100516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.115341 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2321/4654] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:19.140892 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2334/4655] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:18 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:19.146408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:19.154826 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:19.161099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae2cb-8bf4-49c5-83b2-75adc4395bff service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.271684 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:19.314001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.317552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.318168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.318627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.319497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.324948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.445872 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2322/4656] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:19 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:19.446662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:19.469128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695553a-200f-4fa8-8626-4148b6c5a51d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.491077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.491714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.492072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.492349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.493062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.495614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.526753 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2335/4657] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:19.527748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:19.542173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d75c-53d4-4f07-83e9-59773affc21e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.554408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.555089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.555448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.555714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] PATH_INFO: `/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea/users/614d1f9a11f94850b1d5838b5561a2f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.595345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0dcc1a06a84ede84d64f0dcaa061ea, user_id=614d1f9a11f94850b1d5838b5561a2f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.598544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.695058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2323/4658] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:19 2022] PUT /identity/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea/users/614d1f9a11f94850b1d5838b5561a2f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:19.699007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:19.713189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ea2e5-17f8-4a88-8787-c4b1b8d6c24d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.854311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.855001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.855287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.855558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.856201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.857829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c940e1-4a8d-447f-b182-4b5f4c9a9195 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.885687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2336/4659] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:19.900541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:19.917953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76f738-4ff8-46d1-84c5-26802facf81f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:19.929879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:19.930614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.930901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.931207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] PATH_INFO: `/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea/users/614d1f9a11f94850b1d5838b5561a2f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:19.933157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0dcc1a06a84ede84d64f0dcaa061ea, user_id=614d1f9a11f94850b1d5838b5561a2f1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:19.935925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:19.962313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2324/4660] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:19 2022] PUT /identity/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea/users/614d1f9a11f94850b1d5838b5561a2f1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:19.973398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:19.973906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:19.974005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:20.029481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] MFA Rules not processed for user `614d1f9a11f94850b1d5838b5561a2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:20.031251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:20.197403 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2337/4661] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:20.231353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:20.238938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:20.434277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b630-c5f7-4b32-b860-e3448f1cdaff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:20.459012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:20.459012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:20.459379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:20.459473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:20.476024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:20.477531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14b7ab-d2c4-4908-84be-0d132c04cba6 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:20.502888 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2325/4662] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:28.662494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:28.770014 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:28.852708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a02ab-1f6d-46f3-b829-e3a678a1d9b1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:28.865197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:28.865880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:28.866157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:28.866422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] PATH_INFO: `/v3/users/6043c4ed6bee4acbb037ab0e833ef9be` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:28.870692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6043c4ed6bee4acbb037ab0e833ef9be)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:28.872824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:29.222450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6043c4ed6bee4acbb037ab0e833ef9be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:29.360854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6043c4ed6bee4acbb037ab0e833ef9be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:29.362030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6043c4ed6bee4acbb037ab0e833ef9be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:29.394777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6043c4ed6bee4acbb037ab0e833ef9be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:29.412262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6043c4ed6bee4acbb037ab0e833ef9be'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:29.424295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2338/4663] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:28 2022] DELETE /identity/v3/users/6043c4ed6bee4acbb037ab0e833ef9be => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:29.428978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:29.429534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:29.429708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:29.466661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:29.472723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:29.493259 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:29.609229 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2326/4664] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:29.648251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:29.649003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:29.786635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7977a-2435-4b22-81b2-a903da85a6d2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:29.800345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:29.801163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:29.801492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:29.801859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:29.823395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:29.824977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a28906-376b-43df-bfda-ddbf12a1dbc7 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:29.851133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2339/4665] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:30.209998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:30.210956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:30.246729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109ac2-3a3f-4141-ab76-624451fa4b90 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:30.255629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:30.256283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:30.256558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:30.256828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] PATH_INFO: `/v3/users/97d274873bcf459aa6fc1dcb3f678ff9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:30.258392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d274873bcf459aa6fc1dcb3f678ff9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:30.259921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:30.600288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d274873bcf459aa6fc1dcb3f678ff9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:30.600992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d274873bcf459aa6fc1dcb3f678ff9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:30.616622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d274873bcf459aa6fc1dcb3f678ff9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:30.617624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d274873bcf459aa6fc1dcb3f678ff9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:30.743129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d274873bcf459aa6fc1dcb3f678ff9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:30.778050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2327/4666] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:30 2022] DELETE /identity/v3/users/97d274873bcf459aa6fc1dcb3f678ff9 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:35:30.782654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:30.782995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:30.783277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:30.808930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:30.810566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:30.927688 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:30.963108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2340/4667] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:31.037092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:31.039371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:31.235585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0077d0-d3a1-4ee3-ab3e-cf74ae1b420e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:31.251495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:31.252212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:31.252629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:31.253175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:31.283095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:31.286038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:31.299120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:31.300581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:31.322968 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2328/4668] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:31.343871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0e2c8-627e-4c54-80eb-8789edcb2c05 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:31.370761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:31.372331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:31.372779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:31.373692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] PATH_INFO: `/v3/projects/9f7b356c884a4706822ce5e8768c0bc9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:31.378350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7b356c884a4706822ce5e8768c0bc9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:31.380818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:31.588010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7b356c884a4706822ce5e8768c0bc9', 'request_id': 'req-8b65c3a9-4a2f-4164-b958-058e99eb9b15'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:31.755413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7b356c884a4706822ce5e8768c0bc9', 'request_id': 'req-8b65c3a9-4a2f-4164-b958-058e99eb9b15'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:31.765491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7b356c884a4706822ce5e8768c0bc9', 'request_id': 'req-8b65c3a9-4a2f-4164-b958-058e99eb9b15'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:31.794209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] The token cache is being invalidate because project 9f7b356c884a4706822ce5e8768c0bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:31.795746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:31.796756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:31.804029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:31.815918 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2341/4669] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:31 2022] DELETE /identity/v3/projects/9f7b356c884a4706822ce5e8768c0bc9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:31.818817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ef068-1988-4587-aeb8-cc803382510e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:31.885768 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:31.943919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:31.944668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:31.944955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:31.945232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] PATH_INFO: `/v3/users/614d1f9a11f94850b1d5838b5561a2f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:31.946607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614d1f9a11f94850b1d5838b5561a2f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:31.948796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:32.195811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614d1f9a11f94850b1d5838b5561a2f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.197063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614d1f9a11f94850b1d5838b5561a2f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.212088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614d1f9a11f94850b1d5838b5561a2f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.214464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614d1f9a11f94850b1d5838b5561a2f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.233236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:32.235055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:32.263025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65c3a9-4a2f-4164-b958-058e99eb9b15 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:32.284161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:32.284953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:32.285241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:32.287341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] PATH_INFO: `/v3/projects/f4e9ecaa1e4a46feb57fded718c153d8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:32.299423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e9ecaa1e4a46feb57fded718c153d8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:32.307183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b7697300-70cd-4ba9-8a7f-e40100efb525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614d1f9a11f94850b1d5838b5561a2f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.308711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:32.382765 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2329/4670] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:31 2022] DELETE /identity/v3/users/614d1f9a11f94850b1d5838b5561a2f1 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:32.567241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e9ecaa1e4a46feb57fded718c153d8', 'request_id': 'req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.709838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e9ecaa1e4a46feb57fded718c153d8', 'request_id': 'req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.713866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e9ecaa1e4a46feb57fded718c153d8', 'request_id': 'req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.731334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] The token cache is being invalidate because project f4e9ecaa1e4a46feb57fded718c153d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:32.732064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.733991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94084cc4-e4e3-4d82-9b70-cbea4655ccaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:32.735903 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2342/4671] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:32 2022] DELETE /identity/v3/projects/f4e9ecaa1e4a46feb57fded718c153d8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:32.741123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:32.741449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:32.742034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:32.792445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:32.794396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:32.903496 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2330/4672] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:32.918003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:32.919468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:32.920530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:32.951752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:32.953576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:32.967513 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2343/4673] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:32.969933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:32.985434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8f17-3dcc-4e31-8913-df024a3f40ba None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.002053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.002825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.003115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.003395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.004069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:33.013611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.013814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.047063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.051794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2331/4674] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:33.062132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608cef-bd0d-496a-8cfd-21f26d7b551d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.068225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.069083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.069748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.070214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.071041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.073754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.170419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.172361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:33.192905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65843d7c-ed0b-4fea-a376-b6b23a04826d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.204441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.205489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.206702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.207490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] PATH_INFO: `/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.209775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0dcc1a06a84ede84d64f0dcaa061ea)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.212038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.256878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2344/4675] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:33 2022] POST /identity/v3/projects => generated 359 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:33.261289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.372619 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:33.484589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c3ee1-d771-4d11-9249-9bc1947bfb6a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.508838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0dcc1a06a84ede84d64f0dcaa061ea', 'request_id': 'req-63d9a7dc-c5f4-410b-91bf-c6864895d58e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:33.527060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0dcc1a06a84ede84d64f0dcaa061ea', 'request_id': 'req-63d9a7dc-c5f4-410b-91bf-c6864895d58e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:33.618185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.619415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.619870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.621495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.622315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.625369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.629067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0dcc1a06a84ede84d64f0dcaa061ea', 'request_id': 'req-63d9a7dc-c5f4-410b-91bf-c6864895d58e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:33.650642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] The token cache is being invalidate because project cc0dcc1a06a84ede84d64f0dcaa061ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:33.651183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:33.654256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-63d9a7dc-c5f4-410b-91bf-c6864895d58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:33.660513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2332/4676] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:33 2022] DELETE /identity/v3/projects/cc0dcc1a06a84ede84d64f0dcaa061ea => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:35:33.666830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d695a2f-42f0-4683-9834-09abf84f1c32 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.667295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d695a2f-42f0-4683-9834-09abf84f1c32 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.668238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d695a2f-42f0-4683-9834-09abf84f1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.702990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0d695a2f-42f0-4683-9834-09abf84f1c32 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:33.704801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d695a2f-42f0-4683-9834-09abf84f1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:33.715633 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2333/4677] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:33.724424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.725251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.725867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.749243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:33.751043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:33.763697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2334/4678] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:35:33.770608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.792075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50a5ff-4d54-43ae-93fb-2fa987491ef4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.798891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.804879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.820118 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2335/4679] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:33.834393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2345/4680] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:33 2022] POST /identity/v3/users => generated 280 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:33.835370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.838383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.840688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:33.857191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b295d-6245-4813-a7a7-870158803630 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.871813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.872759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.874445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.874992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.876827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.877014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a1a9-d1c6-4ab8-8ee8-0800f2082565 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.881361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.896132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.896766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.897052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.897323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.898361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.909292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.933130 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2346/4681] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:33.939346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:33.951769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de5aef-f2b1-4d09-b79b-ff1d53308119 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:33.957790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:33.958516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:33.965467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:33.965467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:33.965467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:33.965467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:33.977836 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2347/4682] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:33.981783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.002466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008dd0-959c-438f-900b-5eb383dc0890 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.009440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.010734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.011177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.011657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] PATH_INFO: `/v3/projects/19a4db43f962441486eb7356cfe9fe2c/users/2518b5a01d364c2085961da898a82c57/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.033811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a4db43f962441486eb7356cfe9fe2c, user_id=2518b5a01d364c2085961da898a82c57, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.040867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264c757-25bc-4d02-8c2d-cba26f10f3ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.050203 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2336/4683] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:33 2022] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:34.054001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.136984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b31df8-e3ef-4ba9-90b2-872cd011e75f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.143512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.144280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.144628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.145112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.146084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.148860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.163548 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2348/4684] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:33 2022] PUT /identity/v3/projects/19a4db43f962441486eb7356cfe9fe2c/users/2518b5a01d364c2085961da898a82c57/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:34.165557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.166346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.166346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.230743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] MFA Rules not processed for user `2518b5a01d364c2085961da898a82c57`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:34.231990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:34.352386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2337/4685] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:34 2022] POST /identity/v3/users => generated 296 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:34.355775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2349/4686] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:34.360287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.366945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.371491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:34.378125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266018ef-2362-426d-88af-623cf32fb565 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.512440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.513174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.513619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.514139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.522091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.524591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.566291 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2338/4687] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:34.566291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.601898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722884-ffc2-496e-be78-23c5f5b29440 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.621072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.621722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.622068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.624196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.630913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc91de-385f-4120-980c-db0b18058e05 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.645650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.646406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.646694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.646967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.647623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.649244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8e4cd-d0ed-4c76-9e23-91b8da51b1fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.652362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.653994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.705739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2350/4688] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:35:34.718365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2339/4689] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:34.731601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:34.760373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc82a0e-f14a-46ef-b565-8c06955c8693 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:34.775314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:34.777249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:34.777664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:34.778033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] PATH_INFO: `/v3/projects/a803f18ba6b148e0a6915fa2b1305a71/users/58b2cf4f1ecf4ee98736ff697a06b8a7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:34.803719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a803f18ba6b148e0a6915fa2b1305a71, user_id=58b2cf4f1ecf4ee98736ff697a06b8a7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:34.809086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:34.986535 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2351/4690] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:34 2022] PUT /identity/v3/projects/a803f18ba6b148e0a6915fa2b1305a71/users/58b2cf4f1ecf4ee98736ff697a06b8a7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:35.001978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:35.002975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:35.003416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:35.069105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] MFA Rules not processed for user `58b2cf4f1ecf4ee98736ff697a06b8a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:35.073593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:35.087782 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:35.227001 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2340/4691] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:35.266328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:35.471969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110605-72ba-45f1-b59a-e168f3f7965d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:35.481945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:35.484154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:35.484450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:35.485122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:35.503961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:35.506152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a04b33-04a1-45e3-bf32-557977ec134f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:35.533593 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2352/4692] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:36.760453 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:36.981934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:37.006811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e29b67-985c-4320-9f3b-7f9f815a7df9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:37.024959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:37.026192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:37.026477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:37.027251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:37.034284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:37.240112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:37.241656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:37.277931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2341/4693] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:37.823909 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:38.624303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:38.625198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:38.625677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:38.689140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] MFA Rules not processed for user `aba3c4de99ec4a5aae6fb006ab89fdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:38.690890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:38.868846 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2353/4694] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:38.884034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:38.889115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:39.055059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838a620-0f8d-432e-a9f4-0c04376ff739 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:39.078016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:39.079125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:39.082355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:39.082853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:39.089579 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:39.096250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:39.098957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bb7e-b0f2-4d50-8e45-3dadf5e17c33 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:39.112594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2342/4695] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:39.150735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:39.152455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:39.204769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de19200-509c-45f6-b522-3ea7a1ae8b6e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:39.220009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:39.221441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:39.223919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:39.223919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:39.228775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:39.286778 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:39.389203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:39.391833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:39.425922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2354/4696] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:47.936362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:47.937400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:47.937886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:47.985063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] MFA Rules not processed for user `aba3c4de99ec4a5aae6fb006ab89fdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:47.989899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:48.015689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2343/4697] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:49.155046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:49.157095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:49.175916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad992c-de63-498b-997c-4332e3ac6b7d service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:49.179792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:49.186021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:49.186021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:49.186021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:49.186021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:49.205718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:49.207696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:49.224397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2355/4698] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:52.605938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:52.610387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:52.629588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad7d6-abed-44d3-bd9d-25eccaca2e51 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:52.636089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:52.638282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:52.639364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:52.639855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] PATH_INFO: `/v3/users/0bce487302c24def8a8473b0725904f2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:52.642140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bce487302c24def8a8473b0725904f2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:52.644563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:52.846431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bce487302c24def8a8473b0725904f2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:52.847660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bce487302c24def8a8473b0725904f2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:52.859762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bce487302c24def8a8473b0725904f2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:52.860885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bce487302c24def8a8473b0725904f2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:52.938460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cbf5a8bf-a129-4d8d-8f82-e5ded4a9d765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bce487302c24def8a8473b0725904f2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:52.993380 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2344/4699] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:52 2022] DELETE /identity/v3/users/0bce487302c24def8a8473b0725904f2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:54.285646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:54.311832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f52010-0629-4b51-a0d0-2d770d193c2f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:54.451353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:54.452610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:54.453047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:54.453616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] PATH_INFO: `/v3/projects/3efbfd76a9a74c03907d7d9be25f42d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:54.455031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efbfd76a9a74c03907d7d9be25f42d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:54.460383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:54.693235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efbfd76a9a74c03907d7d9be25f42d4', 'request_id': 'req-47146b5b-06ed-49f1-bee8-d8452d2096fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:54.786849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efbfd76a9a74c03907d7d9be25f42d4', 'request_id': 'req-47146b5b-06ed-49f1-bee8-d8452d2096fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:54.795142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efbfd76a9a74c03907d7d9be25f42d4', 'request_id': 'req-47146b5b-06ed-49f1-bee8-d8452d2096fa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:54.807878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] The token cache is being invalidate because project 3efbfd76a9a74c03907d7d9be25f42d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:54.808374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:54.809809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47146b5b-06ed-49f1-bee8-d8452d2096fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:54.811595 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2356/4700] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:54 2022] DELETE /identity/v3/projects/3efbfd76a9a74c03907d7d9be25f42d4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:54.817553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:54.817952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:54.818469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:54.843402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:54.845080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:54.947698 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2345/4701] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:54.957014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:54.957014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:54.957014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:54.973000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:54.974442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:54.989992 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2357/4702] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:54.990588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.005958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d463a8-a9b2-4cb9-adf9-c3a736a1ca63 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.015268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.015896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.016177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.016448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.019291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:55.022025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.022727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.040059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2346/4703] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:35:55.046653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.057596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259cbc-a428-453d-842b-db0c05230904 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.070840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.072016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.073893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.074399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.075426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.078901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.217585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2358/4704] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:55.221152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.233491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a863a7-570b-4deb-9af2-231c2982a81c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.285354 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:55.301990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.303074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.303508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.315768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.318669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.322985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.385495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.391672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:55.423469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9943db-35b3-45e7-8e01-b08b3e7f5ab2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.425308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2347/4705] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:55 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:55.426669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.437702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.438409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.439302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.439978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] PATH_INFO: `/v3/users/58b2cf4f1ecf4ee98736ff697a06b8a7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.448197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b2cf4f1ecf4ee98736ff697a06b8a7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.459786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.460083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b8783-2837-4dcf-9963-d7111ac3b54c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.468425 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:55.473781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.478385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.488763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.488763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.488763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.488763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.520419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2348/4706] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:55.521480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.534017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67892be-cf6c-4d45-8c84-768b1757eef7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.539657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.540600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.540967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.546069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.546069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.546069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.557396 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2349/4707] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:55.569594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:55.586752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fd015-30d6-411f-83ca-64215c758d85 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:55.593279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:55.594041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.594381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.594711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] PATH_INFO: `/v3/projects/44aa2a491e804503a2af0efc40090c48/users/0cda2b7785b04e0cbf70fb35bfaa7e54/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.620902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aa2a491e804503a2af0efc40090c48, user_id=0cda2b7785b04e0cbf70fb35bfaa7e54, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:55.623921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1826-9f33-4628-a233-de15730dbea1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:55.733503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b2cf4f1ecf4ee98736ff697a06b8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:55.756882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2350/4708] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:55 2022] PUT /identity/v3/projects/44aa2a491e804503a2af0efc40090c48/users/0cda2b7785b04e0cbf70fb35bfaa7e54/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:55.768565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.770214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.773143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.808372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:55.810424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:55.845871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b2cf4f1ecf4ee98736ff697a06b8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:55.846914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b2cf4f1ecf4ee98736ff697a06b8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:55.873240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b2cf4f1ecf4ee98736ff697a06b8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:55.900327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3509c7b9-f54a-4598-8481-56d4dd7885c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b2cf4f1ecf4ee98736ff697a06b8a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:55.923123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2359/4709] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:35:55 2022] DELETE /identity/v3/users/58b2cf4f1ecf4ee98736ff697a06b8a7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:55.927601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:55.928854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:55.929320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:55.990281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:55.994017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:56.000933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2351/4710] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:56.051632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:56.054315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:56.215784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ecc75-dd57-40b8-b4d7-891b9b58c20a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:56.244932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2360/4711] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:56.337656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:56.337656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:56.337656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:56.337656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:56.360717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:56.362358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:56.378466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2352/4712] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:35:56.386764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:56.407047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4785a4-7d3d-4284-aef2-ddea3cb1d58e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:56.415221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:56.416660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:56.416867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:56.417208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:56.441113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:56.443120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9a089-8482-4e3f-9d1d-338f10469f2e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:56.458622 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2361/4713] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:35:56.851612 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:57.937960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:57.937960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:57.970449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4c4a-000d-47de-912d-fac601116716 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:57.982991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:57.983909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:57.984334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:57.984763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] PATH_INFO: `/v3/projects/a803f18ba6b148e0a6915fa2b1305a71` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:57.987890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a803f18ba6b148e0a6915fa2b1305a71)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:58.000576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:58.198579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a803f18ba6b148e0a6915fa2b1305a71', 'request_id': 'req-99149b17-df42-47dd-abef-a881b90ebdd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:58.218190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a803f18ba6b148e0a6915fa2b1305a71', 'request_id': 'req-99149b17-df42-47dd-abef-a881b90ebdd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:58.304625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a803f18ba6b148e0a6915fa2b1305a71', 'request_id': 'req-99149b17-df42-47dd-abef-a881b90ebdd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:58.335302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] The token cache is being invalidate because project a803f18ba6b148e0a6915fa2b1305a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:35:58.335302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:58.337446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-99149b17-df42-47dd-abef-a881b90ebdd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:35:58.342557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2353/4714] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:35:57 2022] DELETE /identity/v3/projects/a803f18ba6b148e0a6915fa2b1305a71 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:58.346361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:58.346825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:58.346931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:58.387037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:58.389655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:58.584804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:58.586304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:58.586775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:58.595267 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2362/4715] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:58.652200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:58.653591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:58.682163 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2354/4716] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:58.686960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:58.703963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a6044-4c03-4d64-b627-4365f1293097 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:58.732080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:58.732717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:58.732993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:58.733257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:58.734172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:35:58.734483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:58.736205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:58.753362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:35:58.771928 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2363/4717] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:35:58.776204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:58.790829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd509-9e8c-403a-b747-9e539a716a68 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:58.812113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:58.813061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:58.813538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:58.813962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:58.824207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:58.827564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:58.957588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2355/4718] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:35:58 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:58.958870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:58.988979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b66a54-1ee0-4bbd-adae-95a42bfe5439 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:59.169929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:59.170571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:59.170855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:59.171125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:59.171963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:59.174385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:59.305106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2364/4719] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:35:58 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:35:59.309076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:59.329947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d2306-97ed-4f6a-bbcf-96185a147ba0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:59.338849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:59.339849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:59.340847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:59.359555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:59.361183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:59.365543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:59.382572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2356/4720] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:59.390128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:59.408381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb027-198e-4f65-a5b3-123bc984a670 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:59.422940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:59.423912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:59.424346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:59.424771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:59.425606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:59.428275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb37e81-6f2f-4877-838d-385f4eaff142 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:59.452688 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2365/4721] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:35:59.453481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:59.467655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b58493-531e-4ee9-aeb6-03202e687728 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:35:59.474301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:35:59.474981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:59.475256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:59.475530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] PATH_INFO: `/v3/projects/c459ca098c214c1b94274bdcbfa5fb5d/users/b5d702a3047f45a0a8319562a8db7837/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:59.516150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c459ca098c214c1b94274bdcbfa5fb5d, user_id=b5d702a3047f45a0a8319562a8db7837, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:35:59.523360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:35:59.660222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:35:59.660468 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2357/4722] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:35:59 2022] PUT /identity/v3/projects/c459ca098c214c1b94274bdcbfa5fb5d/users/b5d702a3047f45a0a8319562a8db7837/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:35:59.660987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:35:59.661510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:35:59.719302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] MFA Rules not processed for user `b5d702a3047f45a0a8319562a8db7837`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:35:59.720534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:35:59.893614 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2366/4723] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:35:59.933210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:35:59.936826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:00.052992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9172f9-077b-4344-aa46-532ae7f5bab5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:00.057901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:00.058538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:00.058823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:00.059767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:00.078314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:00.079773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:00.101940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2358/4724] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:04.078925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:04.080388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:04.208311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e80b-200c-4190-8fdc-670bd401d8e2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:04.214128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:04.216044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:04.218485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:04.219074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] PATH_INFO: `/v3/users/55d02fb5fddb48e49fb66428db0f0424` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:04.220770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d02fb5fddb48e49fb66428db0f0424)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:04.222985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:04.232964 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:04.519811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d02fb5fddb48e49fb66428db0f0424'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:04.594145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d02fb5fddb48e49fb66428db0f0424'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:04.594983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d02fb5fddb48e49fb66428db0f0424'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:04.621223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d02fb5fddb48e49fb66428db0f0424'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:04.634494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d02fb5fddb48e49fb66428db0f0424'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:04.666614 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2367/4725] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:04 2022] DELETE /identity/v3/users/55d02fb5fddb48e49fb66428db0f0424 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:05.575670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:05.590301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7a07-0229-4651-89a3-2c3ca9305154 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:05.604644 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:05.675397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:05.676655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:05.677090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:05.677560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] PATH_INFO: `/v3/projects/51b75ee1fcc142dd9eb8cb4e3ea631b8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:05.711392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b75ee1fcc142dd9eb8cb4e3ea631b8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:05.713518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:05.869845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'request_id': 'req-24d3f509-6d44-403c-b2da-a514806d2979'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:05.885104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'request_id': 'req-24d3f509-6d44-403c-b2da-a514806d2979'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:05.987916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b75ee1fcc142dd9eb8cb4e3ea631b8', 'request_id': 'req-24d3f509-6d44-403c-b2da-a514806d2979'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.002374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] The token cache is being invalidate because project 51b75ee1fcc142dd9eb8cb4e3ea631b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:06.002740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.003351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.009230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:06.010882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:06.012089 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2359/4726] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:05 2022] DELETE /identity/v3/projects/51b75ee1fcc142dd9eb8cb4e3ea631b8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:06.025942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e309e-66a8-4446-8809-b268d3dfb1a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:06.116449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:06.117940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:06.118461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:06.119016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] PATH_INFO: `/v3/users/89216c262a8e46b4a1cb8b29dfedcfd3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:06.120562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=89216c262a8e46b4a1cb8b29dfedcfd3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:06.122914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:06.375113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89216c262a8e46b4a1cb8b29dfedcfd3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.479635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89216c262a8e46b4a1cb8b29dfedcfd3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.480412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89216c262a8e46b4a1cb8b29dfedcfd3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.504193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89216c262a8e46b4a1cb8b29dfedcfd3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.528392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9ad8f616-e876-4c33-9c2b-7f4e37bfa42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89216c262a8e46b4a1cb8b29dfedcfd3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:06.538830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2368/4727] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:06 2022] DELETE /identity/v3/users/89216c262a8e46b4a1cb8b29dfedcfd3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:07.575109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:07.576559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:07.600478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3f509-6d44-403c-b2da-a514806d2979 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:07.712487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:07.713628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:07.714131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:07.714639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] PATH_INFO: `/v3/projects/2bf19d32ead440ba86472a2107547ea8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:07.716697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf19d32ead440ba86472a2107547ea8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:07.720707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:07.869119 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:07.919248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf19d32ead440ba86472a2107547ea8', 'request_id': 'req-34a7875e-6418-4dd7-a6e1-9077b3e214ec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:07.929387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf19d32ead440ba86472a2107547ea8', 'request_id': 'req-34a7875e-6418-4dd7-a6e1-9077b3e214ec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:08.012938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98b2e-1f69-41e6-85da-1ce75c9f626e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.013504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98b2e-1f69-41e6-85da-1ce75c9f626e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.013504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98b2e-1f69-41e6-85da-1ce75c9f626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.027373 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:08.051091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf19d32ead440ba86472a2107547ea8', 'request_id': 'req-34a7875e-6418-4dd7-a6e1-9077b3e214ec'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:08.052796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-15f98b2e-1f69-41e6-85da-1ce75c9f626e None None] MFA Rules not processed for user `02d9c8a493ab4fc1bdac4ab6494bec15`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:08.057034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15f98b2e-1f69-41e6-85da-1ce75c9f626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:08.076884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] The token cache is being invalidate because project 2bf19d32ead440ba86472a2107547ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:08.082466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:08.087766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34a7875e-6418-4dd7-a6e1-9077b3e214ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:08.092794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2360/4728] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:07 2022] DELETE /identity/v3/projects/2bf19d32ead440ba86472a2107547ea8 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:08.098700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333fc83-ea3c-497a-b846-9ca5ffdc6d32 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.100018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333fc83-ea3c-497a-b846-9ca5ffdc6d32 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.100468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333fc83-ea3c-497a-b846-9ca5ffdc6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.145006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6333fc83-ea3c-497a-b846-9ca5ffdc6d32 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:08.147505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6333fc83-ea3c-497a-b846-9ca5ffdc6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:08.198588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2369/4729] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:08.202944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.203297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.203577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.242817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] MFA Rules not processed for user `02d9c8a493ab4fc1bdac4ab6494bec15`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:08.244713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:08.263443 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2361/4730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:08.266661 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2370/4731] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:08.275261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.275261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.275261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.303348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:08.304689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:08.314627 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2362/4732] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:08.319187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.338335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b04ef-69a1-4d17-a29d-778b2c5dacc8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.343902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.344855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.345992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.346461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.347474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:08.347971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.349925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:08.370328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2371/4733] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:08.375649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.396785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43b101-4938-495f-9f5a-2c5df8b76cd5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.408794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.410152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.417058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.417058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.417058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.420050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:08.537402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2363/4734] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:36:08.539348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.560911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ac699-76aa-4bf1-b524-4a97dbe7ba7c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.694094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.694727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.695041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.695348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.696326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.698231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:08.824888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2372/4735] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:08 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:08.828982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.840967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24589-b0fb-4723-8768-de559f468532 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.846715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.847459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.849530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.850302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.851127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.853553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:08.870092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2364/4736] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:36:08.871595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.882918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0163c0-886a-4853-8b94-796b777a5252 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.888256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.889011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.895095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.895095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.895095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.895095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038448-2f79-40e3-88c8-759868eaf848 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:08.917782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2373/4737] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:08.918913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:08.940079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68e796-2896-4b77-813e-d28e702e792a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:08.947958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:08.948638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:08.948914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:08.949183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] PATH_INFO: `/v3/projects/6716e9ebbf6c4ca1950a5a0bce33276c/users/352cb9c0a2644e0e8743f3cc4477f88f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:08.983194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6716e9ebbf6c4ca1950a5a0bce33276c, user_id=352cb9c0a2644e0e8743f3cc4477f88f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:08.991372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:09.108346 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2365/4738] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:08 2022] PUT /identity/v3/projects/6716e9ebbf6c4ca1950a5a0bce33276c/users/352cb9c0a2644e0e8743f3cc4477f88f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:09.111614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:09.112511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:09.113155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:09.144690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:09.146567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:09.263124 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2374/4739] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:09.391909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:09.393842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:09.526633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212cd7-ca31-4794-97e7-27ba97a485e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:09.535977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:09.536624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:09.536904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:09.537179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:09.551886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:09.552740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faec15-da50-443e-bc3d-705ff4a10f75 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:09.589810 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2366/4740] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:11.611174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:11.612693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:11.636590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811787f-3a2a-46d5-944f-e6f66eebc698 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:11.653561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:11.654961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:11.655416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:11.655852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] PATH_INFO: `/v3/users/2518b5a01d364c2085961da898a82c57` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:11.663232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2518b5a01d364c2085961da898a82c57)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:11.668903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:11.673076 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:11.909850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2518b5a01d364c2085961da898a82c57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:12.023572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2518b5a01d364c2085961da898a82c57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:12.024696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2518b5a01d364c2085961da898a82c57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:12.054214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2518b5a01d364c2085961da898a82c57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:12.091270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2518b5a01d364c2085961da898a82c57'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:12.099460 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2375/4741] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:11 2022] DELETE /identity/v3/users/2518b5a01d364c2085961da898a82c57 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:12.104710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:12.107191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:12.107859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:12.125763 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:12.154211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:12.155895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:12.343589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2367/4742] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:12.391214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:12.392609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:12.514803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006caca0-d590-45d9-8083-0a79e3dc8cd7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:12.536348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:12.537091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:12.538045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:12.540358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:12.565074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:12.566584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121225d-f920-4656-a92e-7558c9ad2bb3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:12.608087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2376/4743] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:36:14.112993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:14.114499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:14.128152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb8ee-f7b1-4e75-9733-732100aac8ab None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:14.133976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:14.134890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.135350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.135788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] PATH_INFO: `/v3/projects/19a4db43f962441486eb7356cfe9fe2c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.137976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a4db43f962441486eb7356cfe9fe2c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:14.140088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:14.352831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a4db43f962441486eb7356cfe9fe2c', 'request_id': 'req-3b7969cb-5cb7-4dc3-8a15-57b24049572a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:14.371309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a4db43f962441486eb7356cfe9fe2c', 'request_id': 'req-3b7969cb-5cb7-4dc3-8a15-57b24049572a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:14.651413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a4db43f962441486eb7356cfe9fe2c', 'request_id': 'req-3b7969cb-5cb7-4dc3-8a15-57b24049572a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:14.665675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] The token cache is being invalidate because project 19a4db43f962441486eb7356cfe9fe2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:14.666928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:14.666928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:14.669953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2368/4744] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:14 2022] DELETE /identity/v3/projects/19a4db43f962441486eb7356cfe9fe2c => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:14.675058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917085-8e8b-47a5-9f3f-ae522ca62ebd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.675583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917085-8e8b-47a5-9f3f-ae522ca62ebd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.675583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57917085-8e8b-47a5-9f3f-ae522ca62ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.703272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-57917085-8e8b-47a5-9f3f-ae522ca62ebd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:14.705999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57917085-8e8b-47a5-9f3f-ae522ca62ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:14.803099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2377/4745] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:14.805823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:14.807259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:14.811038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.811332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.811611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.828077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7969cb-5cb7-4dc3-8a15-57b24049572a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:14.835552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:14.836198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.838826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.839087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] PATH_INFO: `/v3/users/dcdd7b99e5a94490b604d2e10545a658` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.842736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdd7b99e5a94490b604d2e10545a658)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:14.845587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:14.858506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:14.859751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:14.881118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2378/4746] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:14.885169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:14.908431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c6375-d1c3-4aa0-8c35-343254fea22d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:14.913591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:14.913938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.914218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.914489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.915143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:14.915917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:14.917054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253f87-f451-42de-a549-5d46fba1bf34 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:14.951234 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2379/4747] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:14.953255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:14.953709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:14.954714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:14.971557 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:15.021160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] MFA Rules not processed for user `0cda2b7785b04e0cbf70fb35bfaa7e54`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:15.024772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:15.081472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdd7b99e5a94490b604d2e10545a658'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:15.082172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdd7b99e5a94490b604d2e10545a658'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:15.101844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdd7b99e5a94490b604d2e10545a658'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:15.103975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdd7b99e5a94490b604d2e10545a658'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:15.155814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2380/4748] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:15.161588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:15.163379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:15.181963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd689a90-b152-4ce7-a617-2d5493ebc2fd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:15.187556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:15.188261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.188542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.188866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.189598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:15.192533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:15.200187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdd7b99e5a94490b604d2e10545a658'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:15.232194 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:15.247444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2369/4749] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:14 2022] DELETE /identity/v3/users/dcdd7b99e5a94490b604d2e10545a658 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:15.317194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2381/4750] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:15 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:15.322426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:15.446413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529918-4cdb-4c12-be0f-c9db24cdf6c2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:15.531736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:15.532462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.532858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.534173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.534537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:15.536670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:15.645817 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2370/4751] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:15 2022] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:15.650568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:15.664898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef7d81-75e8-41c4-8979-428c25f86557 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:15.669732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:15.670356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.670637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.670916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.671563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:15.675252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:15.688830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2382/4752] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:15.693255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:15.706518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a56408-7e72-4210-825a-8284534ebe49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:15.727307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:15.729317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.729317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.729773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.731250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:15.734003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6dcac5-649c-4a6f-93d0-81cc0e606bd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:15.754937 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2371/4753] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:15.760432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:15.780025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd28a5-9d70-469f-b230-80874ca47c6c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:15.788866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:15.789904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.790338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.790905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] PATH_INFO: `/v3/projects/b21dd22324254d318140663637c56592/users/edb5c6a30fcb485da0f71c357c86fc37/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.818282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21dd22324254d318140663637c56592, user_id=edb5c6a30fcb485da0f71c357c86fc37, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:15.821443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:15.915500 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2383/4754] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:15 2022] PUT /identity/v3/projects/b21dd22324254d318140663637c56592/users/edb5c6a30fcb485da0f71c357c86fc37/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:15.927319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:15.932245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:15.932245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:15.972480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] MFA Rules not processed for user `edb5c6a30fcb485da0f71c357c86fc37`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:15.974124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:16.087075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2372/4755] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:16.094280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.195786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af75aa-aedc-4197-86f4-f2244628e304 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:16.203514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:16.204304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:16.204304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:16.204576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:16.205210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:16.210918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:16.347179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2384/4756] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:16 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:16.351068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.366973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c9099-967d-4702-ab8d-43a9aa2e5dfc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:16.530954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:16.532330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:16.532330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:16.532330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:16.532913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:16.540624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:16.583424 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:16.681484 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2373/4757] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:16 2022] POST /identity/v3/users => generated 297 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:16.687127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.702330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ef59c-cd6b-4b20-95d8-b826653f6134 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:16.724561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:16.725189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:16.726023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:16.726530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:16.727955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:16.732960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:16.779974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2385/4758] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:16.784255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.798701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43002785-af63-48f5-a422-6084e7a55f1e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:16.831757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:16.831757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:16.831757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:16.832050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] PATH_INFO: `/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d/users/134fd90a33f843ba81ca606e906a5e6f/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:16.860308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b0e2e5a7f4455782d4bcf657c5d58d, user_id=134fd90a33f843ba81ca606e906a5e6f, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:16.863109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:16.972762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.977219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:16.979706 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2374/4759] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:16 2022] PUT /identity/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d/users/134fd90a33f843ba81ca606e906a5e6f/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:16.983959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:16.999127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b764290-8c0f-4960-8b51-ead727b10bc6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:17.011040 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:17.127360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf61cf-0ea7-41e0-800f-afc4e0f7fbcd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:17.137627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:17.137627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.137627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.137627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.138216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:17.138308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:17.155111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2375/4760] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:17.167363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:17.169925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:17.170574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.170857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.171132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] PATH_INFO: `/v3/projects/109772076b1d4aed99db960f295ac4e0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.174406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109772076b1d4aed99db960f295ac4e0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:17.176977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:17.196982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1194-52dd-4c6f-951a-22d84a2fbac9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:17.210885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:17.213390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.213682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.213966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] PATH_INFO: `/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d/users/134fd90a33f843ba81ca606e906a5e6f/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.224355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b0e2e5a7f4455782d4bcf657c5d58d, user_id=134fd90a33f843ba81ca606e906a5e6f, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:17.229439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2d1f-6622-492b-ba52-ea8bcd42d219 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:17.257781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2376/4761] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:17 2022] PUT /identity/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d/users/134fd90a33f843ba81ca606e906a5e6f/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:17.280540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.281127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.281944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.333307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] MFA Rules not processed for user `134fd90a33f843ba81ca606e906a5e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:17.336482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:17.372877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109772076b1d4aed99db960f295ac4e0', 'request_id': 'req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:17.451912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109772076b1d4aed99db960f295ac4e0', 'request_id': 'req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:17.462477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109772076b1d4aed99db960f295ac4e0', 'request_id': 'req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:17.499445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] The token cache is being invalidate because project 109772076b1d4aed99db960f295ac4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:17.506470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:17.506470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:17.506470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2386/4762] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:16 2022] DELETE /identity/v3/projects/109772076b1d4aed99db960f295ac4e0 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:17.506767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2377/4763] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:17.509687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:17.526732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:17.528124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:17.529797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:17.692676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913df4-cec9-4ee3-b978-83c9dd5ad6d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:17.699917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e5c5-bb3f-4ec4-9b9e-68035a45a247 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:17.716089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:17.716787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.717563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.717563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] PATH_INFO: `/v3/users/7f9d7169927f4bc2b7ff51ba20cc70a7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.725610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9d7169927f4bc2b7ff51ba20cc70a7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:17.736730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:17.823353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:17.824426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:17.824945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:17.825493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:17.832791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:17.870940 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:18.016998 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:18.021589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9d7169927f4bc2b7ff51ba20cc70a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:18.053418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:18.054905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:18.085205 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2378/4764] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:18.204121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9d7169927f4bc2b7ff51ba20cc70a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:18.204121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9d7169927f4bc2b7ff51ba20cc70a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:18.227370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9d7169927f4bc2b7ff51ba20cc70a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:18.255447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9d7169927f4bc2b7ff51ba20cc70a7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:18.278252 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2387/4765] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:17 2022] DELETE /identity/v3/users/7f9d7169927f4bc2b7ff51ba20cc70a7 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:18.348792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:18.350953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:18.485098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e23a-8d19-4ceb-ad76-d91776ea2daa service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:18.599240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:18.599943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:18.599943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:18.600348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:18.611260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:18.795829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:18.797555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:18.823709 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2379/4766] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:19.005987 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:19.650934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:19.653290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:19.833922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a407f-4c5d-497a-a1aa-45b07551ffc7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:19.847694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '134fd90a33f843ba81ca606e906a5e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:19.848337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:19.848619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:19.848900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:19.852544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:19.852862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:19.859224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:19.898599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2388/4767] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:36:19.903933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:19.923710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436933-fc3a-4bd2-9e3c-6e01d7a188ca service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:19.933061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '134fd90a33f843ba81ca606e906a5e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:19.933992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:19.934493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:19.935012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:19.935907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:19.941734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:20.100349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2380/4768] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:19 2022] POST /identity/v3/projects => generated 354 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:20.101358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:20.124910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51007232-80ad-41f6-9874-5eb925336d1d tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:20.130227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:20.132264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:20.358794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '134fd90a33f843ba81ca606e906a5e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:20.359565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:20.359947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:20.360323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:20.361194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:20.361615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:20.364794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:20.385399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e6d3b-56a0-4912-b774-378837ba3ad6 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:20.398897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2389/4769] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:36:20.413147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:20.414123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:20.416465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:20.416965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] PATH_INFO: `/v3/projects/7f95b6c505774d48a442b9b2ce22de13` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:20.420023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f95b6c505774d48a442b9b2ce22de13)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:20.424711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:20.551329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:20.571201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052058-86af-4270-b287-253711411c21 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:20.577173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '134fd90a33f843ba81ca606e906a5e6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:20.577870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:20.578483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:20.578713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] PATH_INFO: `/v3/projects/abd6d309a9b94bb9b429d3a24a88059b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:20.586449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abd6d309a9b94bb9b429d3a24a88059b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:20.595195 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:20.595461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:20.614183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f95b6c505774d48a442b9b2ce22de13', 'request_id': 'req-3abd24e8-319b-4707-a201-c12e254ad7dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.626989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f95b6c505774d48a442b9b2ce22de13', 'request_id': 'req-3abd24e8-319b-4707-a201-c12e254ad7dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.719706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f95b6c505774d48a442b9b2ce22de13', 'request_id': 'req-3abd24e8-319b-4707-a201-c12e254ad7dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.738291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] The token cache is being invalidate because project 7f95b6c505774d48a442b9b2ce22de13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:20.738868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.740821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3abd24e8-319b-4707-a201-c12e254ad7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.749474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2381/4770] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:20 2022] DELETE /identity/v3/projects/7f95b6c505774d48a442b9b2ce22de13 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:20.759804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:20.770409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:20.772657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:20.780966 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:20.794485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd6d309a9b94bb9b429d3a24a88059b', 'request_id': 'req-309585ad-1069-45fc-87bd-58c2be80e242'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.826885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:20.828176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:20.924415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd6d309a9b94bb9b429d3a24a88059b', 'request_id': 'req-309585ad-1069-45fc-87bd-58c2be80e242'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.932863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd6d309a9b94bb9b429d3a24a88059b', 'request_id': 'req-309585ad-1069-45fc-87bd-58c2be80e242'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.962257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] The token cache is being invalidate because project abd6d309a9b94bb9b429d3a24a88059b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:20.968906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:20.970691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-309585ad-1069-45fc-87bd-58c2be80e242 tempest-VolumeQuotaClassesTest-1094080800 tempest-VolumeQuotaClassesTest-1094080800-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:21.005857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2390/4771] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:20 2022] DELETE /identity/v3/projects/abd6d309a9b94bb9b429d3a24a88059b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:21.032772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.035148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.035148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.041382 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2382/4772] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:21.102790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:21.104022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:21.138098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.140717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:21.142208 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2391/4773] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:21.173485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ea094-9d70-441a-b12d-33e0970a37ac None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.186316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.193737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.226561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.237444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce935-5209-4f3b-8719-4e18717bde42 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.238031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2383/4774] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:21.251707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.257403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.257403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.257403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.257403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.257403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.413560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2392/4775] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:21 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:21.418598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.429797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1e091-e1a4-450b-bcb5-2a5159891376 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.558510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.559150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.559428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.559702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.560408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.564675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.714176 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2384/4776] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:21 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:21.718977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.738292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccec27-d37b-4ec6-aada-ba67aabb5b3f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.761090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.761090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.761090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.761090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.761699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.762777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.786437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.795140 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2393/4777] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:21.808190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e4fe1-6a3e-48d1-b6d4-5762671f768b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.814015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.814921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.815345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.815767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.816585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.818421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.850840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.865687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2385/4778] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:21.866189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45415f42-3d68-4038-9eb3-29cae93da2d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:21.882501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:21.883681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:21.883681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:21.883681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] PATH_INFO: `/v3/projects/d206d5c4ea654a2194a77d71d27972e8/users/93d18cf1316742dab78a102a257608ae/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:21.914232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d206d5c4ea654a2194a77d71d27972e8, user_id=93d18cf1316742dab78a102a257608ae, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:21.917383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b36f4-48c5-4534-b9d9-560c74e3f133 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:21.960960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:21.963154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:21.985038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc42c6c-dc2d-4610-85fb-38f74bf78e60 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:22.003897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:22.004889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:22.005614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:22.006136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] PATH_INFO: `/v3/users/edb5c6a30fcb485da0f71c357c86fc37` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:22.007557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb5c6a30fcb485da0f71c357c86fc37)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:22.009863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:22.018658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2394/4779] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:21 2022] PUT /identity/v3/projects/d206d5c4ea654a2194a77d71d27972e8/users/93d18cf1316742dab78a102a257608ae/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:22.023121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:22.024439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:22.024439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:22.071769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:22.073939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:22.075153 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:22.257896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb5c6a30fcb485da0f71c357c86fc37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:22.258752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb5c6a30fcb485da0f71c357c86fc37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:22.281516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb5c6a30fcb485da0f71c357c86fc37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:22.282561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb5c6a30fcb485da0f71c357c86fc37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:22.282699 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2395/4780] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:22.308249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:22.310351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:22.417904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01e3bb6e-ff9e-434a-8290-fe22a89cf5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb5c6a30fcb485da0f71c357c86fc37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:22.452272 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2386/4781] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:21 2022] DELETE /identity/v3/users/edb5c6a30fcb485da0f71c357c86fc37 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:22.460479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:22.461088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:22.461610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:22.507024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:22.508404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:22.511104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb9708-e733-4ddd-b18a-2853efbd59ca None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:22.548803 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:22.651863 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2387/4782] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:22.698955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:22.700618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:22.715503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:22.716147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:22.716426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:22.716697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:22.726192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:22.770928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:22.772541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:22.789778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2396/4783] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:22.819975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02ee86-7330-47a0-8337-06ffbffd5b2c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:22.829839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:22.830963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:22.831409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:22.832318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:22.864000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:22.868395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:22.891450 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2388/4784] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:36:25.400025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:25.400706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:25.434848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076188-2afc-4dd7-9528-0311409c2d89 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:25.450926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:25.451565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:25.451842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:25.452216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] PATH_INFO: `/v3/projects/b21dd22324254d318140663637c56592` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:25.455511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21dd22324254d318140663637c56592)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:25.464477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:25.656349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21dd22324254d318140663637c56592', 'request_id': 'req-c0e2933b-0ca0-419d-944f-f50784ffc30e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:25.747877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21dd22324254d318140663637c56592', 'request_id': 'req-c0e2933b-0ca0-419d-944f-f50784ffc30e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:25.758097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21dd22324254d318140663637c56592', 'request_id': 'req-c0e2933b-0ca0-419d-944f-f50784ffc30e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:25.783747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] The token cache is being invalidate because project b21dd22324254d318140663637c56592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:25.784099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:25.786600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0e2933b-0ca0-419d-944f-f50784ffc30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:25.792832 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2397/4785] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:25 2022] DELETE /identity/v3/projects/b21dd22324254d318140663637c56592 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:25.794119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:25.811677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a9c8-ab66-4daa-9d55-bab399c12090 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:25.911328 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:25.939654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:25.940615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:25.940998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:25.941403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] PATH_INFO: `/v3/users/134fd90a33f843ba81ca606e906a5e6f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:25.944269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134fd90a33f843ba81ca606e906a5e6f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:25.946677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:26.189096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134fd90a33f843ba81ca606e906a5e6f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:26.191616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134fd90a33f843ba81ca606e906a5e6f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:26.211805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134fd90a33f843ba81ca606e906a5e6f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:26.214566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134fd90a33f843ba81ca606e906a5e6f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:26.319918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4645961f-99ca-47fd-90c2-ba0acda7f679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134fd90a33f843ba81ca606e906a5e6f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:26.357269 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2389/4786] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:25 2022] DELETE /identity/v3/users/134fd90a33f843ba81ca606e906a5e6f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:28.436065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:28.436617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:28.436617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:28.472630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] MFA Rules not processed for user `352cb9c0a2644e0e8743f3cc4477f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:28.474442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:28.665679 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2398/4787] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:28.667470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:28.667972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:28.668102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:28.719243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] MFA Rules not processed for user `352cb9c0a2644e0e8743f3cc4477f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:28.721713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:28.732446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2390/4788] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:28.749876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:28.752586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:28.832366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:28.832366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:28.884654 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:28.972640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f7c9e-aa10-4503-b4cb-0bea1b54fe4b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:28.988997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:28.990097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:28.990342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:28.990618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.012786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:29.014577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f3dec-84de-4626-8542-8781ca90c0c2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:29.038229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fd3f0-f2e0-40c1-a1a7-4650996da46c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:29.042386 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2399/4789] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:29.047077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:29.052719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:29.052719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:29.052719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] PATH_INFO: `/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.052719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b0e2e5a7f4455782d4bcf657c5d58d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:29.055592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:29.251073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'request_id': 'req-85e9b040-9659-4ade-9e90-5e1a0bc809a7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:29.269804 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:29.274123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'request_id': 'req-85e9b040-9659-4ade-9e90-5e1a0bc809a7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:29.376702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b0e2e5a7f4455782d4bcf657c5d58d', 'request_id': 'req-85e9b040-9659-4ade-9e90-5e1a0bc809a7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:29.400457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] The token cache is being invalidate because project b3b0e2e5a7f4455782d4bcf657c5d58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:29.400857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:29.401744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-85e9b040-9659-4ade-9e90-5e1a0bc809a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:29.412073 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2391/4790] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:28 2022] DELETE /identity/v3/projects/b3b0e2e5a7f4455782d4bcf657c5d58d => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:29.413580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:29.413925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:29.414139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.455098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:29.456245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:29.595658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2400/4791] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:29.603494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:29.603901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:29.605998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.645834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:29.649550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:29.671319 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2392/4792] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:29.676364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:29.694600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9f717-ebc0-4670-8cc8-6e194d91049d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:29.723705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:29.724600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:29.725067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:29.725544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.733042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:29.735931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:29.737446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:29.785136 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2401/4793] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:29.789648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:29.800374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd2bd-345d-4f3c-9f60-82aa05d2b9fb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:29.813718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:29.814943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:29.814943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:29.815592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:29.815691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:29.819880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:29.944130 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2393/4794] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:29 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:29.948092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:29.962005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5ae5-15b9-49b8-8c88-b7af87939798 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.097822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.098651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.099089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.099858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.101421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.107798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.279313 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2402/4795] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:29 2022] POST /identity/v3/users => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:30.285993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.301570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ef42-a57f-4e97-bff2-49ed21f034bc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.316814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.321648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.321648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.321648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.321648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.321648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.352664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2394/4796] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:30.356857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.365769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.369616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:30.372518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca30ec-fa19-477a-85b0-67a7771f9fc3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.388219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.394996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.395463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.395901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.396708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.398557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.434116 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2403/4797] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:30.438300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.462544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fecdb8-4bff-4581-b772-713c18d0ceb5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.478381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.479360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.479792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.480245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] PATH_INFO: `/v3/projects/61dcf9c752e044e5aea45ffdc0d00d33/users/399a64cd18314620a2e7e0f5b53dda38/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.517282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216066f-b145-46ce-914c-14aee00281c9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.520451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dcf9c752e044e5aea45ffdc0d00d33, user_id=399a64cd18314620a2e7e0f5b53dda38, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.525402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7448dc-a422-4ffb-b31c-a61af6f5d312 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.530999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.531963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.532394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.536053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.539547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:30.556092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.557970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.573169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2395/4798] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:30.574827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.576446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:30.596520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0479-1361-4b9d-9f46-2fa51d665d10 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.616769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2404/4799] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:30 2022] PUT /identity/v3/projects/61dcf9c752e044e5aea45ffdc0d00d33/users/399a64cd18314620a2e7e0f5b53dda38/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:30.617126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.618117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.618393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.618663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] PATH_INFO: `/v3/users/0cda2b7785b04e0cbf70fb35bfaa7e54` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.619910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cda2b7785b04e0cbf70fb35bfaa7e54)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.622748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:30.627153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.627441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.627768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.654803 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:30.691809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] MFA Rules not processed for user `399a64cd18314620a2e7e0f5b53dda38`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:30.693772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:30.778692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2405/4800] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:30.784121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:30.896202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cda2b7785b04e0cbf70fb35bfaa7e54'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:30.900414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cda2b7785b04e0cbf70fb35bfaa7e54'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:30.920093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cda2b7785b04e0cbf70fb35bfaa7e54'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:30.922515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cda2b7785b04e0cbf70fb35bfaa7e54'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:30.968232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259bbf8-71fe-40b3-aa6e-341c9df3fe83 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:30.979194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:30.981061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:30.981365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:30.983905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:30.983905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:30.984173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:31.040272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cda2b7785b04e0cbf70fb35bfaa7e54'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:31.077531 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2396/4801] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:30 2022] DELETE /identity/v3/users/0cda2b7785b04e0cbf70fb35bfaa7e54 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:31.147730 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2406/4802] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:30 2022] POST /identity/v3/projects => generated 401 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:31.149239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:31.150858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:31.195907 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:31.328381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79cd99-9194-4833-9edf-49376f9d77d1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:31.416298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:31.418907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:31.419567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:31.419567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:31.420319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:31.425272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:31.510600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2397/4803] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:31 2022] POST /identity/v3/users => generated 307 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:31.514823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:31.528270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759eeb-de95-456d-9665-3a05468feb93 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:31.553768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:31.554832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:31.557546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:31.558167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:31.559144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:31.563286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:31.596798 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2407/4804] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:31.600612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:31.616559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9fbb4-d8ff-45b6-85be-6b34c8912e2e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:31.635336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:31.636921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:31.638437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:31.639604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] PATH_INFO: `/v3/projects/d4525e6bb547430bab2b986ea5a4f06c/users/31bd0aee6a1d438da0cce015f5df8542/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:31.698196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4525e6bb547430bab2b986ea5a4f06c, user_id=31bd0aee6a1d438da0cce015f5df8542, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:31.701438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:31.817984 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2398/4805] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:31 2022] PUT /identity/v3/projects/d4525e6bb547430bab2b986ea5a4f06c/users/31bd0aee6a1d438da0cce015f5df8542/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:31.822648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:31.844452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb5e5-033d-4cab-bab4-6182b31a8221 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:32.038449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:32.039803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:32.040863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:32.041145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:32.043276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:32.047527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9629-ff15-469f-ad61-0045a5df7e89 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:32.077928 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2408/4806] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:32.079334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:32.093626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0febd4-9ea3-4bef-80af-ae32cbeafc26 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:32.106810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:32.107965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:32.109064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:32.110537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] PATH_INFO: `/v3/projects/d4525e6bb547430bab2b986ea5a4f06c/users/31bd0aee6a1d438da0cce015f5df8542/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:32.133609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4525e6bb547430bab2b986ea5a4f06c, user_id=31bd0aee6a1d438da0cce015f5df8542, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:32.141653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:32.175933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2399/4807] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:32 2022] PUT /identity/v3/projects/d4525e6bb547430bab2b986ea5a4f06c/users/31bd0aee6a1d438da0cce015f5df8542/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:32.190024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:32.190383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:32.190575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:32.222738 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:32.254413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] MFA Rules not processed for user `31bd0aee6a1d438da0cce015f5df8542`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:32.255530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:32.367833 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2409/4808] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:32.378245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:32.380011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:32.511959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd787aa8-7570-4312-976f-ec0acccec714 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:32.522175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:32.522974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:32.523413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:32.523747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:32.544763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:32.552183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:32.585443 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2400/4809] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:32.883056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:32.907762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8175728-565a-4ee2-9c55-007f00a5b937 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:32.914020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:32.915176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:32.915702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:32.916143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:32.923872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:33.205494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:33.216633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca04e0-97f9-42c8-915a-73440167fe94 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:33.239248 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2410/4810] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:32 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:33.582327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:33.583191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:33.621389 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:33.743921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe64d72-99ac-4ab9-adce-ee5783a97d33 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:33.750068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:33.750724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:33.751001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:33.752933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] PATH_INFO: `/v3/projects/44aa2a491e804503a2af0efc40090c48` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:33.754216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aa2a491e804503a2af0efc40090c48)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:33.756143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:33.897848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aa2a491e804503a2af0efc40090c48', 'request_id': 'req-83056a56-ea6e-498b-934d-1419b9a0cfba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:33.908429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aa2a491e804503a2af0efc40090c48', 'request_id': 'req-83056a56-ea6e-498b-934d-1419b9a0cfba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:34.011507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aa2a491e804503a2af0efc40090c48', 'request_id': 'req-83056a56-ea6e-498b-934d-1419b9a0cfba'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:34.037866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] The token cache is being invalidate because project 44aa2a491e804503a2af0efc40090c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:34.038512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:34.040187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83056a56-ea6e-498b-934d-1419b9a0cfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:34.049284 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2401/4811] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:33 2022] DELETE /identity/v3/projects/44aa2a491e804503a2af0efc40090c48 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:34.054855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:34.055392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:34.055392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:34.139880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:34.146492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:34.342422 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2411/4812] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:34.343390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:34.343715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:34.343991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:34.416858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:34.423141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:34.457894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2402/4813] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:34.461024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:34.479324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377acc8-f976-4867-abaa-1634d9d24e01 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:34.491720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:34.492357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:34.492885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:34.497789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:34.498998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:34.505613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:34.510893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:34.565355 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2412/4814] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:34.566642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:34.589310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64e32f-f4fe-497f-98a1-7af02587fb5c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:34.663369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:34.665121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:34.665726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:34.667287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:34.671657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:34.678416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:34.842757 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2403/4815] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:34 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:34.848684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:34.864297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f59965-d75a-4348-a6e6-0179bd849e21 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:34.902878 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:34.974360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:34.975421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:34.975897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:34.976384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:34.977224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:34.993709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:35.113428 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2413/4816] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:34 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:36:35.114577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:35.138450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5df8-f93e-4694-9338-c6f1d7de3077 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:35.150594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:35.151482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:35.151956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:35.152373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:35.154022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:35.161023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:35.190467 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2404/4817] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:36:35.195062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:35.222452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54aca03-f99a-4a92-9141-f6169abeac4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:35.233798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:35.234892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:35.235470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:35.236012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:35.237103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:35.241569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0880dd-d5a2-4312-b493-45eaf7b04295 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:35.280839 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2414/4818] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:35.283981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:35.301782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f013b-c146-4f62-9a19-bdfd2182c586 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:35.304406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:35.305265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:35.306021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:35.306467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] PATH_INFO: `/v3/projects/dfba2c53653547babd2c307ac842b3eb/users/3b34bb0b37e84efeb6b82ccc832cad19/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:35.326205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfba2c53653547babd2c307ac842b3eb, user_id=3b34bb0b37e84efeb6b82ccc832cad19, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:35.330588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:35.430068 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2405/4819] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:35 2022] PUT /identity/v3/projects/dfba2c53653547babd2c307ac842b3eb/users/3b34bb0b37e84efeb6b82ccc832cad19/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:35.441909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:35.442229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:35.442508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:35.511687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] MFA Rules not processed for user `3b34bb0b37e84efeb6b82ccc832cad19`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:35.516703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:35.694121 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2415/4820] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:35.706452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:35.708188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:35.968001 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:36.075686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc213d73-fc5b-456c-9ebc-3a5811f88ee8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:36.109190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:36.114102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:36.114612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:36.115111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:36.188676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:36.196010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ca507-78a8-4ae9-a714-99d2a090bc35 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:36.220011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2406/4821] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:36:36.294592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:36.484166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e448ad-e720-4106-9761-3b4054a0f4da None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:36.488987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:36.489933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:36.490410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:36.491331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] PATH_INFO: `/v3/users/3b34bb0b37e84efeb6b82ccc832cad19` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:36.504023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b34bb0b37e84efeb6b82ccc832cad19)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:36.518345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:36.659619 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:36.776628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b34bb0b37e84efeb6b82ccc832cad19'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:36.904964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b34bb0b37e84efeb6b82ccc832cad19'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:36.905703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b34bb0b37e84efeb6b82ccc832cad19'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:36.924667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b34bb0b37e84efeb6b82ccc832cad19'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:36.942308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b34bb0b37e84efeb6b82ccc832cad19'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:36.958194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2416/4822] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:36 2022] DELETE /identity/v3/users/3b34bb0b37e84efeb6b82ccc832cad19 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:36.959262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:36.959719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:36.959914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:37.021486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:37.025056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:37.167422 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2407/4823] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:37.195849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:37.197759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:37.320359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bd802-6861-4494-9625-e7a3bcd6d230 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:37.336336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:37.338146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:37.338436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:37.343674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:37.367153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:37.369215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670650cc-d74b-4624-a086-b129be0352bb service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:37.394578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2417/4824] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:41.768220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:41.768220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:41.802477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69128-002f-4043-babc-3db7a300da92 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:41.825494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:41.826335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:41.826623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:41.827743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] PATH_INFO: `/v3/projects/dfba2c53653547babd2c307ac842b3eb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:41.829326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfba2c53653547babd2c307ac842b3eb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:41.834222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:42.073383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfba2c53653547babd2c307ac842b3eb', 'request_id': 'req-0350f7ed-2d27-42a7-8e0a-48ae136df916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:42.095975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfba2c53653547babd2c307ac842b3eb', 'request_id': 'req-0350f7ed-2d27-42a7-8e0a-48ae136df916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:42.211074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfba2c53653547babd2c307ac842b3eb', 'request_id': 'req-0350f7ed-2d27-42a7-8e0a-48ae136df916'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:42.231456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] The token cache is being invalidate because project dfba2c53653547babd2c307ac842b3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:42.235181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:42.236083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0350f7ed-2d27-42a7-8e0a-48ae136df916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:42.257538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:42.258022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:42.258144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:42.260236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2408/4825] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:41 2022] DELETE /identity/v3/projects/dfba2c53653547babd2c307ac842b3eb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:42.297697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:42.300699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:42.439851 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2418/4826] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:42.447357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:42.450851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:42.450851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:42.492274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:42.510947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:42.528157 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2409/4827] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:42.530546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:42.545798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8dfe-8c5c-4b7c-8c49-2606bdf6c0d1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:42.559553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:42.560537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:42.561029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:42.561726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:42.565370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:42.566214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:42.568308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:42.620075 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2419/4828] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:42.624787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:42.663058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79162e7f-6eb9-4ac3-9bbb-c1308cccad05 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:42.688098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:42.689879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:42.695528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:42.695528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:42.695528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:42.695528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:42.917910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2410/4829] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:42 2022] POST /identity/v3/projects => generated 403 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:42.922549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:42.944335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e124ef5-f0b4-4ca0-9e3d-d48460cb285e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:43.071489 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:43.144588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:43.146388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:43.146840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:43.147298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:43.148461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:43.156031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:43.252110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2420/4830] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:42 2022] POST /identity/v3/users => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:36:43.256423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:43.275700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae985-10cb-4586-af95-673f9407c803 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:43.292149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:43.293692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:43.294227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:43.294660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:43.295480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:43.297543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:43.325024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:43.326554 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2411/4831] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:43.345867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deeb7cc-c3f4-451d-ac4d-82f69b19efc4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:43.353633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:43.354549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:43.355573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:43.356009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:43.357030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:43.359002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666fb4-4e00-4388-a913-861dea052d4f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:43.391472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:43.398158 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2421/4832] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:43.409876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdf161-fed9-4db7-9688-3d2d52f1fdae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:43.421947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:43.422901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:43.423344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:43.423810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] PATH_INFO: `/v3/projects/af70cc392a4c44be8696ae62b4f0810f/users/39906435a48e4f8f9d2668b697d9bdbe/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:43.447340 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:43.468105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af70cc392a4c44be8696ae62b4f0810f, user_id=39906435a48e4f8f9d2668b697d9bdbe, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:43.472113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:43.554778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2412/4833] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:43 2022] PUT /identity/v3/projects/af70cc392a4c44be8696ae62b4f0810f/users/39906435a48e4f8f9d2668b697d9bdbe/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:43.564932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:43.565218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:43.565533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:43.625765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] MFA Rules not processed for user `39906435a48e4f8f9d2668b697d9bdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:43.627172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:43.791465 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2422/4834] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:43.792296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.087967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5fc1-e3a9-42b1-94ad-04e11cd77131 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:44.126632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:44.127538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:44.128000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:44.128428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:44.129303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:44.131445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:44.282646 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2413/4835] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:43 2022] POST /identity/v3/projects => generated 401 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:44.282767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.311461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeb60d-eb45-425e-8a52-a8df2ad4e6f9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:44.380055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.382508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:44.494825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:44.495568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:44.496344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:44.497791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:44.499152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:44.503607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:44.533722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2f38-24c2-4ec5-bf91-03dbaf5194e7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:44.548939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:44.549589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:44.550081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:44.550511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:44.552878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:44.577867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:44.584866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:44.613247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2414/4836] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:36:44.633856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2423/4837] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:44 2022] POST /identity/v3/users => generated 307 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:44.635969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.667119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e6819-a3ee-48cc-bd70-4e205487064c service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:44.690745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:44.691376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:44.691657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:44.691927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:44.692769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:44.694454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:44.736627 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2415/4838] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:44.737912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.754440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f24aab-71da-42a7-ba10-07346921f3db admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:44.770529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:44.771216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:44.771509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:44.771765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] PATH_INFO: `/v3/projects/967e368c07144843b1cd80faf2acc901/users/23f706d12a834839a806c968500a5c1b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:44.804932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967e368c07144843b1cd80faf2acc901, user_id=23f706d12a834839a806c968500a5c1b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:44.807705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:44.923637 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2424/4839] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:44 2022] PUT /identity/v3/projects/967e368c07144843b1cd80faf2acc901/users/23f706d12a834839a806c968500a5c1b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:44.927313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:44.947849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358e00f-de1c-4825-8849-967dc7371d5d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:45.118231 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:45.152382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:45.158305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:45.158723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:45.159151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:45.159920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:45.161834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b35413-fb5e-454b-a2f0-c71b10650c4d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:45.213742 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2416/4840] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:45.218372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:45.259094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5205f1-982a-4978-be6f-13d1d2ab0f56 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:45.259094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:45.259094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:45.259094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:45.260613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] PATH_INFO: `/v3/projects/967e368c07144843b1cd80faf2acc901/users/23f706d12a834839a806c968500a5c1b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:45.260613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967e368c07144843b1cd80faf2acc901, user_id=23f706d12a834839a806c968500a5c1b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:45.260970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:45.278247 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:45.318334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:45.318675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:45.319208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:45.321008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2425/4841] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:45 2022] PUT /identity/v3/projects/967e368c07144843b1cd80faf2acc901/users/23f706d12a834839a806c968500a5c1b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:45.388391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] MFA Rules not processed for user `23f706d12a834839a806c968500a5c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:45.389823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:45.571977 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2417/4842] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:45.577489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:45.597789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa2106-6063-411c-915f-775fbc65f701 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:45.606830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f706d12a834839a806c968500a5c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967e368c07144843b1cd80faf2acc901', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:45.607814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:45.608318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:45.608789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:45.609694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:45.614206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:45.722614 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2426/4843] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:36:45 2022] POST /identity/v3/roles => generated 238 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:45.726434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:45.741858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb5dd8-5de8-40c4-a986-947628d08c1c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:45.765135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f706d12a834839a806c968500a5c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967e368c07144843b1cd80faf2acc901', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:45.766578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:45.767088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:45.767604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] PATH_INFO: `/v3/projects/af70cc392a4c44be8696ae62b4f0810f/users/39906435a48e4f8f9d2668b697d9bdbe/roles/0979f6735f2f42589ea6fc05752f645e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:45.779771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorizing `identity:create_grant(project_id=af70cc392a4c44be8696ae62b4f0810f, user_id=39906435a48e4f8f9d2668b697d9bdbe, role_id=0979f6735f2f42589ea6fc05752f645e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:45.779771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:45.885542 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2418/4844] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:45 2022] PUT /identity/v3/projects/af70cc392a4c44be8696ae62b4f0810f/users/39906435a48e4f8f9d2668b697d9bdbe/roles/0979f6735f2f42589ea6fc05752f645e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:45.889928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:45.950599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:45.953160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:46.093237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2c64f-e0f6-41f4-82ae-adf18cfd8d89 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:46.144004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899feb5-3bc2-41c5-b4cf-855202292ba2 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:46.162838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:46.163484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:46.163992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:46.164466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] PATH_INFO: `/v3/users/399a64cd18314620a2e7e0f5b53dda38` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:46.166410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=399a64cd18314620a2e7e0f5b53dda38)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:46.173775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:46.243671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39906435a48e4f8f9d2668b697d9bdbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af70cc392a4c44be8696ae62b4f0810f', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-12750795', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:46.244343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:46.244647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:46.247913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] PATH_INFO: `/v3/users/39906435a48e4f8f9d2668b697d9bdbe/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:46.248664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: Authorizing `identity:create_application_credential(user_id=39906435a48e4f8f9d2668b697d9bdbe)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:46.252544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2d9a6-8e87-49eb-a44f-aab02abb3ab6 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:46.402376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399a64cd18314620a2e7e0f5b53dda38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:46.403704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399a64cd18314620a2e7e0f5b53dda38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:46.422453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399a64cd18314620a2e7e0f5b53dda38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:46.425243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399a64cd18314620a2e7e0f5b53dda38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:46.514009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3dd7e11d-ba65-4b67-adc1-bab421a1cb3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399a64cd18314620a2e7e0f5b53dda38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:46.517906 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:46.553277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2427/4845] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:36:45 2022] POST /identity/v3/users/39906435a48e4f8f9d2668b697d9bdbe/application_credentials => generated 657 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:46.554775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:46.555062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:46.555331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:46.557635 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2419/4846] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:45 2022] DELETE /identity/v3/users/399a64cd18314620a2e7e0f5b53dda38 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:46.565768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1c63-e4c8-4194-95f0-49b255a4d495 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:46.566188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1c63-e4c8-4194-95f0-49b255a4d495 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:46.566950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1c63-e4c8-4194-95f0-49b255a4d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:46.629029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d20c1c63-e4c8-4194-95f0-49b255a4d495 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:46.630625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d20c1c63-e4c8-4194-95f0-49b255a4d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:46.635216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] MFA Rules not processed for user `39906435a48e4f8f9d2668b697d9bdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:46.642548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:46.769152 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2420/4847] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:46.770881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:46.771421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:46.772176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:46.806012 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:46.849586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] MFA Rules not processed for user `93d18cf1316742dab78a102a257608ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:46.851211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:46.961820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2428/4848] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 30 01:36:46.962809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:46.967753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:47.007215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2421/4849] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:47.008534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:47.012551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:47.144979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bca99f-7ca1-406f-9821-7d0bb9f6c82a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:47.154986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:47.155627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:47.156457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:47.156457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:47.194215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:47.195739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:47.199441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b5a0-86be-49dd-8211-6637c1bd2a69 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:47.211115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39906435a48e4f8f9d2668b697d9bdbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af70cc392a4c44be8696ae62b4f0810f', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-12750795', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:47.218214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:47.218214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:47.218214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] PATH_INFO: `/v3/users/39906435a48e4f8f9d2668b697d9bdbe/application_credentials/49879aaa17544182bf1a23fb9fecb7ab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:47.219082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: Authorizing `identity:delete_application_credential(user_id=39906435a48e4f8f9d2668b697d9bdbe, application_credential_id=49879aaa17544182bf1a23fb9fecb7ab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:47.220963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:47.265318 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2429/4850] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:47.269608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:47.279636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:47.334579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2422/4851] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:36:47 2022] DELETE /identity/v3/users/39906435a48e4f8f9d2668b697d9bdbe/application_credentials/49879aaa17544182bf1a23fb9fecb7ab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:47.339188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:47.341213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:47.564750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4255a9-c13e-4d6e-8432-ba6921991d52 tempest-ApplicationCredentialsV3AdminTest-2055520989 tempest-ApplicationCredentialsV3AdminTest-2055520989-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:47.579798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f706d12a834839a806c968500a5c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '967e368c07144843b1cd80faf2acc901', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:47.580508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:47.580853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:47.581139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] PATH_INFO: `/v3/roles/0979f6735f2f42589ea6fc05752f645e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:47.582914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0979f6735f2f42589ea6fc05752f645e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:47.586195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79677cca-0de6-47b9-b912-3a8ca9f65fdf service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:47.586698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:47.600736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:47.601805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:47.603018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:47.603931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:47.648536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:47.650985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:47.719991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2430/4852] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:47.826170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Invalidating the token cache because role 0979f6735f2f42589ea6fc05752f645e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:47.826540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:47.827242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d8974f82-7c5a-4848-a4f3-71486feca984 tempest-ApplicationCredentialsV3AdminTest-314995742 tempest-ApplicationCredentialsV3AdminTest-314995742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:47.832989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2423/4853] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:47 2022] DELETE /identity/v3/roles/0979f6735f2f42589ea6fc05752f645e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:36:47.835535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:47.836995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:47.870626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff55ac-5bf8-4029-899a-f7a4fc432ee7 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:48.028635 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:48.062767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:48.063415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:48.063691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:48.063955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] PATH_INFO: `/v3/users/39906435a48e4f8f9d2668b697d9bdbe` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:48.065095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39906435a48e4f8f9d2668b697d9bdbe)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:48.067060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:48.324407 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:48.371864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39906435a48e4f8f9d2668b697d9bdbe'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:48.456429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39906435a48e4f8f9d2668b697d9bdbe'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:48.457063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39906435a48e4f8f9d2668b697d9bdbe'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:48.488218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39906435a48e4f8f9d2668b697d9bdbe'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:48.520171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39906435a48e4f8f9d2668b697d9bdbe'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:48.546409 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2431/4854] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:47 2022] DELETE /identity/v3/users/39906435a48e4f8f9d2668b697d9bdbe => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:48.551131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461672e-b613-421d-82d4-0953be53a415 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:48.554057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461672e-b613-421d-82d4-0953be53a415 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:48.554057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461672e-b613-421d-82d4-0953be53a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:48.594661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f461672e-b613-421d-82d4-0953be53a415 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:48.594661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f461672e-b613-421d-82d4-0953be53a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:48.717961 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2424/4855] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:48.751961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:48.753451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:48.929512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9ed1-d078-4202-b2bf-877514e47f36 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:48.939181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:48.939813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:48.941843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:48.942310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:48.970760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:48.976860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:49.010202 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2432/4856] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:49.428212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461672e-b613-421d-82d4-0953be53a415 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:49.429808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f461672e-b613-421d-82d4-0953be53a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:49.452805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461672e-b613-421d-82d4-0953be53a415 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:49.462532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:49.463329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:49.463708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:49.464597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] PATH_INFO: `/v3/projects/61dcf9c752e044e5aea45ffdc0d00d33` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:49.468114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61dcf9c752e044e5aea45ffdc0d00d33)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:49.470342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:49.648268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61dcf9c752e044e5aea45ffdc0d00d33', 'request_id': 'req-9d79dd48-4c85-4a83-b677-efb47c016e73'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:49.660739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61dcf9c752e044e5aea45ffdc0d00d33', 'request_id': 'req-9d79dd48-4c85-4a83-b677-efb47c016e73'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:49.663570 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:49.774626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61dcf9c752e044e5aea45ffdc0d00d33', 'request_id': 'req-9d79dd48-4c85-4a83-b677-efb47c016e73'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:49.794955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] The token cache is being invalidate because project 61dcf9c752e044e5aea45ffdc0d00d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:49.795587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:49.802958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:49.808144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2425/4857] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:49 2022] DELETE /identity/v3/projects/61dcf9c752e044e5aea45ffdc0d00d33 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:49.812328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:49.828045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789362-4c72-4565-8ec4-1095dc932b0f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:49.872259 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:50.030649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:50.031294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:50.031549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:50.032012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] PATH_INFO: `/v3/users/31bd0aee6a1d438da0cce015f5df8542` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:50.034072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bd0aee6a1d438da0cce015f5df8542)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:50.036200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:50.302765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bd0aee6a1d438da0cce015f5df8542'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:50.479590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bd0aee6a1d438da0cce015f5df8542'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:50.480780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bd0aee6a1d438da0cce015f5df8542'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:50.514028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bd0aee6a1d438da0cce015f5df8542'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:50.532148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bd0aee6a1d438da0cce015f5df8542'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:50.553158 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2433/4858] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:49 2022] DELETE /identity/v3/users/31bd0aee6a1d438da0cce015f5df8542 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:51.331648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:51.333902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:51.381027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79dd48-4c85-4a83-b677-efb47c016e73 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:51.524865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:51.526021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:51.526542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:51.527334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] PATH_INFO: `/v3/projects/af70cc392a4c44be8696ae62b4f0810f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:51.528906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af70cc392a4c44be8696ae62b4f0810f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:51.532382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:51.753609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af70cc392a4c44be8696ae62b4f0810f', 'request_id': 'req-5ee837a3-2abd-47dc-a94f-6418aaa5202b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:51.780808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af70cc392a4c44be8696ae62b4f0810f', 'request_id': 'req-5ee837a3-2abd-47dc-a94f-6418aaa5202b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:51.896871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af70cc392a4c44be8696ae62b4f0810f', 'request_id': 'req-5ee837a3-2abd-47dc-a94f-6418aaa5202b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:51.936984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] The token cache is being invalidate because project af70cc392a4c44be8696ae62b4f0810f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:51.937564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:51.938417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:51.956014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2426/4859] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:51 2022] DELETE /identity/v3/projects/af70cc392a4c44be8696ae62b4f0810f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:51.961731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:51.965979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:52.008799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb680c98-d7e5-4875-a39d-5d7e66ef153e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:52.163741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:52.164670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:52.166218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:52.166218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] PATH_INFO: `/v3/users/23f706d12a834839a806c968500a5c1b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:52.174444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f706d12a834839a806c968500a5c1b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:52.176840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:52.431397 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:52.457422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f706d12a834839a806c968500a5c1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:52.542221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f706d12a834839a806c968500a5c1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:52.543549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f706d12a834839a806c968500a5c1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:52.566282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f706d12a834839a806c968500a5c1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:52.598106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3cb1950a-0312-411e-9af2-3b4d16a41172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f706d12a834839a806c968500a5c1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:52.616475 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2434/4860] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:36:51 2022] DELETE /identity/v3/users/23f706d12a834839a806c968500a5c1b => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:53.430347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:53.433481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:53.473910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee837a3-2abd-47dc-a94f-6418aaa5202b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:53.637260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:53.638605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:53.638890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:53.639170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] PATH_INFO: `/v3/projects/d4525e6bb547430bab2b986ea5a4f06c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:53.640450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4525e6bb547430bab2b986ea5a4f06c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:53.652336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:53.675290 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:53.801393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4525e6bb547430bab2b986ea5a4f06c', 'request_id': 'req-c57911a6-105b-4163-acc7-123b84b98e7b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:53.817538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4525e6bb547430bab2b986ea5a4f06c', 'request_id': 'req-c57911a6-105b-4163-acc7-123b84b98e7b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:53.925519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4525e6bb547430bab2b986ea5a4f06c', 'request_id': 'req-c57911a6-105b-4163-acc7-123b84b98e7b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:53.947457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] The token cache is being invalidate because project d4525e6bb547430bab2b986ea5a4f06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:53.952761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:53.954950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c57911a6-105b-4163-acc7-123b84b98e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:53.962723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2427/4861] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:53 2022] DELETE /identity/v3/projects/d4525e6bb547430bab2b986ea5a4f06c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:53.968698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:53.972720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:53.973755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.016601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:54.019702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:54.145445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2435/4862] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:54.147785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.149124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.149508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.204892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:54.205522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:54.219653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2428/4863] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:54.222626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.247764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25687-9034-472d-8af3-9a5716578a6b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:54.256219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:54.257093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.258033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.258479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.259308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:54.259788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:54.262611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:54.290251 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2436/4864] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:54.292008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.303007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5799b-43c2-4f6d-9a14-9f424ed229dc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:54.318720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:54.319620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.321496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.321921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.322734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:54.327536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:54.503300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.512870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2429/4865] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:54 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:54.517494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcccd2-ca62-4b2c-a776-7baf89e2a5e5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:54.734256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:54.735147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.735654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.736087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.736874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:54.742217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:54.879945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.890597 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2437/4866] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:54 2022] POST /identity/v3/users => generated 292 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:54.896496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd7fb8-badf-4af3-b1e9-2e120274e58b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:54.910969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:54.911601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.911878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.912150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.912800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:54.918630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:54.944032 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2430/4867] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:54.948055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.964945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a2e43-27a2-4f88-b6b8-7cb53682bf7d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:54.975548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:54.977893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:54.984173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:54.987303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:54.987303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:54.988068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:54.988776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:54.994199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:55.016627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a768bb-c3be-488b-b23e-cb06d262e6af admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:55.023726 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2438/4868] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:55.025199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:55.030937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:55.032552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.034900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.035312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] PATH_INFO: `/v3/projects/967e368c07144843b1cd80faf2acc901` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.039540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967e368c07144843b1cd80faf2acc901)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:55.044726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:55.062551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513d084-4a07-405b-883e-b17b61e5fd1c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:55.076875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:55.079098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.079098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.079098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] PATH_INFO: `/v3/projects/8a0f8b357f174f559084ef648b246202/users/9a18405b6d9143fcb1c31f8616242597/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.114272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0f8b357f174f559084ef648b246202, user_id=9a18405b6d9143fcb1c31f8616242597, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:55.117566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2ff2-2b16-4b3e-bc67-4b88c2f305d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:55.131810 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:55.205257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2439/4869] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:55 2022] PUT /identity/v3/projects/8a0f8b357f174f559084ef648b246202/users/9a18405b6d9143fcb1c31f8616242597/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:55.217537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.220078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.220078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.220694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967e368c07144843b1cd80faf2acc901', 'request_id': 'req-0cc674b8-169f-4cf9-8414-df029916d5e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:55.231396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967e368c07144843b1cd80faf2acc901', 'request_id': 'req-0cc674b8-169f-4cf9-8414-df029916d5e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:55.324153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] MFA Rules not processed for user `9a18405b6d9143fcb1c31f8616242597`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:55.328507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:55.332107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967e368c07144843b1cd80faf2acc901', 'request_id': 'req-0cc674b8-169f-4cf9-8414-df029916d5e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:55.431174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] The token cache is being invalidate because project 967e368c07144843b1cd80faf2acc901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:36:55.431674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:55.433289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cc674b8-169f-4cf9-8414-df029916d5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:36:55.438135 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2431/4870] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:36:54 2022] DELETE /identity/v3/projects/967e368c07144843b1cd80faf2acc901 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:55.442108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33332be-cd14-4665-9fa6-b8f05e77f8b0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.442575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33332be-cd14-4665-9fa6-b8f05e77f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.443029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33332be-cd14-4665-9fa6-b8f05e77f8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.470387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e33332be-cd14-4665-9fa6-b8f05e77f8b0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:55.472518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e33332be-cd14-4665-9fa6-b8f05e77f8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:55.526796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2440/4871] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:55.527943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:55.531017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:55.592980 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:55.619129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2432/4872] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:55.628466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.628869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.629455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.672346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:55.674098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:55.691927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfb59-65c0-41e2-bcc3-54c7d3a0c171 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:55.703329 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2433/4873] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:55.707885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:55.726069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:55.726699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.727110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.727400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.728028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:55.730610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:55.734386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ea478-360f-44c2-94eb-c4a6623b2d53 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:55.746796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:55.747608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:55.747990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:55.748347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:55.749101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:36:55.750237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:55.752480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:55.814531 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2434/4874] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:55.826916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:55.859012 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2441/4875] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/projects => generated 381 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:55.859512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:55.868114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bc5bf-f655-4f65-93f6-20119f6bef77 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.003615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d57148-7100-4e00-9b15-09b6e9065ac7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.011385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.011385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.011385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.011385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.011887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.013131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.021151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.021818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.022098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.022372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.023073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.027247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.158522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2442/4876] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:56.159822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.160342 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2435/4877] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:55 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:56.164308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.175419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852145e-e473-4b96-b460-d69734770ed7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.251385 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:56.281561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.282459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.282735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.283006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.283660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.290601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.304749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750885-2ef3-44ef-a01c-8ea1f0cd6b06 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.312082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2443/4878] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:56.316864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.324223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.324904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.325185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.325483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.326281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.331453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.342394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b55f6-79a9-47a3-b0d9-d919d26e013b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.355759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.356349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.356626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.356893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] PATH_INFO: `/v3/projects/ea8dc1ba7d0a4879966488880b5695bf/users/a2355930aa5e49719556606954d41134/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.380704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8dc1ba7d0a4879966488880b5695bf, user_id=a2355930aa5e49719556606954d41134, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.385040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.506042 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2444/4879] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:56 2022] PUT /identity/v3/projects/ea8dc1ba7d0a4879966488880b5695bf/users/a2355930aa5e49719556606954d41134/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:56.508285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.510428 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2436/4880] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:56 2022] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:56.512463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.556774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09945-4046-4368-8cc0-bff825535e9c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.705576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55cf26-1c5b-4444-b6ce-771650153727 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.741016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.744248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.744532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.744802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.764866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.770604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.771762 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:56.809422 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2445/4881] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:56.812876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.816313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.816935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.817222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.817532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.818312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.820174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.827577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a38a-8069-44a2-938e-7a09a10af51c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.847237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.847560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.847743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.848687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.849382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.850998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.856543 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2437/4882] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:56.857710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.908492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2446/4883] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:36:56.913841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:56.915140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97dca-c8c8-4709-9eb8-97e9ae5b0775 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.936079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.941644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d772a92-1b33-49ba-8e68-0c7fffdedcaa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:56.949226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.950841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.951080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] PATH_INFO: `/v3/projects/ea8dc1ba7d0a4879966488880b5695bf/users/a2355930aa5e49719556606954d41134/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.960862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea8dc1ba7d0a4879966488880b5695bf, user_id=a2355930aa5e49719556606954d41134, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:56.962125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:56.963808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:56.964125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:56.966435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] PATH_INFO: `/v3/projects/3215daccfd2f40b5ad2d38b982f26f08/users/5c3764d81b3d4a7a9bf7519884271e78/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:56.972828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e24375-a113-4dfe-80d4-a76abcae8a48 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:56.990687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2438/4884] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:56 2022] PUT /identity/v3/projects/ea8dc1ba7d0a4879966488880b5695bf/users/a2355930aa5e49719556606954d41134/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:57.001780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0326a1-5b32-4333-98c4-301eed5c7a29 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.006615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0326a1-5b32-4333-98c4-301eed5c7a29 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.006615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0326a1-5b32-4333-98c4-301eed5c7a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.025040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3215daccfd2f40b5ad2d38b982f26f08, user_id=5c3764d81b3d4a7a9bf7519884271e78, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:57.029832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e196e5-da31-45e6-b9a6-15fec4b5abaf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:57.035427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1a0326a1-5b32-4333-98c4-301eed5c7a29 None None] MFA Rules not processed for user `a2355930aa5e49719556606954d41134`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:57.039265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a0326a1-5b32-4333-98c4-301eed5c7a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:57.133209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2447/4885] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:56 2022] PUT /identity/v3/projects/3215daccfd2f40b5ad2d38b982f26f08/users/5c3764d81b3d4a7a9bf7519884271e78/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:57.136390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.136390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.138856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.183559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] MFA Rules not processed for user `93d18cf1316742dab78a102a257608ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:57.186089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:57.210868 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2439/4886] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:36:57.210868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.210868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.210868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.247693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] MFA Rules not processed for user `5c3764d81b3d4a7a9bf7519884271e78`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:57.249473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:57.296690 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:57.332360 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2448/4887] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:57.333640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:57.335205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:57.397749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2440/4888] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:57.399148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:57.428021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759b0be-c7eb-41f2-8fd2-d920906f2108 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:57.433950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:57.434621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.434981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.435174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.537680 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:57.545899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:57.548434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:57.551038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6151c2-9375-480c-8bad-a176f541dd9f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:57.558516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:57.559748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.560076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.560355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.561942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:57.565840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:57.585782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2449/4889] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:36:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:36:57.713544 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2441/4890] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:57 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:36:57.715561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:57.733005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae63e-24e2-470f-be03-7d1da15fba96 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:57.880690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:57.882037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:57.882813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:57.887842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:57.888997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:57.892299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:58.014964 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2450/4891] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:36:57 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:36:58.016108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:58.046463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65dfb2-2f9f-4900-a3cc-ff25f896be03 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:58.055184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:58.055813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.056092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.056369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.057061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:58.059277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:58.088635 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2442/4892] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:36:58.090452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:58.118876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29b9b3-f23d-48b4-becc-4c1e80195aae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:58.142740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:58.143425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.143705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.143976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] PATH_INFO: `/v3/projects/41b71cb13ef843639ed5621432ab7261/users/8fe9acacffd34181b79e10145430a95b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.172119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b71cb13ef843639ed5621432ab7261, user_id=8fe9acacffd34181b79e10145430a95b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:58.178115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:58.317871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2451/4893] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:58 2022] PUT /identity/v3/projects/41b71cb13ef843639ed5621432ab7261/users/8fe9acacffd34181b79e10145430a95b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:58.321631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:58.335096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd324dc1-1df9-4d70-9c34-b1974323bdaf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:58.442193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:58.445095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.445618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.446267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.447502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:58.450521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995d5f0-ff4c-4788-8868-faeddd49e6ac admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:58.466132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2443/4894] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:36:58.467280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:58.485436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115392-4abc-40cc-9546-88fdd3e68701 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:58.523161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:58.536344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.536344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.536344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] PATH_INFO: `/v3/projects/41b71cb13ef843639ed5621432ab7261/users/8fe9acacffd34181b79e10145430a95b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.541213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b71cb13ef843639ed5621432ab7261, user_id=8fe9acacffd34181b79e10145430a95b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:58.545387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:58.561742 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2452/4895] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:36:58 2022] PUT /identity/v3/projects/41b71cb13ef843639ed5621432ab7261/users/8fe9acacffd34181b79e10145430a95b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:36:58.584256 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:58.666118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.666866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.667954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.716449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] MFA Rules not processed for user `8fe9acacffd34181b79e10145430a95b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:36:58.720374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:36:58.895656 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2444/4896] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:36:58.903177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:58.916628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69713506-51f9-4c16-9535-e1d5f0d79759 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:58.926411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:58.929661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:58.929661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:58.929661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:58.929661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:58.932433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:59.067503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2453/4897] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:36:58 2022] POST /identity/v3/projects => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:59.071477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:59.085976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891c3d-6903-45d0-8e92-d6174a4f4dcc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:59.169300 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:36:59.229188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:59.232989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:59.233368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:59.233836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:59.235170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:59.239391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:59.430996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2445/4898] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:36:59 2022] POST /identity/v3/projects => generated 350 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:59.434980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:59.450608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211647f8-09f4-42f4-9b1f-59f662fe6891 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:59.538985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:59.539989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:59.540599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:59.541094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/users/5c3764d81b3d4a7a9bf7519884271e78` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:59.542802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:get_user(user_id=5c3764d81b3d4a7a9bf7519884271e78)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:59.545680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:59.548573 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2454/4899] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:36:59 2022] GET /identity/v3/users/5c3764d81b3d4a7a9bf7519884271e78 => generated 288 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:36:59.553818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:59.578259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec7685-1378-436c-88a5-318f8996be7b tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:59.629213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:59.630258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:59.632919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:59.633316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:59.634138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:59.636695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:59.759063 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2446/4900] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 30 01:36:59 2022] POST /identity/v3/credentials => generated 428 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:36:59.763554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:36:59.779401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c3f21-7a2d-49c4-9b8c-c344e0bf6f21 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:36:59.815802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:36:59.815802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:36:59.815802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:36:59.816134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:36:59.816134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:59.816134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:36:59.827467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:36:59.829230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.119984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.121701 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2455/4901] 10.222.0.13 () {60 vars in 1358 bytes} [Sun Oct 30 01:36:59 2022] PATCH /identity/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3 => generated 436 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:00.136243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f065666-35a1-4d41-808f-83c4628bb5e9 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.159243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.159243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.159243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.159668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.179510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.189574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.199547 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2447/4902] 10.222.0.13 () {58 vars in 1335 bytes} [Sun Oct 30 01:37:00 2022] GET /identity/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3 => generated 436 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:00.203125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.216778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374e43-90f6-4d6e-a07e-1532b53721dd tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.230170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.230905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.231254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.231597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.235531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.239191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.359404 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2456/4903] 10.222.0.13 () {58 vars in 1338 bytes} [Sun Oct 30 01:37:00 2022] DELETE /identity/v3/credentials/09705e854ab9d118f4557d7a000d7d47552a6967974bf67abf05353f8f4b94f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:00.366544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.383374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912d3ec-797d-45f9-92d5-91f864fefd66 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.393109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.394096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.394569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.395019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.395848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.398027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.514701 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2448/4904] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 30 01:37:00 2022] POST /identity/v3/credentials => generated 430 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:00.515957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.535482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257c0e5-e909-4a2e-9a0e-95ee7e2ba75d tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.548177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.550532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.550995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.551326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.552768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.560723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.679038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2457/4905] 10.222.0.13 () {60 vars in 1162 bytes} [Sun Oct 30 01:37:00 2022] POST /identity/v3/credentials => generated 431 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:00.683132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.722216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84ee76-9040-46c8-90ee-bdce0259aa8a tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.768795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.769520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.769808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.770085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.770719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.772313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.791061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.793583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.796980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.801872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:00.804765 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2449/4906] 10.222.0.13 () {58 vars in 1140 bytes} [Sun Oct 30 01:37:00 2022] GET /identity/v3/credentials => generated 946 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:00.814261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:00.915333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7470-d0d3-49ca-b3ac-11e5f8158daa tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:00.938001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:00.938715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:00.938999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:00.939270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials/36778927a525c825b24aaf6d99dc4c0046c468fd232d61910a972f74e10001ce` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:00.944516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=36778927a525c825b24aaf6d99dc4c0046c468fd232d61910a972f74e10001ce)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:00.954068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:01.075022 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2458/4907] 10.222.0.13 () {58 vars in 1338 bytes} [Sun Oct 30 01:37:00 2022] DELETE /identity/v3/credentials/36778927a525c825b24aaf6d99dc4c0046c468fd232d61910a972f74e10001ce => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:01.081919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:01.096810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047182a0-eee9-4b0a-a9ab-d7186b0a66f5 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:01.119775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:01.124153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:01.124718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:01.127020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/credentials/0f4b91294e28af8a03e613ac1bc81b6a7af550bc570f2c40643e833fa225838f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:01.134011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0f4b91294e28af8a03e613ac1bc81b6a7af550bc570f2c40643e833fa225838f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:01.141471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:01.246903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2450/4908] 10.222.0.13 () {58 vars in 1338 bytes} [Sun Oct 30 01:37:01 2022] DELETE /identity/v3/credentials/0f4b91294e28af8a03e613ac1bc81b6a7af550bc570f2c40643e833fa225838f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:01.256390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:01.270886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308a5a2-c8dd-4864-a0c8-9ae89dd6f1bf tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:01.289899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:01.290548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:01.290858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:01.291132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/projects/97d46517fbe94492bff3f59e545dd1bc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:01.292831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97d46517fbe94492bff3f59e545dd1bc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:01.294926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:01.492175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d46517fbe94492bff3f59e545dd1bc', 'request_id': 'req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.570952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d46517fbe94492bff3f59e545dd1bc', 'request_id': 'req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.587105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d46517fbe94492bff3f59e545dd1bc', 'request_id': 'req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.592773 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:01.611057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] The token cache is being invalidate because project 97d46517fbe94492bff3f59e545dd1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:01.611641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.612625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.614572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2459/4909] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:01 2022] DELETE /identity/v3/projects/97d46517fbe94492bff3f59e545dd1bc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:01.619159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:01.621516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:01.642471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3928e6d-de50-4755-bd29-6e66cad6c381 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:01.788478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe9acacffd34181b79e10145430a95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41b71cb13ef843639ed5621432ab7261', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:01.788919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:01.789201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:01.789550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] PATH_INFO: `/v3/projects/0f336776727a4a36b78fe98bd13f54fe` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:01.790842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f336776727a4a36b78fe98bd13f54fe)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:01.794225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:01.975880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f336776727a4a36b78fe98bd13f54fe', 'request_id': 'req-ea94fef7-9225-4696-91a0-46aa34275f80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:01.988233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f336776727a4a36b78fe98bd13f54fe', 'request_id': 'req-ea94fef7-9225-4696-91a0-46aa34275f80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.085365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f336776727a4a36b78fe98bd13f54fe', 'request_id': 'req-ea94fef7-9225-4696-91a0-46aa34275f80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.101360 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:02.113696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] The token cache is being invalidate because project 0f336776727a4a36b78fe98bd13f54fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:02.114383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.118227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.127008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:02.128707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2451/4910] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:01 2022] DELETE /identity/v3/projects/0f336776727a4a36b78fe98bd13f54fe => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:02.129182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:02.308053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2bd6-e3d1-4744-8e34-0112afaafe13 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:02.465763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:02.466665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:02.467485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:02.467930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] PATH_INFO: `/v3/users/5c3764d81b3d4a7a9bf7519884271e78` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:02.470404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3764d81b3d4a7a9bf7519884271e78)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:02.473343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:02.669446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:02.671162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:02.767591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3764d81b3d4a7a9bf7519884271e78'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.857501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3764d81b3d4a7a9bf7519884271e78'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.858189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3764d81b3d4a7a9bf7519884271e78'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.866534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94fef7-9225-4696-91a0-46aa34275f80 tempest-CredentialsTestJSON-1636015334 tempest-CredentialsTestJSON-1636015334-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:02.872450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:02.873211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:02.873552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:02.873822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:02.876606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:02.881585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3764d81b3d4a7a9bf7519884271e78'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.905801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b0e567d-22cb-4ba2-9f55-12c961cbbcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3764d81b3d4a7a9bf7519884271e78'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:02.908810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:02.910435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:02.920688 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2460/4911] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:02 2022] DELETE /identity/v3/users/5c3764d81b3d4a7a9bf7519884271e78 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:02.925783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:02.930069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:02.930069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:02.944914 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2452/4912] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:37:02.959989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:02.968254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:03.075498 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2461/4913] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:03.112454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:03.115257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:03.301007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c72ce-d0b6-4ece-ae5c-c5268ce37939 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:03.404737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:03.406352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:03.406641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:03.406922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:03.430681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:03.432319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:03.469657 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2453/4914] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:37:05.007966 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:06.256260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:06.257964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:06.281170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e134a-fc21-4670-90ab-3b9a3e8e3527 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:06.292860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:06.293992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:06.294475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:06.295103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] PATH_INFO: `/v3/projects/3215daccfd2f40b5ad2d38b982f26f08` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:06.297764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3215daccfd2f40b5ad2d38b982f26f08)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:06.299959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:06.483807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3215daccfd2f40b5ad2d38b982f26f08', 'request_id': 'req-7c6f5ab1-5015-4083-b472-22527e3829d7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:06.633703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3215daccfd2f40b5ad2d38b982f26f08', 'request_id': 'req-7c6f5ab1-5015-4083-b472-22527e3829d7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:06.642287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3215daccfd2f40b5ad2d38b982f26f08', 'request_id': 'req-7c6f5ab1-5015-4083-b472-22527e3829d7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:06.674845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] The token cache is being invalidate because project 3215daccfd2f40b5ad2d38b982f26f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:06.675142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:06.680328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:06.688079 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2462/4915] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:06 2022] DELETE /identity/v3/projects/3215daccfd2f40b5ad2d38b982f26f08 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:06.689376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:06.700209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36698b81-9036-4a8f-8f97-07443722a8a0 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:06.833369 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:06.861506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:06.862329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:06.862715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:06.863088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] PATH_INFO: `/v3/users/8fe9acacffd34181b79e10145430a95b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:06.864864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe9acacffd34181b79e10145430a95b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:06.871001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:07.136848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe9acacffd34181b79e10145430a95b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:07.137710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe9acacffd34181b79e10145430a95b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:07.154496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe9acacffd34181b79e10145430a95b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:07.160717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe9acacffd34181b79e10145430a95b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:07.256504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a7f9de6-cfa1-40cb-b49f-f465f1c3c4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe9acacffd34181b79e10145430a95b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:07.291058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2454/4916] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:06 2022] DELETE /identity/v3/users/8fe9acacffd34181b79e10145430a95b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:08.813987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:08.815677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:08.846360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f5ab1-5015-4083-b472-22527e3829d7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:08.985142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:08.985899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:08.986183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:08.986465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] PATH_INFO: `/v3/projects/41b71cb13ef843639ed5621432ab7261` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:08.992992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b71cb13ef843639ed5621432ab7261)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:08.995135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:09.182763 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:09.193137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b71cb13ef843639ed5621432ab7261', 'request_id': 'req-9702cce3-480b-43b4-bc91-3fa7b0d4c307'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:09.327191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b71cb13ef843639ed5621432ab7261', 'request_id': 'req-9702cce3-480b-43b4-bc91-3fa7b0d4c307'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:09.343221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b71cb13ef843639ed5621432ab7261', 'request_id': 'req-9702cce3-480b-43b4-bc91-3fa7b0d4c307'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:09.368977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] The token cache is being invalidate because project 41b71cb13ef843639ed5621432ab7261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:09.371476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:09.373501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9702cce3-480b-43b4-bc91-3fa7b0d4c307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:09.377247 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2463/4917] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:08 2022] DELETE /identity/v3/projects/41b71cb13ef843639ed5621432ab7261 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:09.382454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:09.386504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:09.386504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:09.418284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:09.421609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:09.566918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2455/4918] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:37:09.575341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:09.576164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:09.577498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:09.605937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:09.607730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:09.626986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2464/4919] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:09.630869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:09.657695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b77e-7eb3-4866-84cf-59bf93eea570 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:09.664775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:09.666146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:09.666710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:09.671308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:09.673813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:37:09.674971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:09.677037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:09.703032 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2456/4920] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:09.706355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:09.723054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bc2e0-b466-4998-afea-8d914b16bd29 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:09.731691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:09.732951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:09.733785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:09.741919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:09.743585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:09.747133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:09.898966 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2465/4921] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:09 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:09.904042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:09.915928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbc580-e950-4694-a482-edd8b8e4d8b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:10.049901 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:10.085130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:10.087268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.087773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.088997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.089771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:10.093845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:10.233826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2457/4922] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:09 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:10.235046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:10.250927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f6429-29a7-44d0-b314-f419f3beea3a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:10.265844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:10.266479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.266959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.267230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.268034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:10.269749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:10.298903 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2466/4923] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:10.304102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:10.335877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f158038-a0c9-419e-944d-61600ee63b6c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:10.342595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:10.343436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.344214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.344651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.345741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:10.350540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557805-4f7e-428e-a906-9dbcc7311b26 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:10.379841 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2458/4924] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:10.383669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:10.401916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b1f5-8cad-47ae-83a4-5aa399094221 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:10.412946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:10.413861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.414245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.414618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] PATH_INFO: `/v3/projects/782f1a181a7e471da74bc3a335036199/users/ada5848e747f407999ae0623664f526e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.440008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782f1a181a7e471da74bc3a335036199, user_id=ada5848e747f407999ae0623664f526e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:10.443380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:10.521385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2467/4925] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:10 2022] PUT /identity/v3/projects/782f1a181a7e471da74bc3a335036199/users/ada5848e747f407999ae0623664f526e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:10.527974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.529190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.529731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.594272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] MFA Rules not processed for user `ada5848e747f407999ae0623664f526e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:10.596233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:10.727304 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2459/4926] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:10.731619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:10.883558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1946dab-bb33-4907-9a06-8e862935fec4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:10.883558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:10.883558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:10.883558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:10.883940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:10.884041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:10.886730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.022377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:11.023470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2468/4927] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:11.042831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45b55e-726d-410f-b06b-d5ad25f9d12c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:11.256573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:11.257610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.258303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.258795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.259758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:11.265924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.397780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2460/4928] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:11 2022] POST /identity/v3/users => generated 298 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:11.402743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:11.422188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e6f6c-8841-43e0-9a44-c784acf2577c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:11.435465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:11.436318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.439618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.440188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.442766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:11.444592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.460614 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2469/4929] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:11.464987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:11.494174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b72731-e403-43c0-a18b-725695e57e34 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:11.504282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:11.505518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.506172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.506654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] PATH_INFO: `/v3/projects/c527c3160a304f6f98050b4988a09094/users/7f7d8ac414664d4d9f124194d47fd2cc/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.526879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c527c3160a304f6f98050b4988a09094, user_id=7f7d8ac414664d4d9f124194d47fd2cc, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:11.530113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.634856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2461/4930] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:11 2022] PUT /identity/v3/projects/c527c3160a304f6f98050b4988a09094/users/7f7d8ac414664d4d9f124194d47fd2cc/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:11.638977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:11.652274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6af76-95f5-408f-829a-5e80cafa24cc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:11.712477 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:11.735792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:11.741370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.741370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.741370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.741370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:11.741370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3d6b7-64b7-478c-aa5b-1a14d127c892 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.757382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2470/4931] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:11.759725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:11.773268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2351-8020-45e3-8655-fc71986b9b81 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:11.796529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:11.797447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.798349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.798349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] PATH_INFO: `/v3/projects/c527c3160a304f6f98050b4988a09094/users/7f7d8ac414664d4d9f124194d47fd2cc/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.801916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c527c3160a304f6f98050b4988a09094, user_id=7f7d8ac414664d4d9f124194d47fd2cc, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:11.810282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:11.826377 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2462/4932] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:11 2022] PUT /identity/v3/projects/c527c3160a304f6f98050b4988a09094/users/7f7d8ac414664d4d9f124194d47fd2cc/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:11.836206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:11.836733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:11.837160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:11.903303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] MFA Rules not processed for user `7f7d8ac414664d4d9f124194d47fd2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:11.904630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:12.001379 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2471/4933] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:12.003858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.020077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4bc56-59cc-434f-b954-5b8c2c4ea489 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.024607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.025207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.025541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.025813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.027005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.028688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invalid input for field 'name': '' is too short Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: On instance['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: On instance['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: '' Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise error Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application '' Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.045064 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:37:12.046708 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application '' Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:12.047878 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2463/4934] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:12 2022] POST /identity/v3/domains => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:37:12.052512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.062279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc165c6-e4e4-4635-acaf-8d02db6b5af5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.067825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.068889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.069385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.070118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.070966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.072788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: On instance['name']: Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: On instance['name']: Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise error Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.084547 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 30 01:37:12.087609 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.089645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2472/4935] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:12 2022] POST /identity/v3/domains => generated 412 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:37:12.091414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.102631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca9927-a208-410b-8371-b70d23a82bc0 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.121898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.122682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.123067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.123455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.124223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.126049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.200447 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:12.226995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2464/4936] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:12 2022] POST /identity/v3/domains => generated 276 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:12.230132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.243036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e89-e101-4403-85b1-551f5442b333 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.365962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.366717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.367056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.367635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/b7b3183dad314e72be6a2171e6469857` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.384273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b7b3183dad314e72be6a2171e6469857)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.387622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 30 01:37:12.410414 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 30 01:37:12.411655 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:12.417221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2473/4937] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:12 2022] DELETE /identity/v3/domains/b7b3183dad314e72be6a2171e6469857 => generated 120 bytes in 188 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:12.418181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.432624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa9be0-d69c-4426-90ab-0d1bcb3493ce tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.437958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.438787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.439258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.439690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/b7b3183dad314e72be6a2171e6469857` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.441217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b7b3183dad314e72be6a2171e6469857)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.443010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.467795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.468965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.582025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.583544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.587162 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2465/4938] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:12 2022] PATCH /identity/v3/domains/b7b3183dad314e72be6a2171e6469857 => generated 277 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:12.591382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:12.598753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:12.624323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e518ab-0733-4fd6-afa6-e5244dbaf411 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:12.687536 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:12.705038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:12.717425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:12.717425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:12.717425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/b7b3183dad314e72be6a2171e6469857` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:12.719835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b7b3183dad314e72be6a2171e6469857)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:12.726903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:12.753443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.779713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b7b3183dad314e72be6a2171e6469857'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:12.944787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.020145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.029015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.046622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] The token cache is being invalidate because project b7b3183dad314e72be6a2171e6469857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:13.047165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.048487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.064797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.064797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.064797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b7b3183dad314e72be6a2171e6469857', 'request_id': 'req-b37358d9-b700-4440-97a1-3882bd0cd52d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.073397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2474/4939] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:12 2022] DELETE /identity/v3/domains/b7b3183dad314e72be6a2171e6469857 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:13.079392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:13.093394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0973d-4067-40ba-8de4-40c36130a821 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:13.183030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:13.184044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:13.184569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:13.184952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/29b71bed763e4873a61b9016abeeedd7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:13.197557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Could not find domain: 29b71bed763e4873a61b9016abeeedd7.: keystone.exception.DomainNotFound: Could not find domain: 29b71bed763e4873a61b9016abeeedd7. Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 29b71bed763e4873a61b9016abeeedd7. Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:13.206033 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:13.207147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:37:13.208146 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 29b71bed763e4873a61b9016abeeedd7. Oct 30 01:37:13.209845 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.213241 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2466/4940] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:13 2022] DELETE /identity/v3/domains/29b71bed763e4873a61b9016abeeedd7 => generated 112 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:13.215663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:13.218805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:13.244285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37358d9-b700-4440-97a1-3882bd0cd52d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:13.261976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:13.263228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:13.264491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:13.266244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:13.267659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:13.271692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:13.379560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2475/4941] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:13 2022] POST /identity/v3/domains => generated 253 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:13.384427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:13.397438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899f663-9d64-48aa-9783-bff31e4e57ab tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:13.486513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:13.487155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:13.487443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:13.487717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:13.488387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:13.490345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:13.536746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.sql.core [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1049105488' for key 'project.ixu_project_name_domain_id'") Oct 30 01:37:13.536746 n-d-master-1 devstack@keystone.service[82036]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 01:37:13.536746 n-d-master-1 devstack@keystone.service[82036]: [parameters: {'id': 'e77fd27202654bc390750cfc5f2ae94a', 'name': 'tempest-domain-dup-1049105488', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 01:37:13.536746 n-d-master-1 devstack@keystone.service[82036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1049105488.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1049105488. Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:37:13.547188 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1049105488' for key 'project.ixu_project_name_domain_id'") Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 01:37:13.548419 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application yield resource Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise self.value Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application session.commit() Oct 30 01:37:13.549904 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.flush() Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application compat.raise_( Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:37:13.551282 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 01:37:13.552719 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:37:13.553959 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1049105488' for key 'project.ixu_project_name_domain_id'") Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [parameters: {'id': 'e77fd27202654bc390750cfc5f2ae94a', 'name': 'tempest-domain-dup-1049105488', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.555268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1049105488. Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:13.556348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1049105488. Oct 30 01:37:13.559066 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:13.562948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2467/4942] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:13 2022] POST /identity/v3/domains => generated 212 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 30 01:37:13.567013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:13.579467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890838f-2ddc-43c3-9eb3-b81e75beef6a tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:13.584420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:13.585067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:13.585380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:13.585659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/224152005ccf42fbaee7bcbfa56863a1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:13.600372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=224152005ccf42fbaee7bcbfa56863a1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:13.602045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:13.631922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.632687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.772879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.777504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:13.789225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:13.793047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:13.795585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2476/4943] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:13 2022] PATCH /identity/v3/domains/224152005ccf42fbaee7bcbfa56863a1 => generated 254 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:13.827305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9da0d-1566-4700-8d24-00a322b54ed7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:13.998403 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:14.021036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:14.021870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:14.022263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:14.022658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/224152005ccf42fbaee7bcbfa56863a1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:14.051236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=224152005ccf42fbaee7bcbfa56863a1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:14.053189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:14.124705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.138246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.300267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.313125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.393408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.424903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] The token cache is being invalidate because project 224152005ccf42fbaee7bcbfa56863a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:14.425203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.427358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.452037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.464020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.464963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '224152005ccf42fbaee7bcbfa56863a1', 'request_id': 'req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:14.490420 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2468/4944] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:13 2022] DELETE /identity/v3/domains/224152005ccf42fbaee7bcbfa56863a1 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:14.496402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:14.511877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd0da-317c-4864-90a5-b7a0387dfb5d tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:14.550448 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:14.629028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f7d8ac414664d4d9f124194d47fd2cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c527c3160a304f6f98050b4988a09094', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:14.629878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:14.630274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:14.630659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] PATH_INFO: `/v3/domains/b7b3183dad314e72be6a2171e6469857` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:14.641108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-2338e655-8d29-4b0b-b624-a095342c6ace tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Could not find domain: b7b3183dad314e72be6a2171e6469857.: keystone.exception.DomainNotFound: Could not find domain: b7b3183dad314e72be6a2171e6469857. Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b7b3183dad314e72be6a2171e6469857. Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:14.650610 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:14.652485 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:37:14.653789 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b7b3183dad314e72be6a2171e6469857. Oct 30 01:37:14.655370 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:14.659174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2477/4945] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:14 2022] PATCH /identity/v3/domains/b7b3183dad314e72be6a2171e6469857 => generated 112 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:14.660444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:14.661981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:14.752846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0aedd-a18e-449f-b4a7-c646b29f95f7 tempest-DomainsNegativeTestJSON-1648946993 tempest-DomainsNegativeTestJSON-1648946993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:14.758134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:14.758936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:14.759610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:14.760327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] PATH_INFO: `/v3/users/ada5848e747f407999ae0623664f526e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:14.762974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada5848e747f407999ae0623664f526e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:14.765290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:15.002466 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:15.021862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada5848e747f407999ae0623664f526e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:15.034298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada5848e747f407999ae0623664f526e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:15.041264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada5848e747f407999ae0623664f526e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:15.046764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada5848e747f407999ae0623664f526e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:15.131335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada5848e747f407999ae0623664f526e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:15.183068 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2469/4946] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:14 2022] DELETE /identity/v3/users/ada5848e747f407999ae0623664f526e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:15.188791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:15.188940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:15.189216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:15.231834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:15.233083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:15.367618 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2478/4947] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:15.427552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:15.429161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:15.580024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ef23-8766-4c07-b324-5a8140ee7006 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:15.592496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:15.593699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:15.594278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:15.594711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:15.616735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:15.621714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:15.647902 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2470/4948] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:37:17.052358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:17.055524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:17.091124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafc3aa-4751-45a8-bbdc-b6b5d9bf6f3f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:17.091124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:17.091124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:17.091124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:17.092001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] PATH_INFO: `/v3/projects/782f1a181a7e471da74bc3a335036199` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:17.092001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782f1a181a7e471da74bc3a335036199)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:17.093498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:17.216334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782f1a181a7e471da74bc3a335036199', 'request_id': 'req-808c587d-7f43-4b16-8a03-a996d1c38669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.308755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782f1a181a7e471da74bc3a335036199', 'request_id': 'req-808c587d-7f43-4b16-8a03-a996d1c38669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.316952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782f1a181a7e471da74bc3a335036199', 'request_id': 'req-808c587d-7f43-4b16-8a03-a996d1c38669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.328944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] The token cache is being invalidate because project 782f1a181a7e471da74bc3a335036199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:17.329167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.329929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.331569 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2479/4949] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:17 2022] DELETE /identity/v3/projects/782f1a181a7e471da74bc3a335036199 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:17.344207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:17.353848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcd637-a8a9-48f1-b876-1af02ee98ea7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:17.450057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:17.451015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:17.451457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:17.451911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] PATH_INFO: `/v3/users/7f7d8ac414664d4d9f124194d47fd2cc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:17.454235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7d8ac414664d4d9f124194d47fd2cc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:17.456522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:17.694173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7d8ac414664d4d9f124194d47fd2cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.695769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7d8ac414664d4d9f124194d47fd2cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.707113 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:17.711171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7d8ac414664d4d9f124194d47fd2cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.711479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7d8ac414664d4d9f124194d47fd2cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.828603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7d8ac414664d4d9f124194d47fd2cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:17.923470 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2471/4950] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:17 2022] DELETE /identity/v3/users/7f7d8ac414664d4d9f124194d47fd2cc => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:18.524577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:18.532515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:18.632860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:18.672491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c587d-7f43-4b16-8a03-a996d1c38669 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:18.768186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:18.770087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:18.777106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:18.777106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:18.777106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:18.878637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:18.880665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f811e5a-f4ae-4ccf-b43f-c1a903d4f73c service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:18.892435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2480/4951] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:37:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:37:19.105814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:19.107289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:19.245281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93679-6b9d-4b01-8415-fc78b6a67abb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:19.266790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:19.267804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:19.273276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:19.273276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] PATH_INFO: `/v3/projects/c527c3160a304f6f98050b4988a09094` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:19.273276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c527c3160a304f6f98050b4988a09094)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:19.273276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:19.448618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c527c3160a304f6f98050b4988a09094', 'request_id': 'req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:19.465523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c527c3160a304f6f98050b4988a09094', 'request_id': 'req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:19.559122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c527c3160a304f6f98050b4988a09094', 'request_id': 'req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:19.587072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] The token cache is being invalidate because project c527c3160a304f6f98050b4988a09094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:19.587488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:19.589159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0bba6653-0ce4-4d0e-84cb-2b8fb9acf595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:19.598862 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2472/4952] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:19 2022] DELETE /identity/v3/projects/c527c3160a304f6f98050b4988a09094 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:19.603332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:19.603942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:19.604592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:19.647682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:19.648917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:19.741572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2481/4953] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:19.753135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:19.757566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:19.757566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:19.844265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:19.855080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:19.893476 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2473/4954] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:19.896098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:19.914859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee519df-de83-4fe7-88c2-19432c790bdc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:19.925401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:19.926535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:19.927048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:19.927420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:19.928176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:37:19.928652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:19.930364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:19.971252 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2482/4955] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:19.972537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:19.986275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339840-0071-49fb-9a0d-34eb3b91637b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:19.991919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:19.992955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:19.993408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:19.993806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:19.994563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:19.996711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:20.101993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2474/4956] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:19 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:20.106411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:20.118611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fcfb-aa17-4dd0-b4db-c6f8d1f0a8fe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:20.139074 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:20.276900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:20.278609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:20.279044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:20.279867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:20.281500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:20.287031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:20.433688 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2483/4957] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:20 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:20.437083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:20.468961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63420d-ae57-438e-b7cd-c128a3ab0b9d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:20.482543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:20.482543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:20.482543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:20.482543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:20.482996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:20.482996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:20.504216 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2475/4958] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:20.515261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:20.538055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf87722-3f7c-4586-8836-8c672cde881f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:20.549567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:20.549917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:20.553235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:20.553235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:20.553235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:20.553235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f311ac-0175-44d9-8d4d-978d96447dac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:20.576935 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2484/4959] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:20.581301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:20.603058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd723e-1a8d-4e7c-a872-4340faa1bd3e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:20.619151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:20.620549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:20.621005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:20.621722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] PATH_INFO: `/v3/projects/451f4be42a5b4d89a9df66f473aa3171/users/64375195a2c2467bb0190749b7a13b0f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:20.642285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] RBAC: Authorizing `identity:create_grant(project_id=451f4be42a5b4d89a9df66f473aa3171, user_id=64375195a2c2467bb0190749b7a13b0f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:20.646418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:20.732309 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:20.749811 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2476/4960] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:20 2022] PUT /identity/v3/projects/451f4be42a5b4d89a9df66f473aa3171/users/64375195a2c2467bb0190749b7a13b0f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:20.751790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:20.752255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:20.752365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:20.831487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] MFA Rules not processed for user `64375195a2c2467bb0190749b7a13b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:20.832958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:20.980219 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2485/4961] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:20.981145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:21.187616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fcab-32b1-4c58-a953-2f873643078f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:21.201295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:21.201969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:21.202254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:21.202530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:21.203239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:21.205177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:21.355583 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2477/4962] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:20 2022] POST /identity/v3/projects => generated 369 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:21.359526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:21.380854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f6a96-fc88-4eea-b327-fdbf3c1d0682 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:21.491480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:21.492852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:21.492852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:21.493072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:21.493694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:21.496791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:21.611963 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2486/4963] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:21 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:21.617479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:21.644643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7d0a6-a491-4362-8e23-e77f26a3409f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:21.657454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:21.658334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:21.658821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:21.659262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:21.660066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:21.661882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:21.684859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2478/4964] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:21.688712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:21.705635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488dd65-4ff8-4917-9717-aef3ac750b3c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:21.724672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:21.725728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:21.726253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:21.726747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] PATH_INFO: `/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8/users/c68a9a55f88f44099f6596d73275c781/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:21.750150 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:21.758458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c196dcdc5c142f5a97a4a46c9009fb8, user_id=c68a9a55f88f44099f6596d73275c781, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:21.763135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:21.862920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2487/4965] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:21 2022] PUT /identity/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8/users/c68a9a55f88f44099f6596d73275c781/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:21.866976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:21.887942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1a852-ed9a-436a-a630-d58066bd06a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.023266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.024100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.024453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.024792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.026992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.029145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82db6-3d2b-43d0-9a43-d584621b7e14 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.049536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2479/4966] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:22.050331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.062494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab44a00-e576-4f0a-9bfc-beddd52a9a3f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.067810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.071348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.071348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.071348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] PATH_INFO: `/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8/users/c68a9a55f88f44099f6596d73275c781/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.071348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c196dcdc5c142f5a97a4a46c9009fb8, user_id=c68a9a55f88f44099f6596d73275c781, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.073885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.085609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2488/4967] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:22 2022] PUT /identity/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8/users/c68a9a55f88f44099f6596d73275c781/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:22.097294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.097294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.099526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.130658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] MFA Rules not processed for user `c68a9a55f88f44099f6596d73275c781`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:22.131853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:22.255260 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:22.318681 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2480/4968] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:22.319723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.335539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0af5bc-5c70-4b83-8564-88c8e70e0067 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.350003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.351700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.354859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.356173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.357211 n-d-master-1 devstack@keystone.service[82035]: WARNING oslo_log.versionutils [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:22.357743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.369968 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:22.369968 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:37:22.369968 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:37:22.369968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.454008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2489/4969] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:22 2022] POST /identity/v3/policies => generated 229 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:22.458024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.470958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cbd59-db82-4bb2-82bf-f078c53cab40 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.483867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.484629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.484920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.485198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.486196 n-d-master-1 devstack@keystone.service[82036]: WARNING oslo_log.versionutils [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:22.486692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=b585582f8f2a4e0ea8dbec2774a3c104)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.493242 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:22.493242 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:22.493242 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:22.494201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.608753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2481/4970] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:37:22 2022] PATCH /identity/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104 => generated 235 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:22.615755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.647234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446ed27-517a-4e2f-9bb4-6323b61f5767 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.668194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.670799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.673287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.673782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.675743 n-d-master-1 devstack@keystone.service[82035]: WARNING oslo_log.versionutils [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:22.678306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=b585582f8f2a4e0ea8dbec2774a3c104)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.680328 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:22.680328 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:37:22.680328 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:37:22.684222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.702922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2490/4971] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:22 2022] GET /identity/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104 => generated 235 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:22.707574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.723011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe5cf5-2c8b-41a4-8c61-a03a80e8aafd tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.739762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.740683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.741645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.741645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.743268 n-d-master-1 devstack@keystone.service[82036]: WARNING oslo_log.versionutils [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:22.743849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b585582f8f2a4e0ea8dbec2774a3c104)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.750389 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:22.750389 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:22.750389 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:22.751302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:22.865962 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2482/4972] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:22 2022] DELETE /identity/v3/policies/b585582f8f2a4e0ea8dbec2774a3c104 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:22.872722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:22.887126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf74333-a186-43b3-b388-e2c01105fcad tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:22.892299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:22.893257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:22.893805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:22.894478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:22.895821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:22.898055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.042701 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2491/4973] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:22 2022] POST /identity/v3/policies => generated 228 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:23.044593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.082590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e11a04-37b4-4c1c-9c9a-c879e076fe0d tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.089387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.089387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.089387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.089708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.090278 n-d-master-1 devstack@keystone.service[82036]: WARNING oslo_log.versionutils [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:23.090778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.092019 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:23.092019 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:23.092019 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:23.093463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.179270 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2483/4974] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:23 2022] POST /identity/v3/policies => generated 229 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:23.183289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.201095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36abc6-e1ce-4c5c-91ba-d8b471424190 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.220227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.220875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.221153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.221456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.222633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.224496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.314249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2492/4975] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:23 2022] POST /identity/v3/policies => generated 230 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:23.315661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.331593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79d343-2c7e-4468-af9e-7e2d06b9f853 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.344688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.345328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.347387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.347387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.347387 n-d-master-1 devstack@keystone.service[82036]: WARNING oslo_log.versionutils [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:23.347387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.348570 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:23.348570 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:23.348570 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:23.356325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.380341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.380588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2484/4976] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:37:23 2022] GET /identity/v3/policies => generated 763 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:23.395928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66fdf-ad44-471e-906d-7267d6b5e57f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.412705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.413363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.413659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.413934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/1c9d3a21b90948cca78e4fbccc7c502d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.414725 n-d-master-1 devstack@keystone.service[82035]: WARNING oslo_log.versionutils [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 30 01:37:23.415282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1c9d3a21b90948cca78e4fbccc7c502d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.416559 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:23.416559 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:37:23.416559 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:37:23.417495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.522596 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2493/4977] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:23 2022] DELETE /identity/v3/policies/1c9d3a21b90948cca78e4fbccc7c502d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:23.527597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.539839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9579fb-e2c9-4a1e-82c5-73490a89cc86 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.545825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.546777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.547108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.547382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/d39212c7e3f349bcb93db3d925071012` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.548517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d39212c7e3f349bcb93db3d925071012)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.550523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.717987 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2485/4978] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:23 2022] DELETE /identity/v3/policies/d39212c7e3f349bcb93db3d925071012 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:23.722383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:23.739927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c98421-e362-4de5-ba98-1f4df3d9a276 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:23.753621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c68a9a55f88f44099f6596d73275c781', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c196dcdc5c142f5a97a4a46c9009fb8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:23.754283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:23.754566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:23.754843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] PATH_INFO: `/v3/policies/783bfb90fe2f442db67b96da627e8318` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:23.755924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=783bfb90fe2f442db67b96da627e8318)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:23.757785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337598b-5955-48fd-ae6c-2a0e0d00328f tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:23.901714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2494/4979] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:23 2022] DELETE /identity/v3/policies/783bfb90fe2f442db67b96da627e8318 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:23.904784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:24.036736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1a1e5-0bf3-4b65-b529-25a3313c31d3 tempest-PoliciesTestJSON-1489494773 tempest-PoliciesTestJSON-1489494773-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:24.049316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:24.050380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:24.050866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:24.051303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] PATH_INFO: `/v3/users/64375195a2c2467bb0190749b7a13b0f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:24.053475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64375195a2c2467bb0190749b7a13b0f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:24.056260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:24.294121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64375195a2c2467bb0190749b7a13b0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:24.296004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64375195a2c2467bb0190749b7a13b0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:24.309625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64375195a2c2467bb0190749b7a13b0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:24.311534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64375195a2c2467bb0190749b7a13b0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:24.390596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64375195a2c2467bb0190749b7a13b0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:24.422920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2486/4980] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:23 2022] DELETE /identity/v3/users/64375195a2c2467bb0190749b7a13b0f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:24.428790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862967-5343-4149-b99e-63355a34a993 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:24.430848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862967-5343-4149-b99e-63355a34a993 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:24.431439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862967-5343-4149-b99e-63355a34a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:24.500242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d9862967-5343-4149-b99e-63355a34a993 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:24.509158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9862967-5343-4149-b99e-63355a34a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:24.605511 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2495/4981] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:37:24.618410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:24.620196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:24.629273 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:24.701408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b0fa3-85ce-492b-a9d2-589618f5e473 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:24.707115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:24.708257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:24.708740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:24.709422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:24.727852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:24.732527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:24.761834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2487/4982] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:37:26.552243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9862967-5343-4149-b99e-63355a34a993 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:26.554468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9862967-5343-4149-b99e-63355a34a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:26.575177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9862967-5343-4149-b99e-63355a34a993 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:26.581649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:26.588860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:26.588860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:26.588860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] PATH_INFO: `/v3/projects/451f4be42a5b4d89a9df66f473aa3171` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:26.588860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451f4be42a5b4d89a9df66f473aa3171)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:26.588860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:26.809219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451f4be42a5b4d89a9df66f473aa3171', 'request_id': 'req-4c6c6256-a1e0-4c50-b488-336523f68c76'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:26.812473 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:26.920009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451f4be42a5b4d89a9df66f473aa3171', 'request_id': 'req-4c6c6256-a1e0-4c50-b488-336523f68c76'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:26.942545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451f4be42a5b4d89a9df66f473aa3171', 'request_id': 'req-4c6c6256-a1e0-4c50-b488-336523f68c76'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:26.998633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] The token cache is being invalidate because project 451f4be42a5b4d89a9df66f473aa3171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:26.999162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.002561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.005157 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2496/4983] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:26 2022] DELETE /identity/v3/projects/451f4be42a5b4d89a9df66f473aa3171 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:27.019334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:27.040019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51554a-0fe0-43ed-b9fe-495f65ebe626 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:27.203623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:27.204290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:27.204575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:27.204852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] PATH_INFO: `/v3/users/c68a9a55f88f44099f6596d73275c781` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:27.217265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68a9a55f88f44099f6596d73275c781)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:27.220902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:27.537068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68a9a55f88f44099f6596d73275c781'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.537990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68a9a55f88f44099f6596d73275c781'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.558941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68a9a55f88f44099f6596d73275c781'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.558941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68a9a55f88f44099f6596d73275c781'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.654112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b150310b-67a3-4fbd-94be-7f8ad6bebf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68a9a55f88f44099f6596d73275c781'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:27.694550 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2488/4984] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:27 2022] DELETE /identity/v3/users/c68a9a55f88f44099f6596d73275c781 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:28.898111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:28.902917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:28.930056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6256-a1e0-4c50-b488-336523f68c76 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:29.111159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:29.112153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:29.112652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:29.113186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] PATH_INFO: `/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:29.114634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c196dcdc5c142f5a97a4a46c9009fb8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:29.116787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:29.356542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c196dcdc5c142f5a97a4a46c9009fb8', 'request_id': 'req-a19d20a8-3322-4503-9bf4-7e2294cc931e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:29.468010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c196dcdc5c142f5a97a4a46c9009fb8', 'request_id': 'req-a19d20a8-3322-4503-9bf4-7e2294cc931e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:29.479256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c196dcdc5c142f5a97a4a46c9009fb8', 'request_id': 'req-a19d20a8-3322-4503-9bf4-7e2294cc931e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:29.510588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] The token cache is being invalidate because project 9c196dcdc5c142f5a97a4a46c9009fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:29.511142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:29.512280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a19d20a8-3322-4503-9bf4-7e2294cc931e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:29.517796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2497/4985] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:28 2022] DELETE /identity/v3/projects/9c196dcdc5c142f5a97a4a46c9009fb8 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:29.519613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:29.520097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:29.520360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:29.562491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:29.564367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:29.647189 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:29.764420 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2489/4986] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:29.767235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:29.767931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:29.768374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:29.815118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:29.817855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:29.842493 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2498/4987] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:29.847036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:29.859419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa51578-da89-4a12-8d97-a10ae92f48f6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:29.870543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:29.871338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:29.873704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:29.873704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:29.873704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:37:29.874201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:29.887378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:29.924865 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2490/4988] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:29.926186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:29.941258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903008b-2188-4cb6-bacd-f3ee0b7bf26f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:29.952828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:29.953558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:29.953905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:29.954329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:29.955039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:29.957192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:30.113875 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2499/4989] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:29 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:30.118200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:30.132575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fa126-3b36-45e4-bc36-bd729a15c023 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:30.268809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:30.269694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:30.269977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:30.270248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:30.270889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:30.272897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:30.422456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:30.432704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2491/4990] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:30 2022] POST /identity/v3/users => generated 284 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:30.439679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9015b-c7fe-49bc-a1ee-bfa623d0208b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:30.445853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:30.446927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:30.449838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:30.449838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:30.449838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:30.451623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:30.470072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2500/4991] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:30.476364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:30.489535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2407df-b8e1-4b1f-9d27-4c5288720113 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:30.497720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:30.499595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:30.499977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:30.500310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:30.501294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:30.503759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d660682-528d-46e1-b14f-e8eeb7976888 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:30.522740 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2492/4992] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:30.527868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:30.544129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4740-6aec-4ab9-9a7e-560439be9994 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:30.551827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:30.564103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:30.564389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:30.564677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] PATH_INFO: `/v3/projects/22db7444102c4c06bf6fcc2594cd99ac/users/e1a559f803fe48fca49c33c290cf4f34/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:30.590158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22db7444102c4c06bf6fcc2594cd99ac, user_id=e1a559f803fe48fca49c33c290cf4f34, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:30.595601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:30.733494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2501/4993] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:30 2022] PUT /identity/v3/projects/22db7444102c4c06bf6fcc2594cd99ac/users/e1a559f803fe48fca49c33c290cf4f34/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:30.746366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:30.746649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:30.746913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:30.784955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] MFA Rules not processed for user `e1a559f803fe48fca49c33c290cf4f34`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:30.786981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:30.949370 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2493/4994] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:30.953934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:30.962448 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:31.039138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82f8f6-1f63-4db6-9cea-c6a7df37c71e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.046667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.047200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.047551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.047882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.048637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.051948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.145528 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2502/4995] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:30 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:31.148092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:31.175592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a378f5-948e-41e3-a8f4-2c2514b9a09c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.216690 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:31.283234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.283234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.284818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.284818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.284818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.287238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.419043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2494/4996] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:31 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:31.420328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:31.444787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5573ae7-d261-40d6-b400-893a3bc16f11 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.454328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.458034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.458976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.459765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.460432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.462161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.488028 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2503/4997] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:31.490517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:31.517944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fed647-9a15-468f-9e0b-5e5a2229f31b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.532605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.533558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.533942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.534317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] PATH_INFO: `/v3/projects/f68de144179a46c7ab63a399d756c2e7/users/bd2322c09bcd4b98b3852ba28d1bc8aa/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.570144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68de144179a46c7ab63a399d756c2e7, user_id=bd2322c09bcd4b98b3852ba28d1bc8aa, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.571246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.661081 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2495/4998] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:31 2022] PUT /identity/v3/projects/f68de144179a46c7ab63a399d756c2e7/users/bd2322c09bcd4b98b3852ba28d1bc8aa/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:37:31.665220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:31.681098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620cb0-2513-46b3-ba31-ecfa847e65a3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.784780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.785610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.785718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.787818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.788400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.790927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047bb34-d076-42f5-9325-8691160e68af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.814384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2504/4999] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:31.818237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:31.836223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c680-c9f1-40fb-8962-2fbe7ef75bad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:31.852086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:31.852776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.853057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.853325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] PATH_INFO: `/v3/projects/f68de144179a46c7ab63a399d756c2e7/users/bd2322c09bcd4b98b3852ba28d1bc8aa/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.858724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68de144179a46c7ab63a399d756c2e7, user_id=bd2322c09bcd4b98b3852ba28d1bc8aa, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:31.862301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:31.879698 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2496/5000] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:31 2022] PUT /identity/v3/projects/f68de144179a46c7ab63a399d756c2e7/users/bd2322c09bcd4b98b3852ba28d1bc8aa/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:31.894032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:31.894032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:31.894032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:31.949669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] MFA Rules not processed for user `bd2322c09bcd4b98b3852ba28d1bc8aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:31.951209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:32.076904 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:32.091546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2505/5001] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:32.096196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:32.111508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58accfc-d098-4b69-8d7b-4ae459ac048b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:32.116811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:32.118068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:32.118612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:32.119036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:32.120208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:32.122312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:32.257151 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2497/5002] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:32 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:32.259060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:32.272908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68acc3-ba15-4bb1-b423-edeac730ff73 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:32.365544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:32.366247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:32.366712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:32.367420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:32.368257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:32.370974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:32.505872 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2506/5003] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:32 2022] POST /identity/v3/users => generated 416 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:32.508152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:32.521940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d6cfe-4ba3-45e2-8621-bc30bdb36fb7 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:32.531955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:32.532703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:32.533818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:32.536314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/users/c9b9db45f90d4f95ae78f333b3a3bc8b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:32.564678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_user(user_id=c9b9db45f90d4f95ae78f333b3a3bc8b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:32.564678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:32.566461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2498/5004] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:37:32 2022] GET /identity/v3/users/c9b9db45f90d4f95ae78f333b3a3bc8b => generated 416 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:32.567176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:32.582743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fac7c4-2e10-4ae9-aea4-2da113d93840 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:32.592825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:32.593633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:32.598773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:32.598773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/users/c9b9db45f90d4f95ae78f333b3a3bc8b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:32.598773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c9b9db45f90d4f95ae78f333b3a3bc8b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:32.604510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:32.854810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b9db45f90d4f95ae78f333b3a3bc8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:32.983652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b9db45f90d4f95ae78f333b3a3bc8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:32.984385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b9db45f90d4f95ae78f333b3a3bc8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.005808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b9db45f90d4f95ae78f333b3a3bc8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.034417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b9db45f90d4f95ae78f333b3a3bc8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.052824 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2507/5005] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:32 2022] DELETE /identity/v3/users/c9b9db45f90d4f95ae78f333b3a3bc8b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:33.057525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:33.059851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:33.086862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f86df-c32a-41cf-8ac3-5550d4a53096 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:33.277738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:33.278869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:33.279368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:33.279798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/631ebd1b599a4628b473b76a32bb9831` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:33.281243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=631ebd1b599a4628b473b76a32bb9831)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:33.286254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:33.434909 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:33.454432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631ebd1b599a4628b473b76a32bb9831', 'request_id': 'req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.474587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631ebd1b599a4628b473b76a32bb9831', 'request_id': 'req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.570814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631ebd1b599a4628b473b76a32bb9831', 'request_id': 'req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.611212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 631ebd1b599a4628b473b76a32bb9831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:33.612993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.614785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:33.623832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:33.625179 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2499/5006] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:33 2022] DELETE /identity/v3/projects/631ebd1b599a4628b473b76a32bb9831 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:33.637956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52534a9-87cf-469c-afe9-4ad33f2c261d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:33.722132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:33.722749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:33.723031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:33.723297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:33.724036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:33.725796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:33.733394 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:33.843369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2508/5007] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:33 2022] POST /identity/v3/projects => generated 348 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:33.848043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:33.849430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:33.865000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcab5-b9c3-475a-a1b8-8e75b84c4e0c tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:34.014954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:34.018738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:34.018738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:34.018738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:34.018738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:37:34.018738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:34.020746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:34.053215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2500/5008] 10.222.0.13 () {58 vars in 1160 bytes} [Sun Oct 30 01:37:33 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:34.054170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:34.072862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a94ac1-c616-4156-8ae3-6a2848b2f41f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:34.080852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:34.080852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:34.081444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:34.081962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:34.082863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:34.099137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:34.122322 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2509/5009] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:37:34 2022] GET /identity/v3/domains => generated 829 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:34.126301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:34.139885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328a0c-11fa-4292-9618-ea3bf3412c13 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:34.147357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:34.149462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:34.166786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:34.167948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/977c6f90d26348d78d0551fd6ed6c00d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:34.172459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_project(project_id=977c6f90d26348d78d0551fd6ed6c00d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:34.174341 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:34.174341 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:34.174341 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:34.180400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:34.214680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.215622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.339863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.341719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.346324 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2501/5010] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:37:34 2022] PATCH /identity/v3/projects/977c6f90d26348d78d0551fd6ed6c00d => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:34.349597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:34.351400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:34.370100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbefcf-eb06-45a2-a0d8-5e3940ff4e42 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:34.436330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:34.436963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:34.440620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:34.440620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/977c6f90d26348d78d0551fd6ed6c00d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:34.450765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=977c6f90d26348d78d0551fd6ed6c00d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:34.453552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:34.487632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.500444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.629073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.839615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.850536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.872613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 977c6f90d26348d78d0551fd6ed6c00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:34.876306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.876306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.884330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.885297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.886613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '977c6f90d26348d78d0551fd6ed6c00d', 'request_id': 'req-3f467257-544e-46fb-af45-d2a319334ee8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:34.903330 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2510/5011] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:34 2022] DELETE /identity/v3/projects/977c6f90d26348d78d0551fd6ed6c00d => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:34.903502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:34.916581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1227c5-3aec-40cb-8a4a-263fa0c1fd22 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:35.017644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:35.018031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:35.020108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:35.020630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:35.022278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:35.028799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:35.196852 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2502/5012] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:34 2022] POST /identity/v3/projects => generated 358 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:35.201369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:35.203388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:35.257536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467257-544e-46fb-af45-d2a319334ee8 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:35.299527 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:35.420340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:35.423339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:35.423656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:35.423939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/b65989a8a20e42fea673c09e2251af99` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:35.425890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=b65989a8a20e42fea673c09e2251af99)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:35.429761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:35.436993 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2511/5013] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:35 2022] GET /identity/v3/projects/b65989a8a20e42fea673c09e2251af99 => generated 358 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:35.439203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:35.460920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a2bd4-8a09-47f5-9da0-e8bc574812a6 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:35.468155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:35.469554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:35.470090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:35.470692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/b65989a8a20e42fea673c09e2251af99` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:35.473562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b65989a8a20e42fea673c09e2251af99)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:35.476234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:35.492763 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:35.663123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65989a8a20e42fea673c09e2251af99', 'request_id': 'req-2cdc161e-44d1-40b6-90eb-620748332dca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:35.685194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65989a8a20e42fea673c09e2251af99', 'request_id': 'req-2cdc161e-44d1-40b6-90eb-620748332dca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:35.784224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65989a8a20e42fea673c09e2251af99', 'request_id': 'req-2cdc161e-44d1-40b6-90eb-620748332dca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:35.830237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project b65989a8a20e42fea673c09e2251af99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:35.831407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:35.834091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:35.838104 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2503/5014] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:35 2022] DELETE /identity/v3/projects/b65989a8a20e42fea673c09e2251af99 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:35.843391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:35.845164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:35.860431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73fbc3-c54b-41ba-bf1d-7b37c2659309 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:35.957676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:35.958282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:35.958567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:35.958835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:35.960789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:35.961808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:36.107163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:36.111784 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2512/5015] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:35 2022] POST /identity/v3/projects => generated 360 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:36.132497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc161e-44d1-40b6-90eb-620748332dca tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:36.306352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:36.307806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:36.308260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:36.310018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/736b273c3e874b2282ff16e366e213d2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:36.312988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=736b273c3e874b2282ff16e366e213d2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:36.315284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:36.324482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:36.326897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2504/5016] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:36 2022] GET /identity/v3/projects/736b273c3e874b2282ff16e366e213d2 => generated 360 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:36.340682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d6a48-440a-435c-ac7a-f98f2e00854f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:36.346693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:36.347535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:36.348023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:36.348444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/736b273c3e874b2282ff16e366e213d2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:36.350052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=736b273c3e874b2282ff16e366e213d2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:36.353495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:36.475152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736b273c3e874b2282ff16e366e213d2', 'request_id': 'req-9125e704-1a3c-4643-876e-eaa01d22a48b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:36.546567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736b273c3e874b2282ff16e366e213d2', 'request_id': 'req-9125e704-1a3c-4643-876e-eaa01d22a48b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:36.564967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736b273c3e874b2282ff16e366e213d2', 'request_id': 'req-9125e704-1a3c-4643-876e-eaa01d22a48b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:36.585757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 736b273c3e874b2282ff16e366e213d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:36.586320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:36.587282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:36.590373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2513/5017] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:36 2022] DELETE /identity/v3/projects/736b273c3e874b2282ff16e366e213d2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:36.595563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:36.597957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:36.641129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9175ad-dfc0-4a69-a8e8-0f434adc1c16 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:36.760163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:36.760374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:36.760932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:36.761036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:36.761697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:36.763750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:36.890802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2505/5018] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:36 2022] POST /identity/v3/projects => generated 347 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:36.894710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:36.914416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125e704-1a3c-4643-876e-eaa01d22a48b tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:36.978270 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:37.024048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:37.024699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:37.025403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:37.026312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/ad444bc2f93b4a649a82d1e3d8cd7e06` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:37.027987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=ad444bc2f93b4a649a82d1e3d8cd7e06)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:37.030293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:37.032425 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2514/5019] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:36 2022] GET /identity/v3/projects/ad444bc2f93b4a649a82d1e3d8cd7e06 => generated 347 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:37.038922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:37.056579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2ec7b-6276-4188-a6e8-52454cb79c47 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:37.071384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:37.073551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:37.074002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:37.074636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/ad444bc2f93b4a649a82d1e3d8cd7e06` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:37.076099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad444bc2f93b4a649a82d1e3d8cd7e06)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:37.080079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:37.162476 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:37.285256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad444bc2f93b4a649a82d1e3d8cd7e06', 'request_id': 'req-2ec2628d-9f88-4a15-b168-4e16497e0895'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:37.293041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad444bc2f93b4a649a82d1e3d8cd7e06', 'request_id': 'req-2ec2628d-9f88-4a15-b168-4e16497e0895'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:37.416791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad444bc2f93b4a649a82d1e3d8cd7e06', 'request_id': 'req-2ec2628d-9f88-4a15-b168-4e16497e0895'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:37.456569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project ad444bc2f93b4a649a82d1e3d8cd7e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:37.456895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:37.457791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:37.465249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:37.468910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2506/5020] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:37 2022] DELETE /identity/v3/projects/ad444bc2f93b4a649a82d1e3d8cd7e06 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:37.470212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:37.497902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33d6c-f109-49ba-96ba-34072f042345 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:37.683199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:37.683199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:37.683199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:37.683533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:37.683533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:37.683533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:37.797839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:37.804948 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2515/5021] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:37 2022] POST /identity/v3/domains => generated 276 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:37.812224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2628d-9f88-4a15-b168-4e16497e0895 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:37.921076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:37.921754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:37.922061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:37.922307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:37.922952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:37.927098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:38.118763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:38.125966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2507/5022] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:37 2022] POST /identity/v3/projects => generated 404 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:38.137371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087966-fda1-45a5-82b5-ed23147cdb62 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:38.303870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:38.305630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:38.306008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:38.306476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/1afe159d0c25456bad3c115f1f3c6641` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:38.309767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=1afe159d0c25456bad3c115f1f3c6641)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:38.314616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:38.320680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2516/5023] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:38 2022] GET /identity/v3/projects/1afe159d0c25456bad3c115f1f3c6641 => generated 404 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:38.327401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:38.343123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1b471-df40-4b76-a6bb-9928c58b874f tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:38.378917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:38.384453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:38.384453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:38.384453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/1afe159d0c25456bad3c115f1f3c6641` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:38.384453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1afe159d0c25456bad3c115f1f3c6641)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:38.386954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:38.544696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afe159d0c25456bad3c115f1f3c6641', 'request_id': 'req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.560744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afe159d0c25456bad3c115f1f3c6641', 'request_id': 'req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.696302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afe159d0c25456bad3c115f1f3c6641', 'request_id': 'req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.714340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 1afe159d0c25456bad3c115f1f3c6641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:38.714953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.715833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.717610 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2508/5024] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:38 2022] DELETE /identity/v3/projects/1afe159d0c25456bad3c115f1f3c6641 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:38.722191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:38.725133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:38.753187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2410fb2-060b-4c4e-a1a5-1a62d9a2b628 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:38.850768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:38.851626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:38.852045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:38.852457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/25d6fbef46564a03ae608ad8a34b7e38` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:38.854010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=25d6fbef46564a03ae608ad8a34b7e38)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:38.855966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:38.883156 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:38.908719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:38.909550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.057083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.057813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.068350 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2517/5025] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:38 2022] PATCH /identity/v3/domains/25d6fbef46564a03ae608ad8a34b7e38 => generated 277 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:39.069826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:39.082787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a98fa-6b22-4e4e-8b64-47b3edd42c53 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:39.097664 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:39.270107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:39.270782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:39.271053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:39.271335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/25d6fbef46564a03ae608ad8a34b7e38` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:39.288133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=25d6fbef46564a03ae608ad8a34b7e38)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:39.290164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:39.353108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.360746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.533072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.545855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.633092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.652017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 25d6fbef46564a03ae608ad8a34b7e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:39.652314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.653736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.679272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.683336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.684072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '25d6fbef46564a03ae608ad8a34b7e38', 'request_id': 'req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:39.694461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2509/5026] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:39 2022] DELETE /identity/v3/domains/25d6fbef46564a03ae608ad8a34b7e38 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:39.695662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:39.697221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:39.716275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd68aa-9a97-45ef-8016-6c8fafdafb1a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:39.813223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:39.817052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:39.817052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:39.817052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:39.817052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:39.822007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:39.906478 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2518/5027] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:37:39 2022] POST /identity/v3/domains => generated 277 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:39.910553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:39.913902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:39.956092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5f47-7b3c-4a4a-a272-ae15f3614fcd tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:40.050599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:40.051687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:40.052213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:40.054774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:40.055720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:40.058649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:40.125683 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:40.198446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2510/5028] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:39 2022] POST /identity/v3/projects => generated 410 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:40.202472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:40.217557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23038534-9c7f-45d2-bf0d-7a0e8eddaf97 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:40.394257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:40.395022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:40.395423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:40.395821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:40.396587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:40.398631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:40.571733 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2519/5029] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:40 2022] POST /identity/v3/projects => generated 404 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:40.579602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:40.612535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ff16-b26e-4349-9002-cb981e9f6ae2 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:40.720271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:40.721167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:40.721729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:40.722179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/7196a23cd94e44fcadc0b5b387d4740d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:40.734057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7196a23cd94e44fcadc0b5b387d4740d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:40.737421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:40.944799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7196a23cd94e44fcadc0b5b387d4740d', 'request_id': 'req-5bc292dc-60db-4ed4-8d75-715f638e8636'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:40.962019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7196a23cd94e44fcadc0b5b387d4740d', 'request_id': 'req-5bc292dc-60db-4ed4-8d75-715f638e8636'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.126164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7196a23cd94e44fcadc0b5b387d4740d', 'request_id': 'req-5bc292dc-60db-4ed4-8d75-715f638e8636'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.144171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 7196a23cd94e44fcadc0b5b387d4740d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:41.144471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.145147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.146703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2511/5030] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:40 2022] DELETE /identity/v3/projects/7196a23cd94e44fcadc0b5b387d4740d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:41.152370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:41.155740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:41.173408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62191ae-dd9c-4597-a7f4-ee675e54fe75 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:41.275219 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:41.324990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:41.327903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:41.327903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:41.328586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/764b4e1cb2b0476bacb582905017ae08` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:41.330475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=764b4e1cb2b0476bacb582905017ae08)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:41.333057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:41.529748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764b4e1cb2b0476bacb582905017ae08', 'request_id': 'req-98648dac-f6d1-4019-bb6a-344065a7fd85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.600299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764b4e1cb2b0476bacb582905017ae08', 'request_id': 'req-98648dac-f6d1-4019-bb6a-344065a7fd85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.615239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764b4e1cb2b0476bacb582905017ae08', 'request_id': 'req-98648dac-f6d1-4019-bb6a-344065a7fd85'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.645657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 764b4e1cb2b0476bacb582905017ae08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:41.645931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.647755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.652444 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2520/5031] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:41 2022] DELETE /identity/v3/projects/764b4e1cb2b0476bacb582905017ae08 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:41.654119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:41.669745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc292dc-60db-4ed4-8d75-715f638e8636 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:41.848934 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:41.861810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:41.862516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:41.862808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:41.863139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:41.864541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a1a92d497f2e4f2dbcd0b903491a5ce5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:41.866535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:41.921627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:41.929630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.024615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.029033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.034974 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2512/5032] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:41 2022] PATCH /identity/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5 => generated 278 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:42.040127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:42.043936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:42.068345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648dac-f6d1-4019-bb6a-344065a7fd85 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:42.167852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:42.173921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:42.182451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:42.183336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:42.203762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a1a92d497f2e4f2dbcd0b903491a5ce5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:42.203762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:42.264547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.286832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.414433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.500953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.521427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.531830 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:42.544065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project a1a92d497f2e4f2dbcd0b903491a5ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:42.544827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.545098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.558928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.559499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.560723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a1a92d497f2e4f2dbcd0b903491a5ce5', 'request_id': 'req-1ac1792f-9000-491c-814b-33c101c29146'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:42.584765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2521/5033] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:42 2022] DELETE /identity/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:42.585585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:42.587026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:42.599681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff01a54-94ee-4576-a642-9841ff22595d tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:42.729742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:42.731278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:42.731730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:42.732340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:42.733185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:42.736290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:42.883670 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2513/5034] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:42 2022] POST /identity/v3/projects => generated 377 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:42.894238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:42.899639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:42.928139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1792f-9000-491c-814b-33c101c29146 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:43.025802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:43.026604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:43.026985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:43.027378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/1e1170454dbd4086b08665ffbab7f593` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:43.028633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=1e1170454dbd4086b08665ffbab7f593)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:43.030956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:43.036865 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2522/5035] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:42 2022] GET /identity/v3/projects/1e1170454dbd4086b08665ffbab7f593 => generated 377 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:43.038439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:43.063211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d18d08-047b-4399-8e19-d855366a3d6e tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:43.070732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:43.071823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:43.072548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:43.073045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:43.074066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:43.076694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:43.147869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2514/5036] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:37:43 2022] GET /identity/v3/projects => generated 6953 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:43.152893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:43.179577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e87fd0-edc1-46af-a1e1-d3c9257f7c65 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:43.188200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:43.189318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:43.189823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:43.190107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/1e1170454dbd4086b08665ffbab7f593` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:43.191385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e1170454dbd4086b08665ffbab7f593)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:43.219808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:43.431040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1170454dbd4086b08665ffbab7f593', 'request_id': 'req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:43.507070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1170454dbd4086b08665ffbab7f593', 'request_id': 'req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:43.516701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1170454dbd4086b08665ffbab7f593', 'request_id': 'req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:43.560362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 1e1170454dbd4086b08665ffbab7f593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:43.560660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:43.562679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:43.565088 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2523/5037] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:43 2022] DELETE /identity/v3/projects/1e1170454dbd4086b08665ffbab7f593 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:43.570417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:43.572424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:43.590043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a8d0-0b4a-4756-81b9-3432cb056251 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:43.732289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:43.733693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:43.734497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:43.734982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:43.735954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:43.738360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:43.927396 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2515/5038] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:43 2022] POST /identity/v3/projects => generated 347 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:43.931286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:43.942723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1eef9-9c5d-4e8d-a12f-ce5ff9c8b854 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:44.037627 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:44.073972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:44.074997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:44.075447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:44.075888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/3a683e6db374466dbe276157c17518a4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:44.080758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_project(project_id=3a683e6db374466dbe276157c17518a4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:44.080758 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:44.080758 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:37:44.080758 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:37:44.086431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:44.218324 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2524/5039] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:37:43 2022] PATCH /identity/v3/projects/3a683e6db374466dbe276157c17518a4 => generated 361 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:44.222863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:44.244502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8d75-b3af-464b-b6ca-ee1e2ceb7141 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:44.266352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:44.267033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:44.267317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:44.267594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/3a683e6db374466dbe276157c17518a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:44.287527 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:44.293022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=3a683e6db374466dbe276157c17518a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:44.296574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:44.298995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2516/5040] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:44 2022] GET /identity/v3/projects/3a683e6db374466dbe276157c17518a4 => generated 348 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:44.303296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:44.319671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372cc0c-280d-4765-a8ca-0b61234303ee tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:44.328605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:44.329357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:44.329651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:44.329924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/3a683e6db374466dbe276157c17518a4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:44.333588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a683e6db374466dbe276157c17518a4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:44.335838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:44.537897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a683e6db374466dbe276157c17518a4', 'request_id': 'req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:44.669122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a683e6db374466dbe276157c17518a4', 'request_id': 'req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:44.690060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a683e6db374466dbe276157c17518a4', 'request_id': 'req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:44.713668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 3a683e6db374466dbe276157c17518a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:44.713900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:44.714899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:44.717470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2525/5041] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:44 2022] DELETE /identity/v3/projects/3a683e6db374466dbe276157c17518a4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:44.722666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:44.724829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:44.740279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21fbbe-6d1c-486c-8336-d90be7b970a9 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:44.836007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:44.836998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:44.838293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:44.838737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:44.840014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:44.842418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:44.970159 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2517/5042] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:44 2022] POST /identity/v3/projects => generated 360 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:44.972173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:44.997108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93cd0-7c04-4f8a-8a04-9d298d5075ef tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:45.131443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:45.132638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:45.133140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:45.134211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/5464538a367a46d0b997b16e3c7df997` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:45.136308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_project(project_id=5464538a367a46d0b997b16e3c7df997)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:45.139571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:45.332775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2526/5043] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:37:44 2022] PATCH /identity/v3/projects/5464538a367a46d0b997b16e3c7df997 => generated 372 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:45.333757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:45.362593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01be024-a24b-4ca0-9748-0f5d98725a68 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:45.377835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:45.378499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:45.378782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:45.379056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/5464538a367a46d0b997b16e3c7df997` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:45.417438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=5464538a367a46d0b997b16e3c7df997)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:45.419844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:45.430536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:45.433461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2518/5044] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:45 2022] GET /identity/v3/projects/5464538a367a46d0b997b16e3c7df997 => generated 359 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:45.439757 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:45.451553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94db18-d4a3-4fec-b717-6f24fb7798b1 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:45.467048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:45.468006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:45.469206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:45.470093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/5464538a367a46d0b997b16e3c7df997` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:45.474688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5464538a367a46d0b997b16e3c7df997)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:45.503790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:45.664739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5464538a367a46d0b997b16e3c7df997', 'request_id': 'req-4975e7f3-98cd-47a0-a274-fa2b467cf749'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:45.756676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5464538a367a46d0b997b16e3c7df997', 'request_id': 'req-4975e7f3-98cd-47a0-a274-fa2b467cf749'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:45.766159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5464538a367a46d0b997b16e3c7df997', 'request_id': 'req-4975e7f3-98cd-47a0-a274-fa2b467cf749'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:45.777390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project 5464538a367a46d0b997b16e3c7df997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:45.779801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:45.780298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:45.787445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:45.787974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2527/5045] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:45 2022] DELETE /identity/v3/projects/5464538a367a46d0b997b16e3c7df997 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:45.790931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:45.812850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97cf8-a841-4eb2-99fb-ee52780ba86a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:45.905401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:45.906347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:45.907411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:45.907866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:45.908681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:45.911106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:46.048156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2519/5046] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:45 2022] POST /identity/v3/projects => generated 353 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:46.048849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:46.062327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975e7f3-98cd-47a0-a274-fa2b467cf749 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:46.150793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:46.150793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:46.150793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:46.151383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/f1f5daac27124bd1911df5c1e768e77c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:46.152302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:update_project(project_id=f1f5daac27124bd1911df5c1e768e77c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:46.154572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:46.282001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2528/5047] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:37:46 2022] PATCH /identity/v3/projects/f1f5daac27124bd1911df5c1e768e77c => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:46.287630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:46.302410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565497e-e431-4179-adad-11562c8f5f4a tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:46.307649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:46.309750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:46.310340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:46.310827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/f1f5daac27124bd1911df5c1e768e77c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:46.324658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:get_project(project_id=f1f5daac27124bd1911df5c1e768e77c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:46.327811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:46.330202 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2520/5048] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:37:46 2022] GET /identity/v3/projects/f1f5daac27124bd1911df5c1e768e77c => generated 355 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:37:46.334445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:46.347661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36930780-5536-42b3-b442-77b869745744 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:46.353185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:46.354582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:46.355911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:46.355911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/projects/f1f5daac27124bd1911df5c1e768e77c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:46.356840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1f5daac27124bd1911df5c1e768e77c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:46.359067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:46.537185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f5daac27124bd1911df5c1e768e77c', 'request_id': 'req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:46.734439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f5daac27124bd1911df5c1e768e77c', 'request_id': 'req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:46.734439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f5daac27124bd1911df5c1e768e77c', 'request_id': 'req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:46.734439 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:46.751583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] The token cache is being invalidate because project f1f5daac27124bd1911df5c1e768e77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:46.751920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:46.753034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:46.754620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2529/5049] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:46 2022] DELETE /identity/v3/projects/f1f5daac27124bd1911df5c1e768e77c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:37:46.760296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:46.762714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:46.966506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4a13-9698-44ba-a532-e67bd3eb0cdc tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:46.966506 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:46.966506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:46.967422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:46.967422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:46.967422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:46.972266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Could not find domain: a1a92d497f2e4f2dbcd0b903491a5ce5.: keystone.exception.DomainNotFound: Could not find domain: a1a92d497f2e4f2dbcd0b903491a5ce5. Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a1a92d497f2e4f2dbcd0b903491a5ce5. Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:46.977584 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:46.978866 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a1a92d497f2e4f2dbcd0b903491a5ce5. Oct 30 01:37:46.980010 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:46.990817 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2521/5050] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:46 2022] PATCH /identity/v3/domains/a1a92d497f2e4f2dbcd0b903491a5ce5 => generated 112 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:46.991578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:47.000576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb886d39-ea8a-44f4-8afd-abd1cd9c7750 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:47.007019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd2322c09bcd4b98b3852ba28d1bc8aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f68de144179a46c7ab63a399d756c2e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:47.008363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:47.010228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:47.010746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] PATH_INFO: `/v3/domains/25d6fbef46564a03ae608ad8a34b7e38` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:47.022431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-9e4631a0-aa3b-4cc9-827f-eb7bf11bd110 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Could not find domain: 25d6fbef46564a03ae608ad8a34b7e38.: keystone.exception.DomainNotFound: Could not find domain: 25d6fbef46564a03ae608ad8a34b7e38. Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 25d6fbef46564a03ae608ad8a34b7e38. Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:47.032279 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:47.033773 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 25d6fbef46564a03ae608ad8a34b7e38. Oct 30 01:37:47.034883 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:37:47.042668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2530/5051] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:37:46 2022] PATCH /identity/v3/domains/25d6fbef46564a03ae608ad8a34b7e38 => generated 112 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:47.046608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:47.050706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:47.160902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44ba8-554f-4696-9534-09e1109f2a73 tempest-ProjectsTestJSON-224993584 tempest-ProjectsTestJSON-224993584-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:47.167560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:47.169503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:47.169792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:47.170072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] PATH_INFO: `/v3/users/e1a559f803fe48fca49c33c290cf4f34` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:47.171304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a559f803fe48fca49c33c290cf4f34)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:47.173321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:47.482378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a559f803fe48fca49c33c290cf4f34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:47.484774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a559f803fe48fca49c33c290cf4f34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:47.507951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a559f803fe48fca49c33c290cf4f34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:47.512610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a559f803fe48fca49c33c290cf4f34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:47.577753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a559f803fe48fca49c33c290cf4f34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:47.629640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2522/5052] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:47 2022] DELETE /identity/v3/users/e1a559f803fe48fca49c33c290cf4f34 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:47.634588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:47.635122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:47.635122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:47.710808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:47.717345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:47.816850 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2531/5053] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:47.823381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:47.826003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:47.904637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7b85-26f8-433c-8bed-483f2b99e468 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:47.912587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:47.913557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:47.914210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:47.914482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:47.926955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:47.928450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:47.940844 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2523/5054] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:37:48.989070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:48.991194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:49.017871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b7ee0-f0db-44d5-b51c-3204bc2ae10d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:49.030121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:49.031023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:49.031497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:49.031962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] PATH_INFO: `/v3/projects/22db7444102c4c06bf6fcc2594cd99ac` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:49.033502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22db7444102c4c06bf6fcc2594cd99ac)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:49.037080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:49.306656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22db7444102c4c06bf6fcc2594cd99ac', 'request_id': 'req-6c374f8c-20ee-459e-94b0-724d427fd51d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:49.411127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22db7444102c4c06bf6fcc2594cd99ac', 'request_id': 'req-6c374f8c-20ee-459e-94b0-724d427fd51d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:49.431859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22db7444102c4c06bf6fcc2594cd99ac', 'request_id': 'req-6c374f8c-20ee-459e-94b0-724d427fd51d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:49.458344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] The token cache is being invalidate because project 22db7444102c4c06bf6fcc2594cd99ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:49.459480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:49.460421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c374f8c-20ee-459e-94b0-724d427fd51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:49.463345 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2532/5055] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:48 2022] DELETE /identity/v3/projects/22db7444102c4c06bf6fcc2594cd99ac => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:49.467154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:49.475688 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:49.483904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99bf9-6968-4b4e-8f50-af3b42336cbf service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:49.682397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:49.683594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:49.684043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:49.684525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] PATH_INFO: `/v3/users/bd2322c09bcd4b98b3852ba28d1bc8aa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:49.694304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2322c09bcd4b98b3852ba28d1bc8aa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:49.697826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:49.758991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:49.759258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:49.760120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:49.822470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] MFA Rules not processed for user `352cb9c0a2644e0e8743f3cc4477f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:49.833323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:49.952727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2533/5056] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:37:50.026226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2322c09bcd4b98b3852ba28d1bc8aa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:50.037759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2322c09bcd4b98b3852ba28d1bc8aa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:50.057556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2322c09bcd4b98b3852ba28d1bc8aa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:50.058804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2322c09bcd4b98b3852ba28d1bc8aa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:50.160546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d937aa01-b0fc-4015-b27d-8b0cc5ddc7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2322c09bcd4b98b3852ba28d1bc8aa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:50.207384 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2524/5057] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:49 2022] DELETE /identity/v3/users/bd2322c09bcd4b98b3852ba28d1bc8aa => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:51.358215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:51.359708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:51.385612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722bee4-c7eb-4725-a469-05f10e3727d7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:51.408845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:51.544285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c46062-f121-4420-ae36-690276349746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:51.546023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46062-f121-4420-ae36-690276349746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:51.546358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46062-f121-4420-ae36-690276349746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:51.547133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c46062-f121-4420-ae36-690276349746 admin admin] PATH_INFO: `/v3/projects/f68de144179a46c7ab63a399d756c2e7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:51.548503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46062-f121-4420-ae36-690276349746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68de144179a46c7ab63a399d756c2e7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:51.555506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c46062-f121-4420-ae36-690276349746 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:51.753016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68de144179a46c7ab63a399d756c2e7', 'request_id': 'req-85c46062-f121-4420-ae36-690276349746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:51.844789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68de144179a46c7ab63a399d756c2e7', 'request_id': 'req-85c46062-f121-4420-ae36-690276349746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:51.854006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68de144179a46c7ab63a399d756c2e7', 'request_id': 'req-85c46062-f121-4420-ae36-690276349746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:51.878648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] The token cache is being invalidate because project f68de144179a46c7ab63a399d756c2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:51.878936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:51.880544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85c46062-f121-4420-ae36-690276349746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:51.883190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2534/5058] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:51 2022] DELETE /identity/v3/projects/f68de144179a46c7ab63a399d756c2e7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:51.889384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:51.889890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:51.890166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:51.957961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:51.960572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:52.065420 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2525/5059] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:52.075254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.076112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.077577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.115128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:52.118081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:52.159598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2535/5060] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:52.163675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.180239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436803-4cbd-4f2b-b6c3-0b93db9942c7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.188748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.194099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.196754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.200082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.200082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:37:52.200082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.200082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.236929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2526/5061] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:52.237168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.255484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d7b8c-7547-4838-b406-28cbe2eccbd8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.268337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.269092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.269676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.270072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.274037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.297794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.448196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2536/5062] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:52 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:52.452489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.467777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7fa92-9ede-4921-88d1-6baedcc858bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.476878 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:52.552576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.553587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.554064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.554506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.555327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.559309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.675116 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2527/5063] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:52 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:52.678957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.694471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed7-2419-4561-b7d5-df1ee56484fa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.700293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.701379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.701850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.702305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.703142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.705258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.731093 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2537/5064] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:52.735459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.752620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572ba0c-257f-4dc8-b29d-85e33b37b26c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.767020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.767659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.767938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.768212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.768861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.770650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6aa7a-f098-43e0-8cbf-5e3df09a946c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.789301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:52.794997 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2528/5065] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:52.802065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678544e-b8fd-4e9e-ad81-d5acbe30b6d0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:52.816879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:52.817853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.818332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.819020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] PATH_INFO: `/v3/projects/3830cc6d15c94b08bffa3dc1e54f2f34/users/1dae845226994a98aa2c28772f6bbbd7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.839171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3830cc6d15c94b08bffa3dc1e54f2f34, user_id=1dae845226994a98aa2c28772f6bbbd7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:52.847560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:52.944174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2538/5066] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:52 2022] PUT /identity/v3/projects/3830cc6d15c94b08bffa3dc1e54f2f34/users/1dae845226994a98aa2c28772f6bbbd7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:52.956469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:52.957504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:52.957997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:52.990786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] MFA Rules not processed for user `1dae845226994a98aa2c28772f6bbbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:52.996621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:53.096093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2529/5067] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:53.099356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:53.171245 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:53.208798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f7d9-bd13-4c34-a660-7336c89bfd06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:53.213863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:53.214766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:53.215050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:53.215319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:53.216013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:53.225566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:53.323206 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2539/5068] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:37:53 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:53.326807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:53.340353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3d86-d273-4a82-b743-740f9bf76322 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:53.486013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:53.486651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:53.486930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:53.487204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:53.490334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:53.503280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:53.687064 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2530/5069] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:53 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:53.693108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:53.737204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec086a1-d35e-4081-9f49-5f4854e18deb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:53.753277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:53.754810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:53.755099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:53.755372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:53.756027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:53.757674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:53.802206 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2540/5070] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:53.804690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:53.826037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3148b-4689-4e17-b97f-07d078c8c347 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:53.844035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:53.847720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:53.847720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:53.848118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] PATH_INFO: `/v3/projects/6f9f07d5898543d8bc33f48db1b97362/users/96dd6dce97e74b58a6bbba6ae2f09622/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:53.852061 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:53.902329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9f07d5898543d8bc33f48db1b97362, user_id=96dd6dce97e74b58a6bbba6ae2f09622, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:53.907490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:54.013211 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2531/5071] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:53 2022] PUT /identity/v3/projects/6f9f07d5898543d8bc33f48db1b97362/users/96dd6dce97e74b58a6bbba6ae2f09622/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:54.022484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:54.061978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3b822-8d2e-4d5a-899e-86b17a4165db admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:54.211826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:54.212358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:54.213189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:54.213494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:54.214148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:54.215804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a93cf-3e83-4ad0-a5a9-6bcea08d57af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:54.255514 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2541/5072] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:54.258954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:54.276028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad895c4-7f39-4da5-937f-e61003d62f89 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:54.285713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:54.286388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:54.286662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:54.286935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] PATH_INFO: `/v3/projects/6f9f07d5898543d8bc33f48db1b97362/users/96dd6dce97e74b58a6bbba6ae2f09622/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:54.298346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9f07d5898543d8bc33f48db1b97362, user_id=96dd6dce97e74b58a6bbba6ae2f09622, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:54.301064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:54.338406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2532/5073] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:54 2022] PUT /identity/v3/projects/6f9f07d5898543d8bc33f48db1b97362/users/96dd6dce97e74b58a6bbba6ae2f09622/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:37:54.348556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:54.354089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:54.354089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:54.394620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] MFA Rules not processed for user `96dd6dce97e74b58a6bbba6ae2f09622`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:54.395923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:54.542176 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2542/5074] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:54.544357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:54.557437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3166-dd27-4cf3-a0a1-fea5f4d2ba3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:54.562800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:54.563709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:54.564193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:54.564690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:54.565555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:54.567684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:54.725156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2533/5075] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:54 2022] POST /identity/v3/projects => generated 329 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:54.731017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:54.754911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dffcb3-c33a-4d4c-80a9-9d734de9dc91 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:54.851877 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:54.923479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:54.924104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:54.924387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:54.924658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:54.925312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:54.927325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:55.032059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2543/5076] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:54 2022] POST /identity/v3/users => generated 416 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:55.033827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:55.045632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614ea59-d8b9-44a4-8d42-f9112f7a5e97 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:55.055788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:55.058908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:55.058908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:55.058908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:55.058908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:55.059964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:55.197288 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2534/5077] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:37:55 2022] POST /identity/v3/roles => generated 244 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:55.198948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:55.210487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0d7c4-43b1-47c5-9d18-ab476fe26e00 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:55.223442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:55.224252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:55.224545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:55.224821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:55.226053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:55.227691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:55.361036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2544/5078] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:37:55 2022] POST /identity/v3/roles => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:55.362080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:55.374569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b12046-643c-41b5-a0e1-e7be22c4444a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:55.381004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:55.381855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:55.382386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:55.382883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/9a7955df74e84cbf84654c3a0031e719/users/e07a6a8a75e14a09a06e2a138d168eed/roles/45510e91ef3e4dfca0878aa1c67054ff` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:55.411256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a7955df74e84cbf84654c3a0031e719, user_id=e07a6a8a75e14a09a06e2a138d168eed, role_id=45510e91ef3e4dfca0878aa1c67054ff)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:55.414544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:55.529252 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2535/5079] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:55 2022] PUT /identity/v3/projects/9a7955df74e84cbf84654c3a0031e719/users/e07a6a8a75e14a09a06e2a138d168eed/roles/45510e91ef3e4dfca0878aa1c67054ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:37:55.530982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:55.545220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79914273-7fd6-45fe-bce7-f43fe49a06a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:55.677923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:55.681807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:55.682180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:55.682376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/9a7955df74e84cbf84654c3a0031e719/users/e07a6a8a75e14a09a06e2a138d168eed/roles/76de0a8b7f884659aa3dbb6e9202ebf9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:55.685130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a7955df74e84cbf84654c3a0031e719, user_id=e07a6a8a75e14a09a06e2a138d168eed, role_id=76de0a8b7f884659aa3dbb6e9202ebf9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:55.687994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871392d7-80a5-460b-ad11-d06b242ad9df tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:55.835516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2545/5080] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:55 2022] PUT /identity/v3/projects/9a7955df74e84cbf84654c3a0031e719/users/e07a6a8a75e14a09a06e2a138d168eed/roles/76de0a8b7f884659aa3dbb6e9202ebf9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:55.839683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:55.852652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe04b7-67cd-48df-ba1a-db5b77945bbf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:55.947995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:55.951522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:55.951522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:55.951522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:55.951522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:55.954746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eadb4-6a61-436d-906e-f7d1c9e51a34 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:56.026052 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2536/5081] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:37:55 2022] GET /identity/v3/users => generated 8633 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:37:56.030882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:56.031165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:56.031623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:56.098349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] MFA Rules not processed for user `e07a6a8a75e14a09a06e2a138d168eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:56.099503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:56.288109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2546/5082] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:56.289511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:56.290009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:56.290123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:56.328118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] MFA Rules not processed for user `e07a6a8a75e14a09a06e2a138d168eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:37:56.331722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:56.352470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:56.357799 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2537/5083] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:37:56.370530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea4ee-99e6-42cf-98c3-2e2ab8e5f351 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:56.382124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e07a6a8a75e14a09a06e2a138d168eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a7955df74e84cbf84654c3a0031e719', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1027647863', 'tempest-NotDelegatedRole-2026037827'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:56.382757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:56.383420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:56.383694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:56.384614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: Authorizing `identity:create_trust()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:56.386844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:56.432500 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:56.673087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2547/5084] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:37:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:37:56.677450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:56.693952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4b86d-034a-41db-9c67-0a78d669e27f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:56.711668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:56.713114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:56.713619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:56.714055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:56.714939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:56.716568 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:56.716568 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:37:56.716568 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:37:56.720383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:56.745780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2538/5085] 10.222.0.13 () {58 vars in 1155 bytes} [Sun Oct 30 01:37:56 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:37:56.748051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:56.765640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbd0a8-d817-4d53-963a-a43e1876858d tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:56.793130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e07a6a8a75e14a09a06e2a138d168eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a7955df74e84cbf84654c3a0031e719', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1027647863', 'tempest-NotDelegatedRole-2026037827'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:56.795626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:56.796218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:56.796783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] PATH_INFO: `/v3/OS-TRUST/trusts/6a341b868f674842887dd906236cbbaa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:56.811988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: Authorizing `identity:delete_trust(trust_id=6a341b868f674842887dd906236cbbaa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:56.814410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:56.909974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6a341b868f674842887dd906236cbbaa', 'request_id': 'req-982fccde-2b52-42cd-b176-4d19cd3a4675'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:56.913210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6a341b868f674842887dd906236cbbaa', 'request_id': 'req-982fccde-2b52-42cd-b176-4d19cd3a4675'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:56.915323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6a341b868f674842887dd906236cbbaa', 'request_id': 'req-982fccde-2b52-42cd-b176-4d19cd3a4675'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:57.037465 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2548/5086] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:37:56 2022] DELETE /identity/v3/OS-TRUST/trusts/6a341b868f674842887dd906236cbbaa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:57.042250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:57.043993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:57.073596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560e4c9-ddb3-424a-a54d-5d61c2577c50 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:57.079331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e07a6a8a75e14a09a06e2a138d168eed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a7955df74e84cbf84654c3a0031e719', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1027647863', 'tempest-NotDelegatedRole-2026037827'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:57.080205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:57.085899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:57.085899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] PATH_INFO: `/v3/OS-TRUST/trusts/6a341b868f674842887dd906236cbbaa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Could not find trust: 6a341b868f674842887dd906236cbbaa.: keystone.exception.TrustNotFound: Could not find trust: 6a341b868f674842887dd906236cbbaa. Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 30 01:37:57.127429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6a341b868f674842887dd906236cbbaa. Oct 30 01:37:57.128833 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:37:57.129767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2539/5087] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:37:57 2022] GET /identity/v3/OS-TRUST/trusts/6a341b868f674842887dd906236cbbaa => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:37:57.135058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:57.138345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:57.199059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fccde-2b52-42cd-b176-4d19cd3a4675 tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:57.214847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:57.226810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:57.227184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:57.227469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/76de0a8b7f884659aa3dbb6e9202ebf9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:57.232154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=76de0a8b7f884659aa3dbb6e9202ebf9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:57.237678 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:37:57.237678 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:37:57.237678 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:37:57.240387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:57.434867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:57.438426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:57.521400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 76de0a8b7f884659aa3dbb6e9202ebf9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:57.521863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:57.523134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:57.525577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2549/5088] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:57 2022] DELETE /identity/v3/roles/76de0a8b7f884659aa3dbb6e9202ebf9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:57.529592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:57.537572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:57.578345 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:57.644200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86653bee-8df0-4b0d-87cb-87c44974364e tempest-TrustsV3TestJSON-1561998894 tempest-user-1838738984] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:57.767129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:57.768311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:57.770541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:57.775807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:57.781570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:57.846269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:57.851293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:57.855194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da83e72-f997-4f6e-989a-5a17cb24fa88 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:57.882001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:57.882666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:57.882951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:57.883230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/45510e91ef3e4dfca0878aa1c67054ff` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:57.885310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45510e91ef3e4dfca0878aa1c67054ff)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:57.890730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:57.897640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2540/5089] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:37:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:37:58.074228 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:58.097308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 45510e91ef3e4dfca0878aa1c67054ff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:58.097885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.098889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.106311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:58.107888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2550/5090] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:57 2022] DELETE /identity/v3/roles/45510e91ef3e4dfca0878aa1c67054ff => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:58.123500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0b06e-68be-4818-8015-3113906a1df9 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:58.226717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:58.227577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:58.228858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:58.229255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/e07a6a8a75e14a09a06e2a138d168eed` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:58.231890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e07a6a8a75e14a09a06e2a138d168eed)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:58.234884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:58.391946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07a6a8a75e14a09a06e2a138d168eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.394365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07a6a8a75e14a09a06e2a138d168eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.425064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07a6a8a75e14a09a06e2a138d168eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.427280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07a6a8a75e14a09a06e2a138d168eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.536477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07a6a8a75e14a09a06e2a138d168eed'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:58.558696 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:37:58.580424 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2541/5091] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:37:58 2022] DELETE /identity/v3/users/e07a6a8a75e14a09a06e2a138d168eed => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:37:58.584455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:58.585953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:58.619611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c30ee-7d0b-4cdf-be9d-1f335787af20 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:58.718334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:58.719052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:58.719594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:58.721061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/9a7955df74e84cbf84654c3a0031e719` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:58.722863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a7955df74e84cbf84654c3a0031e719)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:58.725710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:58.965103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7955df74e84cbf84654c3a0031e719', 'request_id': 'req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:59.057544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7955df74e84cbf84654c3a0031e719', 'request_id': 'req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:59.086007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7955df74e84cbf84654c3a0031e719', 'request_id': 'req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:59.116996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project 9a7955df74e84cbf84654c3a0031e719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:37:59.117723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:59.119059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:37:59.122987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2551/5092] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:37:58 2022] DELETE /identity/v3/projects/9a7955df74e84cbf84654c3a0031e719 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:37:59.130224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:59.131877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:59.155778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b90ed-563f-425c-998e-1b6332f5bb42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:59.268980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:59.271083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:59.272867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:59.273000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:59.275883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:59.278707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:59.385774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2542/5093] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:37:59 2022] POST /identity/v3/projects => generated 329 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:59.389624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:59.391286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:37:59.432752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c29478-7595-4c3d-a9d1-dd7c3c73d4ee tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:59.573303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:59.574307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:59.574770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:59.575226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:59.576107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:59.579036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:59.683743 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2552/5094] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:37:59 2022] POST /identity/v3/users => generated 416 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:59.687893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:59.703594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac878a31-5461-43e9-8360-0ba9250baee0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:59.713044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:59.717312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:59.717781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:59.718243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:59.721703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:59.723565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:59.828645 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2543/5095] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:37:59 2022] POST /identity/v3/roles => generated 244 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:59.830013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:59.843285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e3f0-8c90-4e62-befb-a34b8835728a tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:37:59.855346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:37:59.857418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:37:59.857808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:37:59.858683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:37:59.860242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:37:59.862841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:37:59.974217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2553/5096] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:37:59 2022] POST /identity/v3/roles => generated 247 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:37:59.975040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:37:59.987891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ac672-d6b7-435f-bd40-69c3b763bfb2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:00.000697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:00.000697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.001973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.003551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/ee9a30800e6a404fb27244c83dab8a02/users/1544b508bf6b4191bdf6c0f18c536e62/roles/083b34a21f214272a81c6665de723eca` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.037474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ee9a30800e6a404fb27244c83dab8a02, user_id=1544b508bf6b4191bdf6c0f18c536e62, role_id=083b34a21f214272a81c6665de723eca)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:00.041646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:00.140318 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2544/5097] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:37:59 2022] PUT /identity/v3/projects/ee9a30800e6a404fb27244c83dab8a02/users/1544b508bf6b4191bdf6c0f18c536e62/roles/083b34a21f214272a81c6665de723eca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:00.146918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:00.152730 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:00.159062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc2d50-bd92-4e61-94f5-91956b38f774 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:00.232787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:00.234064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.234717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.235153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/ee9a30800e6a404fb27244c83dab8a02/users/1544b508bf6b4191bdf6c0f18c536e62/roles/2e6ba492381f43b1966fb11a94c68332` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.238438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ee9a30800e6a404fb27244c83dab8a02, user_id=1544b508bf6b4191bdf6c0f18c536e62, role_id=2e6ba492381f43b1966fb11a94c68332)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:00.242688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf878d-58c2-434d-8dfc-d2a3f0da8ccf tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:00.354070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2554/5098] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:00 2022] PUT /identity/v3/projects/ee9a30800e6a404fb27244c83dab8a02/users/1544b508bf6b4191bdf6c0f18c536e62/roles/2e6ba492381f43b1966fb11a94c68332 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:00.358235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:00.389304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6877bf0-8e9b-4324-9d43-adaaf2cbd5cd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:00.555435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:00.558225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.558571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.558854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.559915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:00.562902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1fefe-f03a-4e5f-8ec8-71ce49f7403f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:00.653474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2545/5099] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:00 2022] GET /identity/v3/users => generated 8633 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:00.658166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.658644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.659078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.732844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] MFA Rules not processed for user `1544b508bf6b4191bdf6c0f18c536e62`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:00.734334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:00.890525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2555/5100] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:00.900349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.900869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.901102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.952031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] MFA Rules not processed for user `1544b508bf6b4191bdf6c0f18c536e62`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:00.953854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:00.969124 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2546/5101] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:00.972641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:00.983438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902b3a-983b-44eb-8239-f25e41866144 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:00.988666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1544b508bf6b4191bdf6c0f18c536e62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9a30800e6a404fb27244c83dab8a02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1920898580', 'tempest-DelegatedRole-1898929762'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:00.989315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:00.989631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:00.990666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:00.990666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorizing `identity:create_trust()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:00.992044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:01.144347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2556/5102] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:38:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:38:01.152812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:01.163680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ef6de-f883-4acc-a664-816bc3315401 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:01.174262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1544b508bf6b4191bdf6c0f18c536e62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9a30800e6a404fb27244c83dab8a02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1920898580', 'tempest-DelegatedRole-1898929762'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:01.175100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:01.177663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:01.179554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:01.179554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:01.181931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:01.196802 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2547/5103] 10.222.0.13 () {58 vars in 1252 bytes} [Sun Oct 30 01:38:01 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=1544b508bf6b4191bdf6c0f18c536e62 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:38:01.197188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:01.207675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596889d5-459d-4ae8-b85f-c7b78acc23d7 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:01.212884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1544b508bf6b4191bdf6c0f18c536e62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9a30800e6a404fb27244c83dab8a02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1920898580', 'tempest-DelegatedRole-1898929762'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:01.213780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:01.214060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:01.214335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] PATH_INFO: `/v3/OS-TRUST/trusts/71a4cc89149748b891d4b329481eeb76` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:01.216928 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:01.221398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorizing `identity:delete_trust(trust_id=71a4cc89149748b891d4b329481eeb76)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:01.222938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:01.347765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '71a4cc89149748b891d4b329481eeb76', 'request_id': 'req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:01.348864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '71a4cc89149748b891d4b329481eeb76', 'request_id': 'req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:01.349524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '71a4cc89149748b891d4b329481eeb76', 'request_id': 'req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:01.467714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2557/5104] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:38:01 2022] DELETE /identity/v3/OS-TRUST/trusts/71a4cc89149748b891d4b329481eeb76 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:01.472033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:01.473944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:01.521027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b08a5-cba6-4f03-b286-5fb623ab775b tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:01.536776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1544b508bf6b4191bdf6c0f18c536e62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9a30800e6a404fb27244c83dab8a02', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1920898580', 'tempest-DelegatedRole-1898929762'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:01.536776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:01.536776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:01.537405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] PATH_INFO: `/v3/OS-TRUST/trusts/71a4cc89149748b891d4b329481eeb76` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Could not find trust: 71a4cc89149748b891d4b329481eeb76.: keystone.exception.TrustNotFound: Could not find trust: 71a4cc89149748b891d4b329481eeb76. Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 30 01:38:01.564644 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 71a4cc89149748b891d4b329481eeb76. Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:01.565900 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2548/5105] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:01 2022] GET /identity/v3/OS-TRUST/trusts/71a4cc89149748b891d4b329481eeb76 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:01.570247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:01.572004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:01.614587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb9eb7-1901-4b30-ba54-7c1c8f486edc tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:01.646625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:01.647291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:01.647575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:01.653687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/2e6ba492381f43b1966fb11a94c68332` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:01.670847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2e6ba492381f43b1966fb11a94c68332)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:01.683998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:01.970485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 2e6ba492381f43b1966fb11a94c68332 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:01.970776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:01.973447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:01.975436 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2558/5106] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:01 2022] DELETE /identity/v3/roles/2e6ba492381f43b1966fb11a94c68332 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:01.980334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:01.982742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:02.006041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c35da4-aed4-4769-8c2a-1955a7565a19 tempest-TrustsV3TestJSON-1288472143 tempest-user-1367830368] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:02.016857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:02.116299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:02.119202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:02.119570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:02.119970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/083b34a21f214272a81c6665de723eca` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:02.127911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=083b34a21f214272a81c6665de723eca)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:02.131655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:02.363012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 083b34a21f214272a81c6665de723eca has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:02.363225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.364021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.370026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2549/5107] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:01 2022] DELETE /identity/v3/roles/083b34a21f214272a81c6665de723eca => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:02.374549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:02.408247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47dc-fb92-452d-8c35-d192fdb3a7b5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:02.518584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:02.519752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:02.520201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:02.520692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/1544b508bf6b4191bdf6c0f18c536e62` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:02.522733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1544b508bf6b4191bdf6c0f18c536e62)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:02.526295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:02.720509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1544b508bf6b4191bdf6c0f18c536e62'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.871476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1544b508bf6b4191bdf6c0f18c536e62'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.876219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1544b508bf6b4191bdf6c0f18c536e62'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.911715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1544b508bf6b4191bdf6c0f18c536e62'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.930302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1544b508bf6b4191bdf6c0f18c536e62'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:02.949086 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2559/5108] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:02 2022] DELETE /identity/v3/users/1544b508bf6b4191bdf6c0f18c536e62 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:02.949550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:02.951267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:02.974185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c069da-1184-4a9c-b289-def13fb8dae0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:03.117380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:03.119332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:03.119876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:03.120327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/ee9a30800e6a404fb27244c83dab8a02` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:03.121847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee9a30800e6a404fb27244c83dab8a02)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:03.124107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:03.348093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9a30800e6a404fb27244c83dab8a02', 'request_id': 'req-55d0d907-efd3-4da7-ab24-cce85c423321'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:03.358824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9a30800e6a404fb27244c83dab8a02', 'request_id': 'req-55d0d907-efd3-4da7-ab24-cce85c423321'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:03.457314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9a30800e6a404fb27244c83dab8a02', 'request_id': 'req-55d0d907-efd3-4da7-ab24-cce85c423321'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:03.484348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project ee9a30800e6a404fb27244c83dab8a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:03.486236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:03.489166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:03.495394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2550/5109] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:02 2022] DELETE /identity/v3/projects/ee9a30800e6a404fb27244c83dab8a02 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:03.502652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:03.515851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:03.576844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e481f-dc4a-4eb5-8630-7839a7d28562 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:03.597007 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:03.859755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:03.860522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:03.860949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:03.867158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:03.868044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:03.870796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:03.996608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2560/5110] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:38:03 2022] POST /identity/v3/projects => generated 329 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:03.998225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.004688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:04.031820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d907-efd3-4da7-ab24-cce85c423321 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:04.038269 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:04.172175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:04.174820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:04.175377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:04.175869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:04.178092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:04.180543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:04.285410 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2551/5111] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:03 2022] POST /identity/v3/users => generated 416 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:04.289297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.300284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ae4e6-542e-4f86-8f9a-7cf1a2cb4796 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:04.304899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:04.305580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:04.306352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:04.306761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:04.307449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:04.309039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:04.442348 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2561/5112] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:04 2022] POST /identity/v3/roles => generated 243 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:38:04.446428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.462425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae1a86-a55e-4a22-826d-66a6f8038acd tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:04.470710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:04.472866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:04.473445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:04.481720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:04.482572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:04.484450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:04.614483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2552/5113] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:04 2022] POST /identity/v3/roles => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:04.614705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.626318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd72e7-a93d-4627-98de-2b5d7729b66b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:04.631083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:04.631782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:04.632109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:04.632736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/506f8b841e7240eaa38ee297444fba7a/users/b229d76ea9ff469a8b7ac504a288946a/roles/6e82e6e473cd469385d3b65edd7cc48d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:04.648892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=506f8b841e7240eaa38ee297444fba7a, user_id=b229d76ea9ff469a8b7ac504a288946a, role_id=6e82e6e473cd469385d3b65edd7cc48d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:04.651626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:04.759652 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2562/5114] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:04 2022] PUT /identity/v3/projects/506f8b841e7240eaa38ee297444fba7a/users/b229d76ea9ff469a8b7ac504a288946a/roles/6e82e6e473cd469385d3b65edd7cc48d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:04.765528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.776045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0628f7-2f70-4449-bc17-4530e692ce12 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:04.847829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:04.848921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:04.849223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:04.849656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/506f8b841e7240eaa38ee297444fba7a/users/b229d76ea9ff469a8b7ac504a288946a/roles/1a4a359f813241c39f160de72c078d8c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:04.851924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=506f8b841e7240eaa38ee297444fba7a, user_id=b229d76ea9ff469a8b7ac504a288946a, role_id=1a4a359f813241c39f160de72c078d8c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:04.855256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383925ca-2011-4b70-96c4-da58a4f6435b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:04.976361 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2553/5115] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:04 2022] PUT /identity/v3/projects/506f8b841e7240eaa38ee297444fba7a/users/b229d76ea9ff469a8b7ac504a288946a/roles/1a4a359f813241c39f160de72c078d8c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:04.978873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:04.999505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7ba72-e920-45fc-8039-5dba5cddde13 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:05.128118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:05.128866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.129452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.129733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.130395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:05.131400 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:38:05.131400 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:38:05.131400 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:38:05.132542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04c43-a5b9-49af-9950-24ce40f3325d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:05.218319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.218319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.218319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.220687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2563/5116] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:04 2022] GET /identity/v3/users => generated 8633 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:05.275540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] MFA Rules not processed for user `b229d76ea9ff469a8b7ac504a288946a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:05.277207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:05.373382 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2554/5117] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:05.383155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.383443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.383717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.408135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] MFA Rules not processed for user `b229d76ea9ff469a8b7ac504a288946a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:05.423256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:05.434677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2564/5118] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:05.439350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:05.453398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a73483-a9f1-457e-bd61-7b43976d14e8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:05.459063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:05.461393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.467050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.467050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.467050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:create_trust()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:05.475748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:05.713522 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2555/5119] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:38:05 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:38:05.714474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:05.729792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca58a9-2fda-46c3-bee3-fef3c02aac54 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:05.731732 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:05.748586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:05.749522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.750985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.751620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.770426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:get_trust(trust_id=356d8949dbb94613a28ee7f3b0407986)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:05.772203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:05.803477 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2565/5120] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:05 2022] GET /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986 => generated 858 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:05.807563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:05.825553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a056f41-8595-4a5f-8f4b-da7df129c3f5 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:05.836514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:05.837211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.837594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.837869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.863041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=356d8949dbb94613a28ee7f3b0407986)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:05.864633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:05.910181 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2556/5121] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:38:05 2022] GET /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles => generated 370 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:05.914403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:05.967497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c1be-94a9-46a8-9bcf-f71ba4362105 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:05.974370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:05.975357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:05.975882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:05.976191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/6e82e6e473cd469385d3b65edd7cc48d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:05.997439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:get_role_for_trust(trust_id=356d8949dbb94613a28ee7f3b0407986, role_id=6e82e6e473cd469385d3b65edd7cc48d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:05.998911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.010105 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2566/5122] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:05 2022] GET /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/6e82e6e473cd469385d3b65edd7cc48d => generated 243 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:06.017060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.028524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d8c0c-9e38-461e-9cc4-747af775b60f tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.042036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.042716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.042997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.043450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/6e82e6e473cd469385d3b65edd7cc48d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.056811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:get_role_for_trust(trust_id=356d8949dbb94613a28ee7f3b0407986, role_id=6e82e6e473cd469385d3b65edd7cc48d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:06.059776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.077201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.078564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2557/5123] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:06 2022] HEAD /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/6e82e6e473cd469385d3b65edd7cc48d => generated 0 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 30 01:38:06.092614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691de56-1a3c-4d57-a498-3eaa90954118 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.116923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.117687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.117976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.118254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/1a4a359f813241c39f160de72c078d8c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.124838 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:06.130461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:get_role_for_trust(trust_id=356d8949dbb94613a28ee7f3b0407986, role_id=1a4a359f813241c39f160de72c078d8c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:06.132137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Could not find role: 1a4a359f813241c39f160de72c078d8c.: keystone.exception.RoleNotFound: Could not find role: 1a4a359f813241c39f160de72c078d8c. Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:06.148234 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1a4a359f813241c39f160de72c078d8c. Oct 30 01:38:06.149407 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:38:06.151639 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2567/5124] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:06 2022] GET /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/1a4a359f813241c39f160de72c078d8c => generated 110 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:06.156126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.168870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a289f-b9fa-489a-86d0-43ca7adee88e tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.173593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.174366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.174590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.174931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/1a4a359f813241c39f160de72c078d8c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.182039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:get_role_for_trust(trust_id=356d8949dbb94613a28ee7f3b0407986, role_id=1a4a359f813241c39f160de72c078d8c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:06.183438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Could not find role: 1a4a359f813241c39f160de72c078d8c.: keystone.exception.RoleNotFound: Could not find role: 1a4a359f813241c39f160de72c078d8c. Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:06.202348 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1a4a359f813241c39f160de72c078d8c. Oct 30 01:38:06.203559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:06.207295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2558/5125] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:06 2022] HEAD /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986/roles/1a4a359f813241c39f160de72c078d8c => generated 0 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 30 01:38:06.211074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.224503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e66fd-004e-4844-b842-b1d24a5b888d tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.230266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.231347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.231844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.232299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.238787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorizing `identity:delete_trust(trust_id=356d8949dbb94613a28ee7f3b0407986)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:06.240524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.336079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '356d8949dbb94613a28ee7f3b0407986', 'request_id': 'req-68b468dc-ca4a-4389-8073-8d4fd56e0db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:06.337237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '356d8949dbb94613a28ee7f3b0407986', 'request_id': 'req-68b468dc-ca4a-4389-8073-8d4fd56e0db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:06.338601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '356d8949dbb94613a28ee7f3b0407986', 'request_id': 'req-68b468dc-ca4a-4389-8073-8d4fd56e0db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:06.443279 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2568/5126] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:38:06 2022] DELETE /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:06.448317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.450242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:06.481796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e950b-0d9c-4cb3-b81d-d35a78551927 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.485893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b229d76ea9ff469a8b7ac504a288946a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '506f8b841e7240eaa38ee297444fba7a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-114602104', 'tempest-NotDelegatedRole-470080694'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.490192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.490497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.491005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] PATH_INFO: `/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Could not find trust: 356d8949dbb94613a28ee7f3b0407986.: keystone.exception.TrustNotFound: Could not find trust: 356d8949dbb94613a28ee7f3b0407986. Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 30 01:38:06.515429 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 356d8949dbb94613a28ee7f3b0407986. Oct 30 01:38:06.516804 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:06.520014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2559/5127] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:06 2022] GET /identity/v3/OS-TRUST/trusts/356d8949dbb94613a28ee7f3b0407986 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:06.525385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.527215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:06.555206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b468dc-ca4a-4389-8073-8d4fd56e0db3 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:06.569887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:06.570735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:06.571790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:06.572242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/1a4a359f813241c39f160de72c078d8c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:06.575192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1a4a359f813241c39f160de72c078d8c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:06.576796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:06.888401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 1a4a359f813241c39f160de72c078d8c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:06.889763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:06.890793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:06.901247 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2569/5128] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:06 2022] DELETE /identity/v3/roles/1a4a359f813241c39f160de72c078d8c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:06.905740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:06.908341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:06.932318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdafd7e-ac59-46e9-87d2-bf16d6805ed2 tempest-TrustsV3TestJSON-1007135413 tempest-user-1971838631] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:07.081965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:07.082885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:07.083362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:07.083839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/6e82e6e473cd469385d3b65edd7cc48d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:07.085782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6e82e6e473cd469385d3b65edd7cc48d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:07.090350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:07.231111 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:07.333304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 6e82e6e473cd469385d3b65edd7cc48d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:07.333664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.334952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.338676 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2560/5129] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:06 2022] DELETE /identity/v3/roles/6e82e6e473cd469385d3b65edd7cc48d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:07.342988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:07.376093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47f3a-4911-4eb4-967d-fc85c2081590 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:07.543799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:07.543799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:07.543799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:07.544195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/b229d76ea9ff469a8b7ac504a288946a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:07.544195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b229d76ea9ff469a8b7ac504a288946a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:07.546679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:07.683082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b229d76ea9ff469a8b7ac504a288946a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.782265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b229d76ea9ff469a8b7ac504a288946a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.790897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b229d76ea9ff469a8b7ac504a288946a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.816288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b229d76ea9ff469a8b7ac504a288946a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.817655 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:07.846024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b229d76ea9ff469a8b7ac504a288946a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:07.866038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2570/5130] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:07 2022] DELETE /identity/v3/users/b229d76ea9ff469a8b7ac504a288946a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:07.871138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:07.873116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:07.895791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81153c1a-4897-448a-924b-0b1121e0fda5 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:08.048093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:08.049937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:08.050439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:08.051720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/506f8b841e7240eaa38ee297444fba7a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:08.053563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=506f8b841e7240eaa38ee297444fba7a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:08.057189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:08.278557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506f8b841e7240eaa38ee297444fba7a', 'request_id': 'req-ba319195-c006-422a-bb8c-31a59ddbc256'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:08.293509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506f8b841e7240eaa38ee297444fba7a', 'request_id': 'req-ba319195-c006-422a-bb8c-31a59ddbc256'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:08.387686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506f8b841e7240eaa38ee297444fba7a', 'request_id': 'req-ba319195-c006-422a-bb8c-31a59ddbc256'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:08.407237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project 506f8b841e7240eaa38ee297444fba7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:08.407886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:08.409052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:08.411447 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2561/5131] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:07 2022] DELETE /identity/v3/projects/506f8b841e7240eaa38ee297444fba7a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:08.417670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:08.419874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:08.436016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead5dc-574a-45d4-92b7-6e14582328e6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:08.615226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:08.618572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:08.619121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:08.619799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:08.624649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:08.630530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:08.740780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2571/5132] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:38:08 2022] POST /identity/v3/projects => generated 328 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:08.745171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:08.746823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:08.770388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba319195-c006-422a-bb8c-31a59ddbc256 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:08.903336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:08.904832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:08.905292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:08.905792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:08.906689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:08.909859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.043260 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2562/5133] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:08 2022] POST /identity/v3/users => generated 413 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:38:09.047334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:09.067405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81f4c-6140-4cf6-990f-22381b8359ff tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:09.076625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:09.078312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.078850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.079349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.080957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:09.084097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.178501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2572/5134] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:09 2022] POST /identity/v3/roles => generated 243 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:09.182798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:09.196081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ca6fa-3b18-434c-b7a3-d5ddaf17768e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:09.204506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:09.206155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.206441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.206723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.207412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:09.209029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.296732 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=8,keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:09.312256 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2563/5135] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:09 2022] POST /identity/v3/roles => generated 247 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:09.316359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:09.329593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3a99a-822e-4de7-9bf4-2d0b09805206 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:09.334623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:09.335267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.335548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.335847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/df921dadc0094160bb09ea72f6c2d29b/users/4fa1ee04ff49453e9c4e099ae6885ea0/roles/a1978add546b4f7ba82ef33e4fbc100f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.351452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df921dadc0094160bb09ea72f6c2d29b, user_id=4fa1ee04ff49453e9c4e099ae6885ea0, role_id=a1978add546b4f7ba82ef33e4fbc100f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:09.354876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.440329 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2573/5136] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:09 2022] PUT /identity/v3/projects/df921dadc0094160bb09ea72f6c2d29b/users/4fa1ee04ff49453e9c4e099ae6885ea0/roles/a1978add546b4f7ba82ef33e4fbc100f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:09.444690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:09.466136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd875b-4abc-40c4-a344-28b8d207b612 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:09.579589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:09.580273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.580781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.581046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/df921dadc0094160bb09ea72f6c2d29b/users/4fa1ee04ff49453e9c4e099ae6885ea0/roles/06f98511a487421282cf73160c18c9c7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.584474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=df921dadc0094160bb09ea72f6c2d29b, user_id=4fa1ee04ff49453e9c4e099ae6885ea0, role_id=06f98511a487421282cf73160c18c9c7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:09.590091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e1f55-0475-468a-8655-ba251b3ff867 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.672477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2564/5137] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:09 2022] PUT /identity/v3/projects/df921dadc0094160bb09ea72f6c2d29b/users/4fa1ee04ff49453e9c4e099ae6885ea0/roles/06f98511a487421282cf73160c18c9c7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:09.674096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:09.693755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c95a57-fd97-4179-bd22-31c5db9c675f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:09.795199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:09.797542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.798072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.798525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.799655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:09.801930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503af6d-3057-4f9e-a869-56311f148d15 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:09.847867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2574/5138] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:09 2022] GET /identity/v3/users => generated 8630 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:38:09.852429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:09.853362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:09.853733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:09.943284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] MFA Rules not processed for user `4fa1ee04ff49453e9c4e099ae6885ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:09.944615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:10.060235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2565/5139] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:10.071094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:10.071411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:10.071716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:10.099858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] MFA Rules not processed for user `4fa1ee04ff49453e9c4e099ae6885ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:10.101131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:10.129613 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2575/5140] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:10.133656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:10.144753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1ee4-eb28-4465-9f10-0de8fecdc086 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:10.151155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fa1ee04ff49453e9c4e099ae6885ea0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df921dadc0094160bb09ea72f6c2d29b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1490754460', 'tempest-DelegatedRole-912709869'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:10.152287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:10.152857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:10.153442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:10.154520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] RBAC: Authorizing `identity:create_trust()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:10.156086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 30 01:38:10.381917 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 30 01:38:10.383007 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:10.394772 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2566/5141] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:38:10 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 242 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:38:10.395934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:10.416381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db355e07-f9e8-4501-9f7c-3dbfff9144f8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:10.431947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:10.433842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:10.434204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:10.434493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/06f98511a487421282cf73160c18c9c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:10.435998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=06f98511a487421282cf73160c18c9c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:10.437826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:10.521381 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:10.618814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 06f98511a487421282cf73160c18c9c7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:10.619171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:10.622642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:10.631611 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2576/5142] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:10 2022] DELETE /identity/v3/roles/06f98511a487421282cf73160c18c9c7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:10.639397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:10.641930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:10.674505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5683-1e66-4de4-8637-fc8ad45d419e tempest-TrustsV3TestJSON-571202571 tempest-user-722870481] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:10.744500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:10.745568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:10.746102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:10.747457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/a1978add546b4f7ba82ef33e4fbc100f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:10.749271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a1978add546b4f7ba82ef33e4fbc100f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:10.751076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:11.020051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role a1978add546b4f7ba82ef33e4fbc100f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:11.023398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.026615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.033600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2567/5143] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:10 2022] DELETE /identity/v3/roles/a1978add546b4f7ba82ef33e4fbc100f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:11.034264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:11.048073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae3c62-9a4b-448f-906a-bf3a4904c0d6 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:11.168069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:11.169633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:11.170094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:11.170544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/4fa1ee04ff49453e9c4e099ae6885ea0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:11.172026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4fa1ee04ff49453e9c4e099ae6885ea0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:11.176212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:11.381307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa1ee04ff49453e9c4e099ae6885ea0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.462237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa1ee04ff49453e9c4e099ae6885ea0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.463477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa1ee04ff49453e9c4e099ae6885ea0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.496719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa1ee04ff49453e9c4e099ae6885ea0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.505560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa1ee04ff49453e9c4e099ae6885ea0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.513864 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2577/5144] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:11 2022] DELETE /identity/v3/users/4fa1ee04ff49453e9c4e099ae6885ea0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:11.517862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:11.519582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:11.541992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3296538-b0e1-4c5b-970b-f602db6e01cb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:11.605043 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:11.635832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:11.636597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:11.636889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:11.637214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/df921dadc0094160bb09ea72f6c2d29b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:11.638480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df921dadc0094160bb09ea72f6c2d29b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:11.640998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:11.905437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df921dadc0094160bb09ea72f6c2d29b', 'request_id': 'req-5399b40e-295b-4471-85f6-b38de8bd195e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:11.913731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df921dadc0094160bb09ea72f6c2d29b', 'request_id': 'req-5399b40e-295b-4471-85f6-b38de8bd195e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:12.027751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df921dadc0094160bb09ea72f6c2d29b', 'request_id': 'req-5399b40e-295b-4471-85f6-b38de8bd195e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:12.056836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project df921dadc0094160bb09ea72f6c2d29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:12.057139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:12.057888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:12.059788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2568/5145] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:11 2022] DELETE /identity/v3/projects/df921dadc0094160bb09ea72f6c2d29b => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:12.064920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:12.066618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:12.091398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa53b3f-56f5-4597-90a5-8c1f5b8cd4f0 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:12.249945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:12.250954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:12.251407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:12.253018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:12.254000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:12.256873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:12.383594 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2578/5146] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:38:12 2022] POST /identity/v3/projects => generated 328 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:12.389761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:12.391586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:12.432037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399b40e-295b-4471-85f6-b38de8bd195e tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:12.434491 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:12.548017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:12.549700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:12.550900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:12.551372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:12.552471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:12.556953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:12.679995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2569/5147] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:12 2022] POST /identity/v3/users => generated 416 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:12.684668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:12.699490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9bc8e-f4f1-4cb0-a448-71b689546a51 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:12.709023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:12.709921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:12.710483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:12.710979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:12.712451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:12.714625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:12.787023 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2579/5148] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:12 2022] POST /identity/v3/roles => generated 244 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:12.791665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:12.811410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c83e-5112-49a2-a691-2f8026372916 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:12.823908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:12.824866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:12.825328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:12.825811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:12.827037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:12.829265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:12.839003 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:12.928099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:12.929016 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2570/5149] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:12 2022] POST /identity/v3/roles => generated 247 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:12.944595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dec2da-fa4b-4745-b646-7338704bf9eb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:12.949829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:12.950497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:12.950780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:12.951058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/8bd590114eaf4f8a8177a0108b459511/users/378bcd9d3c1a4ecd93f35108e2a1246b/roles/3a170368f3854770a8932c87cf33ab42` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:12.969132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd590114eaf4f8a8177a0108b459511, user_id=378bcd9d3c1a4ecd93f35108e2a1246b, role_id=3a170368f3854770a8932c87cf33ab42)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:12.971887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:13.107951 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2580/5150] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:12 2022] PUT /identity/v3/projects/8bd590114eaf4f8a8177a0108b459511/users/378bcd9d3c1a4ecd93f35108e2a1246b/roles/3a170368f3854770a8932c87cf33ab42 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:13.108949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:13.134692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa529-ab7b-445c-9450-c1a98fb92147 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:13.275637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:13.276858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:13.277402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:13.278175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/8bd590114eaf4f8a8177a0108b459511/users/378bcd9d3c1a4ecd93f35108e2a1246b/roles/782c7201d7bb4cfab311e25222b255eb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:13.281209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bd590114eaf4f8a8177a0108b459511, user_id=378bcd9d3c1a4ecd93f35108e2a1246b, role_id=782c7201d7bb4cfab311e25222b255eb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:13.284349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01414378-5134-404e-875b-8cae630b1d42 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:13.376746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2571/5151] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:13 2022] PUT /identity/v3/projects/8bd590114eaf4f8a8177a0108b459511/users/378bcd9d3c1a4ecd93f35108e2a1246b/roles/782c7201d7bb4cfab311e25222b255eb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:13.377431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:13.391509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a7b1-723b-4d62-8c68-004190ca5619 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:13.462960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:13.463818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:13.469538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:13.469955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:13.470750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:13.479996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8690f-1e0f-4a9d-a9b9-ad1b73ed4fe2 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:13.539249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2581/5152] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:13 2022] GET /identity/v3/users => generated 8633 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:38:13.540781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:13.541203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:13.541599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:13.626711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] MFA Rules not processed for user `378bcd9d3c1a4ecd93f35108e2a1246b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:13.628055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:13.765904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:13.766168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:13.766447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:13.784979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2572/5153] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:13.819702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] MFA Rules not processed for user `378bcd9d3c1a4ecd93f35108e2a1246b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:13.821046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:13.840194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2582/5154] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:13.844455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:13.860596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9bd52-edda-48ea-83b3-959c47ab8470 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:13.910450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:13.911096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:13.911378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:13.911651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:13.912363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:create_trust()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:13.919444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.175891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2573/5155] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:38:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:14.179828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.201189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7dc5-15db-4cbe-80fc-bb33d07eb563 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.244648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.249480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.249844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.250199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.300847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:get_trust(trust_id=b1b93d7c57df4619a2809d70177a9782)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.302353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.322156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2583/5156] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:14 2022] GET /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782 => generated 834 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:14.326224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.338056 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:14.341440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ac12-be36-4ddd-8229-31f007c1424a tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.351583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.352346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.353478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.354085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.361810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b1b93d7c57df4619a2809d70177a9782)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.363818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.374489 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2574/5157] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:38:14 2022] GET /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:14.378629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.394057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381a889-36c9-44b7-8153-ccadf4fd3ccc tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.399630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.400392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.403533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.403533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/3a170368f3854770a8932c87cf33ab42` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.409939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b1b93d7c57df4619a2809d70177a9782, role_id=3a170368f3854770a8932c87cf33ab42)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.411828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.431766 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2584/5158] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:14 2022] GET /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/3a170368f3854770a8932c87cf33ab42 => generated 244 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:14.436039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.448414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337f0b6-a989-4081-b081-fa14654260bd tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.453597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.454551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.457044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.457044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/3a170368f3854770a8932c87cf33ab42` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.464818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b1b93d7c57df4619a2809d70177a9782, role_id=3a170368f3854770a8932c87cf33ab42)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.466382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.474514 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2575/5159] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:14 2022] HEAD /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/3a170368f3854770a8932c87cf33ab42 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 30 01:38:14.479569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.495962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f06c4-fa10-41a7-9f77-040a6d80d184 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.501010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.502063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.502617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.503287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/782c7201d7bb4cfab311e25222b255eb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.510839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b1b93d7c57df4619a2809d70177a9782, role_id=782c7201d7bb4cfab311e25222b255eb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.512891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Could not find role: 782c7201d7bb4cfab311e25222b255eb.: keystone.exception.RoleNotFound: Could not find role: 782c7201d7bb4cfab311e25222b255eb. Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:14.526243 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 782c7201d7bb4cfab311e25222b255eb. Oct 30 01:38:14.527465 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:38:14.529617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2585/5160] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:14 2022] GET /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/782c7201d7bb4cfab311e25222b255eb => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:14.533785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.551370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad122d4-e437-4922-b18d-668fb21059a5 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.558844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.559899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.560408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.561502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/782c7201d7bb4cfab311e25222b255eb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.570087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b1b93d7c57df4619a2809d70177a9782, role_id=782c7201d7bb4cfab311e25222b255eb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.579801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Could not find role: 782c7201d7bb4cfab311e25222b255eb.: keystone.exception.RoleNotFound: Could not find role: 782c7201d7bb4cfab311e25222b255eb. Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:14.594195 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 782c7201d7bb4cfab311e25222b255eb. Oct 30 01:38:14.595861 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:14.597460 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2576/5161] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:14 2022] HEAD /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782/roles/782c7201d7bb4cfab311e25222b255eb => generated 0 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:14.601472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.615715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcbf9-c3c7-423f-93f3-6b08b5bab5eb tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.623094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.624447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.625046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.625772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.637221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorizing `identity:delete_trust(trust_id=b1b93d7c57df4619a2809d70177a9782)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.640328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:14.753951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b1b93d7c57df4619a2809d70177a9782', 'request_id': 'req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:14.755270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b1b93d7c57df4619a2809d70177a9782', 'request_id': 'req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:14.756527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b1b93d7c57df4619a2809d70177a9782', 'request_id': 'req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:14.917708 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2586/5162] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:38:14 2022] DELETE /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:14.921412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.923296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:14.938701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f24ed5-0dfa-47fe-8203-e9e733559ac8 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.945887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '378bcd9d3c1a4ecd93f35108e2a1246b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd590114eaf4f8a8177a0108b459511', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1088809300', 'tempest-DelegatedRole-1442712734'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.946728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.947006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.947282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] PATH_INFO: `/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Could not find trust: b1b93d7c57df4619a2809d70177a9782.: keystone.exception.TrustNotFound: Could not find trust: b1b93d7c57df4619a2809d70177a9782. Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 30 01:38:14.957254 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b1b93d7c57df4619a2809d70177a9782. Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:14.958564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2577/5163] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:14 2022] GET /identity/v3/OS-TRUST/trusts/b1b93d7c57df4619a2809d70177a9782 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:14.965145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:14.967191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:14.985951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40d147-b2a5-46b6-83e7-8dd9eabd9cd1 tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:14.990761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:14.991653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:14.993963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:14.994521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/782c7201d7bb4cfab311e25222b255eb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:14.995820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=782c7201d7bb4cfab311e25222b255eb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:14.997698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:15.000246 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:15.251746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 782c7201d7bb4cfab311e25222b255eb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:15.252639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:15.253111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:15.257291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2587/5164] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:14 2022] DELETE /identity/v3/roles/782c7201d7bb4cfab311e25222b255eb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:15.261911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:15.264165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:15.309157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f19da-adad-4c81-8909-ef011dcee4df tempest-TrustsV3TestJSON-822611713 tempest-user-1604781570] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:15.400822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:15.401923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:15.403202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:15.405198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/3a170368f3854770a8932c87cf33ab42` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:15.407334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a170368f3854770a8932c87cf33ab42)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:15.410037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:15.627879 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:15.635413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 3a170368f3854770a8932c87cf33ab42 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:15.635958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:15.642057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:15.644265 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2578/5165] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:15 2022] DELETE /identity/v3/roles/3a170368f3854770a8932c87cf33ab42 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:15.648639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:15.665313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5af20-4335-488a-8f78-3af4b7cd6a1f tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:15.741214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:15.742237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:15.742580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:15.742862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/378bcd9d3c1a4ecd93f35108e2a1246b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:15.744766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=378bcd9d3c1a4ecd93f35108e2a1246b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:15.746918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:15.991869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378bcd9d3c1a4ecd93f35108e2a1246b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.102064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378bcd9d3c1a4ecd93f35108e2a1246b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.106218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378bcd9d3c1a4ecd93f35108e2a1246b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.127945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378bcd9d3c1a4ecd93f35108e2a1246b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.138162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378bcd9d3c1a4ecd93f35108e2a1246b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.153229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:16.154750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:16.160267 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2588/5166] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:15 2022] DELETE /identity/v3/users/378bcd9d3c1a4ecd93f35108e2a1246b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:16.179168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7c073-a3f8-4c0b-b56a-a9e302dcc0a9 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:16.263223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:16.264559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:16.265135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:16.266216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/8bd590114eaf4f8a8177a0108b459511` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:16.275501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8bd590114eaf4f8a8177a0108b459511)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:16.279414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:16.520853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd590114eaf4f8a8177a0108b459511', 'request_id': 'req-552aae64-d7d9-438d-92d8-a4941bc4a984'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.527190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd590114eaf4f8a8177a0108b459511', 'request_id': 'req-552aae64-d7d9-438d-92d8-a4941bc4a984'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.662445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd590114eaf4f8a8177a0108b459511', 'request_id': 'req-552aae64-d7d9-438d-92d8-a4941bc4a984'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.684827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project 8bd590114eaf4f8a8177a0108b459511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:16.685124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.685832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:16.687329 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2579/5167] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:16 2022] DELETE /identity/v3/projects/8bd590114eaf4f8a8177a0108b459511 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:16.694878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:16.698105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:16.718388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46132c77-d8b1-43bd-9692-070558657f68 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:16.832977 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:16.907096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:16.907753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:16.908041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:16.908499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:16.909162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:16.922703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:17.020227 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2589/5168] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:38:16 2022] POST /identity/v3/projects => generated 328 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:17.024887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:17.026625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:17.073304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552aae64-d7d9-438d-92d8-a4941bc4a984 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:17.204705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:17.205632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:17.206074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:17.206536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:17.207417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:17.209636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:17.392302 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2580/5169] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:17 2022] POST /identity/v3/users => generated 416 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:17.393499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:17.409691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69c01f-85e0-4351-8aca-b6131f85dfcb tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:17.428675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:17.431737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:17.431737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:17.431737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:17.431737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:17.433746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:17.548788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2590/5170] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:17 2022] POST /identity/v3/roles => generated 243 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:38:17.553204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:17.567848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2421e8-bcb8-4700-a6d1-a28f1b0a6046 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:17.579001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:17.579932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:17.580423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:17.580882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:17.586118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:17.586118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:17.674582 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2581/5171] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:38:17 2022] POST /identity/v3/roles => generated 246 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:17.675527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:17.699118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cbf3b-2f6f-42c9-b857-da942bebcb47 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:17.718182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:17.719222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:17.719765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:17.720921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/0a2a404a41e04d32b9c7b2b13314b881/users/a403010ef4fe42b6b00357f06212c1c0/roles/c4364620bac4494b9d47aee2abd1dcc1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:17.747873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a404a41e04d32b9c7b2b13314b881, user_id=a403010ef4fe42b6b00357f06212c1c0, role_id=c4364620bac4494b9d47aee2abd1dcc1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:17.751753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:17.900885 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2591/5172] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:17 2022] PUT /identity/v3/projects/0a2a404a41e04d32b9c7b2b13314b881/users/a403010ef4fe42b6b00357f06212c1c0/roles/c4364620bac4494b9d47aee2abd1dcc1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:17.908077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:17.914228 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:17.935805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba458-dbb6-44fe-9ac7-cb1e026b019d tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:18.094241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:18.094556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:18.096985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:18.097311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/0a2a404a41e04d32b9c7b2b13314b881/users/a403010ef4fe42b6b00357f06212c1c0/roles/458a512ecb27498aa50cfcb174d15e68` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:18.104621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a404a41e04d32b9c7b2b13314b881, user_id=a403010ef4fe42b6b00357f06212c1c0, role_id=458a512ecb27498aa50cfcb174d15e68)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:18.118926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ec9f-b2ea-4152-b761-ac1a35d12724 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:18.491721 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2582/5173] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:17 2022] PUT /identity/v3/projects/0a2a404a41e04d32b9c7b2b13314b881/users/a403010ef4fe42b6b00357f06212c1c0/roles/458a512ecb27498aa50cfcb174d15e68 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:18.496515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:18.515615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c5186-b7f4-47e5-bf39-9296bac62482 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:18.653935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:18.661621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:18.663942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:18.663942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:18.663942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:18.666570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bacee7-1efd-4575-adea-9f0fa74ed189 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:18.716811 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2592/5174] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:18 2022] GET /identity/v3/users => generated 8633 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:18.720627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:18.720911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:18.721483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:18.795957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] MFA Rules not processed for user `a403010ef4fe42b6b00357f06212c1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:18.799010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:18.982569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2583/5175] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:18.993043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:18.994248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:18.995095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.028228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] MFA Rules not processed for user `a403010ef4fe42b6b00357f06212c1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:19.038113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:19.059260 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2593/5176] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:19.060558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.070922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8dac3-04dd-4d8d-9115-732a13aa8155 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.086485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.088445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.088791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.089079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.089802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:create_trust()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:19.094702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:19.458754 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2584/5177] 10.222.0.13 () {60 vars in 1174 bytes} [Sun Oct 30 01:38:19 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:19.460276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.476385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c15920-09a2-4051-8d86-b03e80f84a1f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.499629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.506531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.506531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.506531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.537624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:get_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:19.540643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:19.568065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2594/5178] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:19 2022] GET /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd => generated 834 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:19.573324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.590126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997683-5de7-4142-9e02-aa164ff029ae tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.608406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.612203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.612493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.618750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.649835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:19.674470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:19.701487 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2585/5179] 10.222.0.13 () {58 vars in 1269 bytes} [Sun Oct 30 01:38:19 2022] GET /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles => generated 370 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:19.705747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.733314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df0ce-9433-4c90-99e3-9d784c77a049 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.753521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.757765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.757765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.757765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/c4364620bac4494b9d47aee2abd1dcc1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.795630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd, role_id=c4364620bac4494b9d47aee2abd1dcc1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:19.801143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:19.852764 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2595/5180] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:19 2022] GET /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/c4364620bac4494b9d47aee2abd1dcc1 => generated 243 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:19.857069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.867547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2e7e8-de44-4f99-8125-098617bb8575 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.888237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.897813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.898366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.899038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/c4364620bac4494b9d47aee2abd1dcc1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:19.922404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd, role_id=c4364620bac4494b9d47aee2abd1dcc1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:19.929005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:19.940706 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2586/5181] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:19 2022] HEAD /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/c4364620bac4494b9d47aee2abd1dcc1 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 30 01:38:19.942415 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:19.944830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:19.968550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfa60c-0c34-473c-b01d-18ecef480a83 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:19.979884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:19.980663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:19.981020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:19.981407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/458a512ecb27498aa50cfcb174d15e68` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.016324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd, role_id=458a512ecb27498aa50cfcb174d15e68)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:20.025806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Could not find role: 458a512ecb27498aa50cfcb174d15e68.: keystone.exception.RoleNotFound: Could not find role: 458a512ecb27498aa50cfcb174d15e68. Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:20.061600 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 458a512ecb27498aa50cfcb174d15e68. Oct 30 01:38:20.062990 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:38:20.064619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2596/5182] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:38:19 2022] GET /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/458a512ecb27498aa50cfcb174d15e68 => generated 110 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:20.069078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.082888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d7afa-f922-4387-ab33-d20ed6788bd9 tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:20.102349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:20.106906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:20.106906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:20.108614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/458a512ecb27498aa50cfcb174d15e68` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.126542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:get_role_for_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd, role_id=458a512ecb27498aa50cfcb174d15e68)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:20.130677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-e7dac6db-8cd1-45ee-8382-4c0691c62ffa tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Could not find role: 458a512ecb27498aa50cfcb174d15e68.: keystone.exception.RoleNotFound: Could not find role: 458a512ecb27498aa50cfcb174d15e68. Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:38:20.150877 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 458a512ecb27498aa50cfcb174d15e68. Oct 30 01:38:20.154906 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:20.156141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2587/5183] 10.222.0.13 () {58 vars in 1369 bytes} [Sun Oct 30 01:38:20 2022] HEAD /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd/roles/458a512ecb27498aa50cfcb174d15e68 => generated 0 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 30 01:38:20.160042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.183870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7043-337c-41dc-9a61-98b1830c264b tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:20.200197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:20.201737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:20.201737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:20.202289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.222006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorizing `identity:delete_trust(trust_id=a095bb699eea4167b5e93d70dd0880bd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:20.224709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:20.358286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a095bb699eea4167b5e93d70dd0880bd', 'request_id': 'req-cd112015-a3de-41c8-8e4f-9042bcae132f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:20.365450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a095bb699eea4167b5e93d70dd0880bd', 'request_id': 'req-cd112015-a3de-41c8-8e4f-9042bcae132f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:20.365450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a095bb699eea4167b5e93d70dd0880bd', 'request_id': 'req-cd112015-a3de-41c8-8e4f-9042bcae132f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:20.365450 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:20.386860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:20.387252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:20.387637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.422706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:20.424205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:20.471592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2597/5184] 10.222.0.13 () {58 vars in 1254 bytes} [Sun Oct 30 01:38:20 2022] DELETE /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:20.476757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.479957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:20.521224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd112015-a3de-41c8-8e4f-9042bcae132f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:20.534375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a403010ef4fe42b6b00357f06212c1c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a2a404a41e04d32b9c7b2b13314b881', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216856616', 'tempest-DelegatedRole-185884141'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:20.545922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:20.546212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:20.546503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] PATH_INFO: `/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Could not find trust: a095bb699eea4167b5e93d70dd0880bd.: keystone.exception.TrustNotFound: Could not find trust: a095bb699eea4167b5e93d70dd0880bd. Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 30 01:38:20.582682 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a095bb699eea4167b5e93d70dd0880bd. Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:38:20.592684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2598/5185] 10.222.0.13 () {58 vars in 1251 bytes} [Sun Oct 30 01:38:20 2022] GET /identity/v3/OS-TRUST/trusts/a095bb699eea4167b5e93d70dd0880bd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:38:20.594074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.594074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:20.609466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2588/5186] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:38:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:20.652967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e7871-0b44-44dd-85ca-94440aac005f tempest-TrustsV3TestJSON-831944844 tempest-user-1177237086] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:20.671044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:20.671764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:20.672053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:20.672322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/458a512ecb27498aa50cfcb174d15e68` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:20.674095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=458a512ecb27498aa50cfcb174d15e68)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:20.675754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:20.798388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.800962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:20.871533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role 458a512ecb27498aa50cfcb174d15e68 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:20.872036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:20.873844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:20.876033 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2599/5187] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:20 2022] DELETE /identity/v3/roles/458a512ecb27498aa50cfcb174d15e68 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:20.880477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:20.887597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:21.014709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50a2ac-ce08-4a74-a259-52fbc5396b76 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:21.072685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28467089-38a2-4c5f-8e01-f604515cf93b tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:21.088194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:21.088852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:21.089137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:21.089445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/roles/c4364620bac4494b9d47aee2abd1dcc1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:21.090918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c4364620bac4494b9d47aee2abd1dcc1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:21.092669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:21.178077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:21.179449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:21.179449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:21.179449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:21.182109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:21.195926 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:21.327677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:21.331385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:21.359450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invalidating the token cache because role c4364620bac4494b9d47aee2abd1dcc1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:21.359731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2589/5188] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:38:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:38:21.360538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.361472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.364549 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2600/5189] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:20 2022] DELETE /identity/v3/roles/c4364620bac4494b9d47aee2abd1dcc1 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:21.369547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:21.407161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1db9d-990b-4589-bc3f-28d0016b4b4b service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:21.639923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:21.640746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:21.641139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:21.641976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/users/a403010ef4fe42b6b00357f06212c1c0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:21.645045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a403010ef4fe42b6b00357f06212c1c0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:21.649858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:21.883080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a403010ef4fe42b6b00357f06212c1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.884677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a403010ef4fe42b6b00357f06212c1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.909371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a403010ef4fe42b6b00357f06212c1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.910313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a403010ef4fe42b6b00357f06212c1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:21.997587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a403010ef4fe42b6b00357f06212c1c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.026786 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2590/5190] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:21 2022] DELETE /identity/v3/users/a403010ef4fe42b6b00357f06212c1c0 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:22.031281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:22.033273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:22.066949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10a31-8878-4f09-8009-a9feffb18540 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:22.261274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96dd6dce97e74b58a6bbba6ae2f09622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f9f07d5898543d8bc33f48db1b97362', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:22.266372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:22.266372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:22.266372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] PATH_INFO: `/v3/projects/0a2a404a41e04d32b9c7b2b13314b881` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:22.269518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a2a404a41e04d32b9c7b2b13314b881)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:22.273163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:22.290928 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:22.612269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2a404a41e04d32b9c7b2b13314b881', 'request_id': 'req-12cf7e49-abda-4edf-b81e-3bba6e9ca762'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.739685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2a404a41e04d32b9c7b2b13314b881', 'request_id': 'req-12cf7e49-abda-4edf-b81e-3bba6e9ca762'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.744807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2a404a41e04d32b9c7b2b13314b881', 'request_id': 'req-12cf7e49-abda-4edf-b81e-3bba6e9ca762'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.766198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] The token cache is being invalidate because project 0a2a404a41e04d32b9c7b2b13314b881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:22.766543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.769395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-12cf7e49-abda-4edf-b81e-3bba6e9ca762 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:22.772789 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2601/5191] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:22 2022] DELETE /identity/v3/projects/0a2a404a41e04d32b9c7b2b13314b881 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:22.779705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:22.782119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:22.829702 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:22.945734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffebff-ed03-4172-8fdc-3f0bfceddc11 tempest-TrustsV3TestJSON-426020993 tempest-TrustsV3TestJSON-426020993-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:23.072573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:23.073392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:23.073781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:23.074161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] PATH_INFO: `/v3/users/1dae845226994a98aa2c28772f6bbbd7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:23.075553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dae845226994a98aa2c28772f6bbbd7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:23.078008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:23.442560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dae845226994a98aa2c28772f6bbbd7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:23.443409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dae845226994a98aa2c28772f6bbbd7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:23.467891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dae845226994a98aa2c28772f6bbbd7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:23.470931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dae845226994a98aa2c28772f6bbbd7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:23.548189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dae845226994a98aa2c28772f6bbbd7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:23.586178 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2591/5192] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:22 2022] DELETE /identity/v3/users/1dae845226994a98aa2c28772f6bbbd7 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:23.587586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:23.588070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:23.588205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:23.629471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:23.632959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:23.809919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2602/5193] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:23.836513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:23.836513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:23.997651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72c24c-48ba-4947-8b90-ba2ee305aefb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:24.006562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:24.008205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:24.008205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:24.008205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:24.020746 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:24.027436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:24.038844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:24.054389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2592/5194] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:25.579950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:25.581506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:25.614661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65852b2-1eaf-4181-830e-be18ccb86260 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:25.633162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:25.636381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:25.637258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:25.640361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] PATH_INFO: `/v3/projects/3830cc6d15c94b08bffa3dc1e54f2f34` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:25.644237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3830cc6d15c94b08bffa3dc1e54f2f34)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:25.649465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:25.898017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3830cc6d15c94b08bffa3dc1e54f2f34', 'request_id': 'req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:25.997592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3830cc6d15c94b08bffa3dc1e54f2f34', 'request_id': 'req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.015364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3830cc6d15c94b08bffa3dc1e54f2f34', 'request_id': 'req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.054951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] The token cache is being invalidate because project 3830cc6d15c94b08bffa3dc1e54f2f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:26.055435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.059016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.061201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2603/5195] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:25 2022] DELETE /identity/v3/projects/3830cc6d15c94b08bffa3dc1e54f2f34 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:26.064984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:26.086372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f65815-4c96-4540-935c-a2786399be19 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:26.360167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:26.360828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:26.361109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:26.361408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] PATH_INFO: `/v3/users/96dd6dce97e74b58a6bbba6ae2f09622` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:26.378436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96dd6dce97e74b58a6bbba6ae2f09622)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:26.380798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:26.646556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96dd6dce97e74b58a6bbba6ae2f09622'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.655459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96dd6dce97e74b58a6bbba6ae2f09622'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.706483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96dd6dce97e74b58a6bbba6ae2f09622'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.712943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96dd6dce97e74b58a6bbba6ae2f09622'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.809534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bd461b2-4f8a-4a23-97d5-6e7c2bab74d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96dd6dce97e74b58a6bbba6ae2f09622'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:26.873920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2593/5196] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:26 2022] DELETE /identity/v3/users/96dd6dce97e74b58a6bbba6ae2f09622 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:28.826962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:28.828581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:28.860467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8d7cc-029e-4c87-98e9-e5a9d205969b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:28.934393 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:29.111346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:29.112138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:29.112565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:29.113042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] PATH_INFO: `/v3/projects/6f9f07d5898543d8bc33f48db1b97362` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:29.114589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9f07d5898543d8bc33f48db1b97362)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:29.120051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:29.488476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9f07d5898543d8bc33f48db1b97362', 'request_id': 'req-b434a217-d4e5-4208-8a88-8339cccf31d3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:29.569636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9f07d5898543d8bc33f48db1b97362', 'request_id': 'req-b434a217-d4e5-4208-8a88-8339cccf31d3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:29.577605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9f07d5898543d8bc33f48db1b97362', 'request_id': 'req-b434a217-d4e5-4208-8a88-8339cccf31d3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:29.621250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] The token cache is being invalidate because project 6f9f07d5898543d8bc33f48db1b97362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:29.621588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:29.623077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:29.633637 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2604/5197] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:28 2022] DELETE /identity/v3/projects/6f9f07d5898543d8bc33f48db1b97362 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:29.639860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540343b-e735-4348-81d7-705601d04de5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:29.640368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540343b-e735-4348-81d7-705601d04de5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:29.640461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540343b-e735-4348-81d7-705601d04de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:29.707703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7540343b-e735-4348-81d7-705601d04de5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:29.711999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7540343b-e735-4348-81d7-705601d04de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:29.797021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:29.799639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:29.894395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2594/5198] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:29.903309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:29.910328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:29.910328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:29.944074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:29.945961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:29.946286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a217-d4e5-4208-8a88-8339cccf31d3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:29.955425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:29.956230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:29.957675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:29.958442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] PATH_INFO: `/v3/users/b5d702a3047f45a0a8319562a8db7837` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:29.961846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d702a3047f45a0a8319562a8db7837)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:29.964620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:29.967644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2595/5199] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:38:29.968407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:29.979675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e66d2-231f-4b04-87d9-efd326d8b004 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:29.985790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:29.986792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:29.987330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:29.987833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:29.988729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:38:29.989849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:29.992032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:29.994109 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:30.008970 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2596/5200] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:30.014240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.026882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd4005-9e47-452f-8bb8-b4898e636c87 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.032278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.034069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.034069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.034069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.034069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.048637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.187646 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2597/5201] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:38:30 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:30.188632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.297284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d702a3047f45a0a8319562a8db7837'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:30.331158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1ec35-f1bf-4d1c-bed6-dff5d2385b65 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.344983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.347686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.349013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.349313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.350103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.352851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.400152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d702a3047f45a0a8319562a8db7837'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:30.401288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d702a3047f45a0a8319562a8db7837'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:30.421163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d702a3047f45a0a8319562a8db7837'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:30.438790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6ae58e2-6834-43a0-891a-edf552950dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d702a3047f45a0a8319562a8db7837'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:30.463047 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2605/5202] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:29 2022] DELETE /identity/v3/users/b5d702a3047f45a0a8319562a8db7837 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:30.465900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.466824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.466824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.493066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2598/5203] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:30 2022] POST /identity/v3/users => generated 281 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:30.504446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.509022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:30.516589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:30.517967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:30.531687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a088bfe-1d49-43d9-895b-995237344458 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.647905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2606/5204] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:30.656124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.658010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:30.677209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.677209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.677209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.677209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.677956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.677956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.691563 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2599/5205] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:30.692797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.758263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b02d2-a5d6-4497-8361-ffd5817227db admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.793501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.794123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.794540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.794819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.795463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.797064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.809290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2600/5206] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:30.813128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:30.818091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b7aa0-2e22-4aef-8b42-02a6358020e3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.839780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.840759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.841037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deed03-c7de-4d12-8536-a76bd7ac94f8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:30.841445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.841729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.850221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:30.851224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:30.851665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:30.852717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] PATH_INFO: `/v3/projects/f22b89925f6f45a08f16061504ff5c8e/users/9678a27c70a1453d9b379f7e46bde22d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:30.887138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22b89925f6f45a08f16061504ff5c8e, user_id=9678a27c70a1453d9b379f7e46bde22d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.890447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bfc1e-f3d7-4d72-a0d9-272ea78d743d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.902424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:30.905115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b632c8-5d2c-40fc-9f71-5061b4194a33 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:30.923608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2607/5207] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:38:30.959490 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:30.994863 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2601/5208] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:30 2022] PUT /identity/v3/projects/f22b89925f6f45a08f16061504ff5c8e/users/9678a27c70a1453d9b379f7e46bde22d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:31.005050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba93a-8501-4ece-95a5-6f29d2251dd9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.005413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba93a-8501-4ece-95a5-6f29d2251dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.005882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba93a-8501-4ece-95a5-6f29d2251dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.059255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a7ba93a-8501-4ece-95a5-6f29d2251dd9 None None] MFA Rules not processed for user `9678a27c70a1453d9b379f7e46bde22d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:31.060818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a7ba93a-8501-4ece-95a5-6f29d2251dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.227693 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2608/5209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:31.233302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.233598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.233922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.294900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] MFA Rules not processed for user `9678a27c70a1453d9b379f7e46bde22d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:31.296616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.300898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2602/5210] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:31.306147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.306417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.306695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.345917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] MFA Rules not processed for user `9678a27c70a1453d9b379f7e46bde22d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:31.347199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.357731 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2609/5211] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:31.358817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.376918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22226d97-7169-4d73-9ec1-74d80223b052 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.391999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.392736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.392978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.393243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.407692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorizing `identity:check_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:31.409368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:31.431567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2603/5212] 10.222.0.13 () {56 vars in 1264 bytes} [Sun Oct 30 01:38:31 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:31.436607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.462341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944cb1f-690f-4ea2-b9e7-541a5f9ff1e8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.475829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.478842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.487148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.487148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.504567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:31.506560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:31.516980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2610/5213] 10.222.0.13 () {56 vars in 1263 bytes} [Sun Oct 30 01:38:31 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 01:38:31.521111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.526094 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:31.538472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510fb3-153c-46bd-a8f7-dc5ec0ad9c55 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.544571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.545326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.546003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.546514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.569091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.571455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.584090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:31.593730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:31.754638 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2604/5214] 10.222.0.13 () {56 vars in 1266 bytes} [Sun Oct 30 01:38:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:31.759535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.776707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec59f-d1ab-4ad9-a4db-7ab4f42259f6 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.795123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.796179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.796633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.797085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.801994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.827390 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-7a8ac4a8-41ad-4e74-896c-fb2425fb920d tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 30 01:38:31.840749 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 30 01:38:31.842116 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:31.843268 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:31.846612 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2605/5215] 10.222.0.13 () {56 vars in 1264 bytes} [Sun Oct 30 01:38:31 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 30 01:38:31.851842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.852417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.852904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.888589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] MFA Rules not processed for user `9678a27c70a1453d9b379f7e46bde22d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:31.890163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:31.899768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8b5e9-1225-4e0a-a708-546d992c5ae9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.902638 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2606/5216] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 01:38:31.906163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.922432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.923314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.923600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.923871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] PATH_INFO: `/v3/projects/c459ca098c214c1b94274bdcbfa5fb5d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.925754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c459ca098c214c1b94274bdcbfa5fb5d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:31.926293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03261f-4f0b-4d91-bd52-56643fb0d211 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:31.928110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:31.943654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:31.944337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:31.944741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:31.945119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:31.956240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:31.958275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:31.978470 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2607/5217] 10.222.0.13 () {56 vars in 1263 bytes} [Sun Oct 30 01:38:31 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 30 01:38:31.979644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:31.995990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75293f07-48f2-4b5e-98ff-a51c22c9a4f9 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:32.006005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:32.006791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.007180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.007561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.024409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:32.026277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:32.107609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c459ca098c214c1b94274bdcbfa5fb5d', 'request_id': 'req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:32.171870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2608/5218] 10.222.0.13 () {56 vars in 1266 bytes} [Sun Oct 30 01:38:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:32.175835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:32.198901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cbc0c-f60b-47a2-bc6c-ef5c85cf1e51 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:32.261963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c459ca098c214c1b94274bdcbfa5fb5d', 'request_id': 'req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:32.272288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c459ca098c214c1b94274bdcbfa5fb5d', 'request_id': 'req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:32.311963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] The token cache is being invalidate because project c459ca098c214c1b94274bdcbfa5fb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:32.312288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:32.314314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f1ffb3e6-181c-4e26-99f4-aacef50c58f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:32.317522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2611/5219] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:31 2022] DELETE /identity/v3/projects/c459ca098c214c1b94274bdcbfa5fb5d => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:32.323991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bafb41-394e-400b-9190-0c2dbb9acfda None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.324286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bafb41-394e-400b-9190-0c2dbb9acfda None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.324568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bafb41-394e-400b-9190-0c2dbb9acfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.399995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-01bafb41-394e-400b-9190-0c2dbb9acfda None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:32.401194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-01bafb41-394e-400b-9190-0c2dbb9acfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:32.408971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9678a27c70a1453d9b379f7e46bde22d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f22b89925f6f45a08f16061504ff5c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:32.409630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.410876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.411205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.422623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 30 01:38:32.454272 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 30 01:38:32.455818 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:32.457071 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:32.462965 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2609/5220] 10.222.0.13 () {56 vars in 1263 bytes} [Sun Oct 30 01:38:32 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 30 01:38:32.464089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:32.475280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:32.604873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b02f1-6427-42ab-9395-41472b65f620 tempest-TokensV3Test-1339002268 tempest-TokensV3Test-1339002268-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:32.615937 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2612/5221] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:32.623435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:32.624980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.625279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.625580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.626402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.631839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.632532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] PATH_INFO: `/v3/users/9678a27c70a1453d9b379f7e46bde22d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.638806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9678a27c70a1453d9b379f7e46bde22d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:32.645681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:32.702509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:32.703784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:32.725884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2613/5222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:32.726813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:32.734540 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:32.753290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4e20a-04b1-4bad-a850-c3640da283c0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:32.771725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:32.772759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.772900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.773202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.774495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:38:32.774879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:32.776583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:32.807015 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2614/5223] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:32.808059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:32.841820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f827056-411a-4ba6-b70f-f7a3b06d1170 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:32.872225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:32.873190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:32.873764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:32.877155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:32.878216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:32.880895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:32.934498 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:32.999767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9678a27c70a1453d9b379f7e46bde22d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:33.002218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9678a27c70a1453d9b379f7e46bde22d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:33.021226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9678a27c70a1453d9b379f7e46bde22d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:33.023043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9678a27c70a1453d9b379f7e46bde22d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:33.053770 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2615/5224] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:33.058615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:33.061317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:33.158439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-215cc30c-2882-4c9e-acb3-457235099686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9678a27c70a1453d9b379f7e46bde22d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:33.200290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2610/5225] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:38:32 2022] DELETE /identity/v3/users/9678a27c70a1453d9b379f7e46bde22d => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:33.204588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.204900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.205171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.234163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:33.235844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:33.243476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9e7c-1db5-40a4-a58e-bbdf28f22c40 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:33.375343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:33.376226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.377096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.378253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.380315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:33.382446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:33.394401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2611/5226] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:33.415304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:33.415304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:33.540617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2616/5227] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:33 2022] POST /identity/v3/users => generated 292 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:33.544836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:33.569892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d294d-c60c-49ce-9840-9bde7ce01e3e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:33.579569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e03577-54e5-4bee-920d-85d9696f8aed None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:33.601250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:33.601250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.601250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.601250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.603119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:33.605506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:33.606486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:33.607418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.609112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.609490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.630818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:33.632367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:33.632730 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2617/5228] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:38:33.634489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:33.655812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6efbea-dc11-49d0-8e88-48dda1b60547 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:33.658941 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2612/5229] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:38:33.663703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:33.664508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.664877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.665229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.665976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:33.667912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaba2fb-76b0-4fcd-9cc7-6bca95178d06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:33.693697 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2618/5230] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:33.699353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:33.717729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1329e-e04c-4616-8c64-3f1238b7e8f2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:33.725620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:33.726250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.726529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.726830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] PATH_INFO: `/v3/projects/83338405679447d48531c28168ff406d/users/76ec92d85cda47dc842805d7f8f3e22f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:33.764979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83338405679447d48531c28168ff406d, user_id=76ec92d85cda47dc842805d7f8f3e22f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:33.768885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:33.921807 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2613/5231] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:33 2022] PUT /identity/v3/projects/83338405679447d48531c28168ff406d/users/76ec92d85cda47dc842805d7f8f3e22f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:33.946501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:33.946816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:33.947048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:34.026209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] MFA Rules not processed for user `76ec92d85cda47dc842805d7f8f3e22f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:34.027640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:34.107664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:34.110160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:34.147265 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:34.204317 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:34.253272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2619/5232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:34.255245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edfce4-fb35-4834-8b6f-86bfa1742e0f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:34.260577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:34.261218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:34.261557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:34.261962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:34.264450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:34.321846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:34.431882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:34.434225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:34.459049 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2614/5233] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:38:34.487496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a025c-3d90-4faa-9afb-1dfb728b1697 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:34.493748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:34.494829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:34.495101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:34.495374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:34.515942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:34.517762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f95e7-6cd2-4ad7-baed-3e5e20539447 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:34.539391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2620/5234] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:34.930974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:34.932490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:35.136923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3d848-e4e7-4551-878f-4584f19f65ef service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:35.148205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:35.149538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.150058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.150624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] PATH_INFO: `/v3/projects/f22b89925f6f45a08f16061504ff5c8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.151876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22b89925f6f45a08f16061504ff5c8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:35.154158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:35.323781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22b89925f6f45a08f16061504ff5c8e', 'request_id': 'req-94e5e8a8-eeff-46d5-808d-3a9578254b90'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:35.331172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22b89925f6f45a08f16061504ff5c8e', 'request_id': 'req-94e5e8a8-eeff-46d5-808d-3a9578254b90'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:35.507641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22b89925f6f45a08f16061504ff5c8e', 'request_id': 'req-94e5e8a8-eeff-46d5-808d-3a9578254b90'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:35.526461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] The token cache is being invalidate because project f22b89925f6f45a08f16061504ff5c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:38:35.526887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:35.527747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94e5e8a8-eeff-46d5-808d-3a9578254b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:35.534259 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2615/5235] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:38:34 2022] DELETE /identity/v3/projects/f22b89925f6f45a08f16061504ff5c8e => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:35.535423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.535944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.536050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.566981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:35.568197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:35.695745 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2621/5236] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:35.695863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.695863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.695863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.726758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:35.737396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:35.761452 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2616/5237] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:35.762798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:35.781168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:35.782675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:35.791270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163e899-eb41-4d2d-b18c-0c77f13b4211 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:35.814351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:35.814957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.815238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.815518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.816365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:38:35.816674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:35.818631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:35.837592 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:35.860898 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2622/5238] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:38:35.864860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:35.896153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50582a-c419-4bc4-b0d1-42e28c350564 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:35.909054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:35.909701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.910065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.910343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.910983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:35.913140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:35.927140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c71d8-2cfb-446e-8c41-be83675beb59 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:35.932492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:35.933551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:35.934139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:35.934616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:35.937761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:36.035346 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2623/5239] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:38:35 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:36.041558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:36.076251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:36.078887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:36.111375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2617/5240] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:38:36.135443 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:36.168326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e344dd-e028-48e3-8f65-d2846423b727 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:36.175365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:36.176068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:36.180053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:36.180053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:36.180053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:36.180053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:36.301030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:36.313173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2624/5241] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:38:36 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:38:36.315836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cff25-234e-45ff-9ebd-d39aaba5844e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:36.330124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:36.330773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:36.331055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:36.331332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:36.332001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:36.333701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:36.372402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2618/5242] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:38:36.377024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:36.403611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda390e-2288-4124-bc9c-18b5087f8d42 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:36.420851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:36.421620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:36.421972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:36.422342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:36.423188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:36.424992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80aa4e-e759-4e9c-88ce-f2d74e2e6e57 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:36.456245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2625/5243] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:38:36.456791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:36.476667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b5b9-8ef2-4c14-8e88-7b87b7564f21 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:36.482260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:36.483189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:36.483876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:36.484215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] PATH_INFO: `/v3/projects/bf43a1610ccc4ecea063f561d93f5cb3/users/a20c50ed3cdb4a3884295aa13384d36d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:36.510263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf43a1610ccc4ecea063f561d93f5cb3, user_id=a20c50ed3cdb4a3884295aa13384d36d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:36.513980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:36.806818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2619/5244] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:38:36 2022] PUT /identity/v3/projects/bf43a1610ccc4ecea063f561d93f5cb3/users/a20c50ed3cdb4a3884295aa13384d36d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:36.829651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4002d1-9af7-46a6-a3bf-f4a4ef4d0648 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:36.829651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4002d1-9af7-46a6-a3bf-f4a4ef4d0648 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:36.829651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4002d1-9af7-46a6-a3bf-f4a4ef4d0648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:36.878845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cc4002d1-9af7-46a6-a3bf-f4a4ef4d0648 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:36.880628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cc4002d1-9af7-46a6-a3bf-f4a4ef4d0648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:37.030473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2626/5245] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:37.036765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:37.051736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935e62d-da4a-4fa8-8419-a1f249fb1800 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:37.057442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c014571-0c16-467b-aaec-796cfa59e5d2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:37.058663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c014571-0c16-467b-aaec-796cfa59e5d2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:37.059135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c014571-0c16-467b-aaec-796cfa59e5d2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:37.059576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c014571-0c16-467b-aaec-796cfa59e5d2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:37.195511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c014571-0c16-467b-aaec-796cfa59e5d2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:37.370956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2620/5246] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:37 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:38.376369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:38.378382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:38.379061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:38.476371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:38.483025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:38.502301 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2627/5247] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:38.504203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:38.504738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:38.504738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:38.560700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:38.562948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:38.593160 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2621/5248] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:38.597165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:38.612134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30909d36-e871-49d2-8dd6-66957227c46b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:38.617227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:38.618263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:38.618743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:38.619225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:38.714341 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 30 01:38:38.715607 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:38:38.720795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:38.721326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2628/5249] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:38 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 188 bytes in 122 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:38:38.742859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288371c-5a7d-40b1-8e73-f90a16ee7eb5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:38.772099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fc97d-29aa-4b28-a1f5-dd7c1e959844 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:38.772905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc97d-29aa-4b28-a1f5-dd7c1e959844 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:38.773298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc97d-29aa-4b28-a1f5-dd7c1e959844 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:38.773759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fc97d-29aa-4b28-a1f5-dd7c1e959844 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-8d7fc97d-29aa-4b28-a1f5-dd7c1e959844 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:38.865581 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 30 01:38:38.867175 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:38.873441 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2622/5250] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:38 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 188 bytes in 154 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:38:38.877468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:38.893400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af627ed4-c39d-41fe-8e67-c28cff905359 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:38.909835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d703-bc2d-40a5-a71c-a687af5a297c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:38.910947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d703-bc2d-40a5-a71c-a687af5a297c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:38.912213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d703-bc2d-40a5-a71c-a687af5a297c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:38.912674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d703-bc2d-40a5-a71c-a687af5a297c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:39.130591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7266d703-bc2d-40a5-a71c-a687af5a297c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:39.239553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2629/5251] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:38 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:40.245888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:40.246725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:40.246725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:40.293500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:40.295625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:40.301742 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2623/5252] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:40 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:40.306977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810abb-3632-47bd-a1f3-90d172e284d2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:40.316790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810abb-3632-47bd-a1f3-90d172e284d2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:40.316790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810abb-3632-47bd-a1f3-90d172e284d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:40.361251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2810abb-3632-47bd-a1f3-90d172e284d2 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:40.370808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2810abb-3632-47bd-a1f3-90d172e284d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:40.391674 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2630/5253] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:40.391809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:40.406297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229d540-1085-48f7-b4a9-16c777e6397e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:40.418358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38fcb5-5521-44d1-ba6a-ae000b168dc2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:40.420071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fcb5-5521-44d1-ba6a-ae000b168dc2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:40.421903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fcb5-5521-44d1-ba6a-ae000b168dc2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:40.422852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38fcb5-5521-44d1-ba6a-ae000b168dc2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:40.435720 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:40.604347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be38fcb5-5521-44d1-ba6a-ae000b168dc2 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:40.775156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2624/5254] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:40 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:38:41.780769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:41.783823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:41.790481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:41.846614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:41.850424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:41.867006 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2631/5255] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 01:38:41.869295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903bd1b-2bec-4cdf-9d30-6cbbefe365db None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:41.869874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903bd1b-2bec-4cdf-9d30-6cbbefe365db None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:41.869874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903bd1b-2bec-4cdf-9d30-6cbbefe365db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:41.935391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d903bd1b-2bec-4cdf-9d30-6cbbefe365db None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:41.938693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d903bd1b-2bec-4cdf-9d30-6cbbefe365db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:41.953539 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2625/5256] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:41.957943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:41.983395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592c821-c5c1-4d42-9bf8-633281c6fa40 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:41.989733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd50bd9-7178-429c-bd70-5cf4fd139c17 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:41.990764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50bd9-7178-429c-bd70-5cf4fd139c17 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:41.992288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50bd9-7178-429c-bd70-5cf4fd139c17 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:41.992288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd50bd9-7178-429c-bd70-5cf4fd139c17 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:42.204665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-acd50bd9-7178-429c-bd70-5cf4fd139c17 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:42.226774 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:42.355096 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2632/5257] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:41 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:43.359361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:43.359858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:43.360001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:43.439233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:43.445907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:43.471600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2626/5258] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:43 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:43.478025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20791a-46ac-49b7-988d-9ebe9a522caa None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:43.478561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20791a-46ac-49b7-988d-9ebe9a522caa None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:43.478672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20791a-46ac-49b7-988d-9ebe9a522caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:43.546077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-db20791a-46ac-49b7-988d-9ebe9a522caa None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:43.547598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db20791a-46ac-49b7-988d-9ebe9a522caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:43.567526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2633/5259] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:43.570789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:43.589048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf3afb-7c31-4632-ad9f-5825046dfca5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:43.613170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb097b-e611-46e6-a8ee-cb727f460bb7 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:43.617558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb097b-e611-46e6-a8ee-cb727f460bb7 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:43.617915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb097b-e611-46e6-a8ee-cb727f460bb7 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:43.618195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb097b-e611-46e6-a8ee-cb727f460bb7 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:43.901401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6adb097b-e611-46e6-a8ee-cb727f460bb7 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:44.032133 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2627/5260] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:43 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:45.036305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407a3f-3ee8-49a8-a24b-8c52a1194aef None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:45.036900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407a3f-3ee8-49a8-a24b-8c52a1194aef None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:45.037492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407a3f-3ee8-49a8-a24b-8c52a1194aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:45.067275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a5407a3f-3ee8-49a8-a24b-8c52a1194aef None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:45.075384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a5407a3f-3ee8-49a8-a24b-8c52a1194aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:45.082466 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2634/5261] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:45 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:46.088490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6b97-ae48-4474-b6cb-c655f6afe567 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:46.089033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6b97-ae48-4474-b6cb-c655f6afe567 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:46.089033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6b97-ae48-4474-b6cb-c655f6afe567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:46.142754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-192d6b97-ae48-4474-b6cb-c655f6afe567 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:46.146304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-192d6b97-ae48-4474-b6cb-c655f6afe567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:46.172797 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2628/5262] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:46.183064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7e33-29f8-4288-b0b6-f03ed4400223 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:46.183607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7e33-29f8-4288-b0b6-f03ed4400223 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:46.183702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b7e33-29f8-4288-b0b6-f03ed4400223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:46.232082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-878b7e33-29f8-4288-b0b6-f03ed4400223 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:46.234585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-878b7e33-29f8-4288-b0b6-f03ed4400223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:46.244536 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2635/5263] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:46.250469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3fc5-8ae1-4859-90f7-9833cb401bd4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:46.251069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3fc5-8ae1-4859-90f7-9833cb401bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:46.251377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3fc5-8ae1-4859-90f7-9833cb401bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:46.409848 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.application [None req-09ab3fc5-8ae1-4859-90f7-9833cb401bd4 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:38:46.414830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2629/5264] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 167 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 30 01:38:46.417035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:46.419138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:46.421978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:46.589849 n-d-master-1 devstack@keystone.service[82035]: WARNING keystone.server.flask.application [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:38:46.591254 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2636/5265] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 175 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 30 01:38:46.595679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:46.596315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:46.597400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:46.723966 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.application [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:38:46.728434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2630/5266] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 134 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Oct 30 01:38:50.964234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:51.053199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e586a7-658a-4f35-a3a8-8d017b65cc07 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:51.057347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:51.061891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:51.061891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:51.061891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:51.063621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:51.189474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:51.191205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afce14-785a-4808-838b-2608b1d23432 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:51.209482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2637/5267] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:52.146082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:52.162294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393906-3817-41ff-aef5-25cdea5ac515 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:52.166802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:52.167894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:52.168175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:52.168441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:52.171106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:52.185174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:52.205823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:52.238838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2631/5268] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:55.703950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c738c4-978f-4ba5-a2a5-cd2e28ec503e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:55.705061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:55.706101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c738c4-978f-4ba5-a2a5-cd2e28ec503e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:55.706406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c738c4-978f-4ba5-a2a5-cd2e28ec503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:55.707086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:55.757230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-96c738c4-978f-4ba5-a2a5-cd2e28ec503e None None] MFA Rules not processed for user `352cb9c0a2644e0e8743f3cc4477f88f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:55.760855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96c738c4-978f-4ba5-a2a5-cd2e28ec503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:55.821318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138420-dd3b-42d4-9911-d42028fae57c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:55.827007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:55.827702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:55.828046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:55.828664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:55.834748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:55.859540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:55.861015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:55.897300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2632/5269] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:55.969317 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2638/5270] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:56.244422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:56.246409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:56.272271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1590e3-bc14-4242-bf47-4748c9538c9e service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:56.281980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:56.284256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:56.284844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:56.285303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:56.289768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:56.307889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:38:56.310739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:38:56.328335 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2633/5271] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:38:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:38:57.744750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1ac0-ae1a-4031-90c0-c5f39dab4866 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:57.745381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1ac0-ae1a-4031-90c0-c5f39dab4866 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:57.745851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd1ac0-ae1a-4031-90c0-c5f39dab4866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:57.760564 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:57.895950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ddcd1ac0-ae1a-4031-90c0-c5f39dab4866 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:57.902011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ddcd1ac0-ae1a-4031-90c0-c5f39dab4866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:57.912199 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2639/5272] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:57.918555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:57.940733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42575f0-b456-405e-afa9-cb87be4a397d service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:57.954685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764bbb6-9658-49fd-863a-d5434bb0dc30 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:57.955708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764bbb6-9658-49fd-863a-d5434bb0dc30 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:57.956290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764bbb6-9658-49fd-863a-d5434bb0dc30 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:57.957116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764bbb6-9658-49fd-863a-d5434bb0dc30 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:58.026398 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:UPDATE=4,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:38:58.192024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d764bbb6-9658-49fd-863a-d5434bb0dc30 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:38:58.355184 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2634/5273] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:57 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:38:59.360313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-8690-42ee-bbd5-18c1b99f1593 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:59.360888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-8690-42ee-bbd5-18c1b99f1593 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:59.360991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83603-8690-42ee-bbd5-18c1b99f1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:59.417492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4bd83603-8690-42ee-bbd5-18c1b99f1593 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:59.419085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4bd83603-8690-42ee-bbd5-18c1b99f1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:59.422930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2640/5274] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:38:59.428099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa865-2f76-4237-b8ee-1df87bd00622 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:59.431173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa865-2f76-4237-b8ee-1df87bd00622 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:59.431675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afa865-2f76-4237-b8ee-1df87bd00622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-47afa865-2f76-4237-b8ee-1df87bd00622 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 30 01:38:59.485997 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:59.487698 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 30 01:38:59.488964 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:38:59.495580 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2635/5275] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:59 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 01:38:59.500006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:59.500542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:59.501218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:59.683974 n-d-master-1 devstack@keystone.service[82035]: WARNING keystone.server.flask.application [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:38:59.688558 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2641/5276] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 187 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 30 01:38:59.690265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2359fb-bdfe-47f3-acd1-b91d65ce1a76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:59.690558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2359fb-bdfe-47f3-acd1-b91d65ce1a76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:59.690839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2359fb-bdfe-47f3-acd1-b91d65ce1a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:38:59.918791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6c2359fb-bdfe-47f3-acd1-b91d65ce1a76 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:38:59.920294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6c2359fb-bdfe-47f3-acd1-b91d65ce1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:38:59.932680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2636/5277] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:38:59.936619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:38:59.957745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b7c41-aa23-4ba3-96d4-6b5f35d563a5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:38:59.969719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9da06-c1b6-4b68-9c3b-956fd3cdbaa9 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:38:59.969719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9da06-c1b6-4b68-9c3b-956fd3cdbaa9 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:38:59.969719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9da06-c1b6-4b68-9c3b-956fd3cdbaa9 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:38:59.970299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9da06-c1b6-4b68-9c3b-956fd3cdbaa9 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:00.204923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0ea9da06-c1b6-4b68-9c3b-956fd3cdbaa9 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:00.404321 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2642/5278] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:38:59 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:01.408387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:01.408980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:01.408980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:01.472730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:01.475421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:01.485485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a64f-aa85-4a16-9316-19e226fcee01 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:01.486431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a64f-aa85-4a16-9316-19e226fcee01 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:01.486873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87a64f-aa85-4a16-9316-19e226fcee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:01.495086 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2637/5279] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:39:01.524705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c87a64f-aa85-4a16-9316-19e226fcee01 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:01.526170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c87a64f-aa85-4a16-9316-19e226fcee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:01.548807 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2643/5280] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:01.553224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:01.566103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1f14-e2e8-42ac-91d3-6c05e33cec25 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:01.571633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b8edb-957e-45a8-966a-d2db6a3c534c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:01.572322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8edb-957e-45a8-966a-d2db6a3c534c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:01.572605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8edb-957e-45a8-966a-d2db6a3c534c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:01.572880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b8edb-957e-45a8-966a-d2db6a3c534c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:01.874082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1d4b8edb-957e-45a8-966a-d2db6a3c534c tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:02.108516 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2638/5281] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:39:01 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:03.114240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:03.115895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:03.116332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:03.154573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:03.156231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:03.170834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2644/5282] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:39:03.175480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbe94-c546-450f-bd6c-f087d2d1f0d6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:03.176037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbe94-c546-450f-bd6c-f087d2d1f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:03.176632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbe94-c546-450f-bd6c-f087d2d1f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:03.220643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-63cbbe94-c546-450f-bd6c-f087d2d1f0d6 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:03.221931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-63cbbe94-c546-450f-bd6c-f087d2d1f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:03.244160 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2639/5283] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:03.248470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:03.278539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba14ee-1ad2-491d-b87e-56dfb5576038 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:03.292402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8fa4-1154-4b13-a7da-0a7abb7e0e84 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20c50ed3cdb4a3884295aa13384d36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf43a1610ccc4ecea063f561d93f5cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:03.293465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8fa4-1154-4b13-a7da-0a7abb7e0e84 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:03.294749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8fa4-1154-4b13-a7da-0a7abb7e0e84 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:03.295213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8fa4-1154-4b13-a7da-0a7abb7e0e84 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:03.478652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61ad8fa4-1154-4b13-a7da-0a7abb7e0e84 tempest-IdentityV3UsersTest-1002206073 tempest-IdentityV3UsersTest-1002206073-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:03.590089 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2645/5284] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:39:03 2022] POST /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d/password => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:04.595915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:04.596642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:04.596642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:04.645612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:04.647032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:04.657519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2640/5285] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:39:05.662243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602af3-4ee3-4a36-9585-47d992f8494f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:05.662823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602af3-4ee3-4a36-9585-47d992f8494f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:05.662823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86602af3-4ee3-4a36-9585-47d992f8494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:05.721755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-86602af3-4ee3-4a36-9585-47d992f8494f None None] MFA Rules not processed for user `a20c50ed3cdb4a3884295aa13384d36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:05.722822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86602af3-4ee3-4a36-9585-47d992f8494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:05.731664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2646/5286] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:05.737307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:05.926975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9605-29be-4e91-8a01-47b18175e811 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:05.953775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:05.953775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:05.953775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:05.954844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] PATH_INFO: `/v3/users/a20c50ed3cdb4a3884295aa13384d36d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:05.961888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20c50ed3cdb4a3884295aa13384d36d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:05.964756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:06.362461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:06.363253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:06.380674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:06.381452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:06.499148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20c50ed3cdb4a3884295aa13384d36d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:06.513658 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=13,keystone:SELECT=81,keystone:INSERT=4,keystone:UPDATE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:06.529214 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2641/5287] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:05 2022] DELETE /identity/v3/users/a20c50ed3cdb4a3884295aa13384d36d => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:06.534303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:06.535030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:06.535314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:06.580177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:06.581468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:06.725751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2647/5288] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:06.765757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:06.767306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:06.927415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4154d-949c-4c4b-9cc9-c7ac75b8e248 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:06.937181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:06.937913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:06.939931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:06.939931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:06.962303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:06.964163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020ee85-7485-4bdb-8dad-ff4a9df059dc service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:06.992407 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2642/5289] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:08.438603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:08.440025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:08.465659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f13be-d3da-46eb-9b95-f67a929ceb08 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:08.477741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:08.479524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:08.479913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:08.480286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] PATH_INFO: `/v3/projects/bf43a1610ccc4ecea063f561d93f5cb3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:08.483032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf43a1610ccc4ecea063f561d93f5cb3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:08.488898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:08.584501 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:08.804665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf43a1610ccc4ecea063f561d93f5cb3', 'request_id': 'req-6f937a55-7170-42b1-8a0a-b98e49ec5439'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:09.003314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf43a1610ccc4ecea063f561d93f5cb3', 'request_id': 'req-6f937a55-7170-42b1-8a0a-b98e49ec5439'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:09.008301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf43a1610ccc4ecea063f561d93f5cb3', 'request_id': 'req-6f937a55-7170-42b1-8a0a-b98e49ec5439'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:09.028875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] The token cache is being invalidate because project bf43a1610ccc4ecea063f561d93f5cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:09.029575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:09.031166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6f937a55-7170-42b1-8a0a-b98e49ec5439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:09.041743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.042247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.042356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.047829 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2648/5290] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:08 2022] DELETE /identity/v3/projects/bf43a1610ccc4ecea063f561d93f5cb3 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:09.097708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:09.099617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:09.198915 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2643/5291] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:39:09.210900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.210900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.210900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.231691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:09.233091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:09.255313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.263479 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2649/5292] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:09.274865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0140f-7af0-4f6a-af7a-a6e1d42a129b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.287125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.287854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.288020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.288402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.289056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:09.289383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:09.294053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:09.328720 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2644/5293] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:09.331160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.349828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596bc5f-7310-4e13-93f9-92dff0f94fe8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.356589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.357987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.358288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.358655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.359191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:09.372653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:09.505606 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2650/5294] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:09 2022] POST /identity/v3/projects => generated 411 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:09.511112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.526451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a8df-bf73-4e63-be0d-93109285a816 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.633931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.634807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.635273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.635647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.636411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:09.639243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:09.829809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2645/5295] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:09 2022] POST /identity/v3/users => generated 306 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:39:09.834153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.872130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787048-8258-450d-b2bc-946fa115faa2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.877554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.878478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.878991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.879482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.880576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:09.882668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:09.902486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2651/5296] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:09.905506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.922518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baa534-966e-44c4-91d7-3db75718c75c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.927550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.929529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.929932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.930286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:09.931147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:09.933589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4be7b4-474f-42fd-84f0-4cbd39937c28 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:09.940821 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:09.948225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2646/5297] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:39:09.959101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:09.973405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18ba7-a58f-44d9-9dd8-ba7acf013628 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:09.980335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:09.982647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:09.982934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:09.983206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] PATH_INFO: `/v3/projects/9abce57e7d8c44fd9bd02ca59efd4d9f/users/a63b90f56ab14533b6a6b77e51613487/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:10.006009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9abce57e7d8c44fd9bd02ca59efd4d9f, user_id=a63b90f56ab14533b6a6b77e51613487, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:10.009516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:10.159902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2652/5298] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:09 2022] PUT /identity/v3/projects/9abce57e7d8c44fd9bd02ca59efd4d9f/users/a63b90f56ab14533b6a6b77e51613487/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:10.171819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:10.172395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:10.172395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:10.218694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] MFA Rules not processed for user `a63b90f56ab14533b6a6b77e51613487`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:10.219932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:10.324720 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2647/5299] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:10 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:10.328791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:10.424859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5442b-d07b-4ff3-9b5a-f9c5cfe2b359 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:10.431061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:10.432004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:10.432493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:10.433040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:10.435934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:10.439423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:10.657388 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2653/5300] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:10 2022] POST /identity/v3/projects => generated 411 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:10.663430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:10.680427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0b66c-2860-4bdc-9624-cf4caf54fb40 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:10.810926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:10.813155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:10.813556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:10.813835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:10.814501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:10.823594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.003260 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2648/5301] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:10 2022] POST /identity/v3/users => generated 312 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:39:11.007935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:11.021912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e9f78-a6de-4a01-aa42-32344a76b856 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:11.027669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:11.028540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.029036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.029510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.030507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:11.033460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.057557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2654/5302] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:39:11.059692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:11.078495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a9341-cbd6-4cfc-ba54-2bf2a523713c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:11.093983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:11.094475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.094799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.095027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] PATH_INFO: `/v3/projects/24e1a4157f4949989263038faded96ab/users/40e0caac6a61437e818be90254150727/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.138584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e1a4157f4949989263038faded96ab, user_id=40e0caac6a61437e818be90254150727, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:11.142072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.268999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2649/5303] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:11 2022] PUT /identity/v3/projects/24e1a4157f4949989263038faded96ab/users/40e0caac6a61437e818be90254150727/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:11.275324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:11.287670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015c4e-5db7-4d76-9d53-ced38f1c3907 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:11.394193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:11.394833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.395112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.395381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.396043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:11.405833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc605c84-5830-40d6-9d4c-0a223147d2aa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.425627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2655/5304] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:11.427977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:11.443892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7eba-48e7-44bb-8129-971e688f93b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:11.451674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:11.452458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.452841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.454055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] PATH_INFO: `/v3/projects/24e1a4157f4949989263038faded96ab/users/40e0caac6a61437e818be90254150727/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.457387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e1a4157f4949989263038faded96ab, user_id=40e0caac6a61437e818be90254150727, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:11.462013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.507521 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2650/5305] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:11 2022] PUT /identity/v3/projects/24e1a4157f4949989263038faded96ab/users/40e0caac6a61437e818be90254150727/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:11.518290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.518647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.518982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.567370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] MFA Rules not processed for user `40e0caac6a61437e818be90254150727`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:11.569976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:11.685611 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2656/5306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:11 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:11.694298 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:11.716081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:11.718294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:11.825250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8f2d4-d82e-4e62-9580-749662626808 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:11.830014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:11.830747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:11.830943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:11.831223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:11.894009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:11.897001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbb0e-a198-40df-9d3f-cabb51c02273 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:11.924998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2651/5307] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:11 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:12.275555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:12.280904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:12.463349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185b2d4-c46b-40e7-99aa-530c44923177 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:12.472097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:12.472097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:12.478488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:12.478488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:12.478488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:12.492479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:12.494521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:12.538297 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2657/5308] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:12.700224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290755f-8eed-4632-862e-77679526459c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:12.700224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290755f-8eed-4632-862e-77679526459c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:12.700224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290755f-8eed-4632-862e-77679526459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:12.700224 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:12.782535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4290755f-8eed-4632-862e-77679526459c None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:12.785943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4290755f-8eed-4632-862e-77679526459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:12.892033 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2652/5309] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:39:12.904726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:12.915988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:13.016533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c861e7d-09d6-433b-a628-b416321e8f76 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:13.023603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:13.024932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:13.027138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:13.027341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:13.054838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:13.059461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f19631-7a75-4822-8faa-5c2037844b89 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:13.072566 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2658/5310] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:14.920421 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:19.004334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290755f-8eed-4632-862e-77679526459c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:19.005932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4290755f-8eed-4632-862e-77679526459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:19.282684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290755f-8eed-4632-862e-77679526459c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:19.288594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:19.289607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:19.290111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:19.290776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] PATH_INFO: `/v3/users/76ec92d85cda47dc842805d7f8f3e22f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:19.296861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ec92d85cda47dc842805d7f8f3e22f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:19.299552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:19.683252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ec92d85cda47dc842805d7f8f3e22f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:19.684355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ec92d85cda47dc842805d7f8f3e22f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:19.697720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ec92d85cda47dc842805d7f8f3e22f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:19.701260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ec92d85cda47dc842805d7f8f3e22f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:19.883999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ec92d85cda47dc842805d7f8f3e22f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:19.933285 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2653/5311] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:19 2022] DELETE /identity/v3/users/76ec92d85cda47dc842805d7f8f3e22f => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:19.941527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:19.942474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:19.942916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:20.022730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:20.024493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:20.040373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:20.044125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:20.088342 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:20.287617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8a854-3906-438f-bae1-67ab347d42ef admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:20.311394 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2659/5312] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:20.318100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:20.319113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:20.320076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:20.321596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:20.325067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:20.328012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] PATH_INFO: `/v3/users/a63b90f56ab14533b6a6b77e51613487` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:20.331993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63b90f56ab14533b6a6b77e51613487)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:20.336464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:20.607013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8f83d-e925-4893-a545-8a3e2a3563f7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:20.631918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:20.634574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:20.635026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:20.635459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:20.672304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:20.674402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d9183-5fdd-419b-9f10-438e9339b066 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:20.714932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2660/5313] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:39:20.933034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63b90f56ab14533b6a6b77e51613487'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:20.935782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63b90f56ab14533b6a6b77e51613487'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:20.979786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63b90f56ab14533b6a6b77e51613487'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:20.986571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63b90f56ab14533b6a6b77e51613487'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:21.118613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63b90f56ab14533b6a6b77e51613487'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:21.164857 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2654/5314] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:20 2022] DELETE /identity/v3/users/a63b90f56ab14533b6a6b77e51613487 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:39:21.172071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:21.172657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:21.173506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:21.230593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:21.235334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:21.443565 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2661/5315] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:21.469242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:21.471072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:21.665447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecd62f-aca4-4431-9262-aa3123f40b34 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:21.683780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:21.685815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:21.691685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:21.692073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:21.721540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:21.723948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee84d7-c080-4353-a8df-3246072780d7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:21.753697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2655/5316] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:22.052937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:22.054887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:22.080246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b29e3-8524-46ed-87fa-454b59d0f83f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:22.095684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:22.097956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:22.106577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:22.106577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] PATH_INFO: `/v3/projects/83338405679447d48531c28168ff406d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:22.106577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83338405679447d48531c28168ff406d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:22.108293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:22.113950 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:22.354165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83338405679447d48531c28168ff406d', 'request_id': 'req-8f677aff-9225-4973-ab83-b95c75252773'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:22.420979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83338405679447d48531c28168ff406d', 'request_id': 'req-8f677aff-9225-4973-ab83-b95c75252773'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:22.432544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83338405679447d48531c28168ff406d', 'request_id': 'req-8f677aff-9225-4973-ab83-b95c75252773'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:22.454257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] The token cache is being invalidate because project 83338405679447d48531c28168ff406d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:22.454995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:22.456091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f677aff-9225-4973-ab83-b95c75252773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:22.457786 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2662/5317] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:22 2022] DELETE /identity/v3/projects/83338405679447d48531c28168ff406d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:22.463978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:22.464561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:22.464878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:22.538911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:22.550361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:22.656036 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:22.777162 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2656/5318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:22.888957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:22.889273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:22.889551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:22.963001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:22.966444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:23.005930 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2663/5319] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:23.007095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.025046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a771b-9095-4249-ba37-ec8b94be4e4a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.058876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.058876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.058876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.058876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.059454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:23.059578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:23.061080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:23.129002 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2657/5320] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:39:23.133588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.152548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6551ef-5e74-4282-b13a-32f7ccbfe6c9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.169497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.170134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.170418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.170694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.171330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:23.173236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:23.317452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2664/5321] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:23 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:23.321855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.333064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6803204-f592-4159-bc4f-8482365a5672 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.401183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.402529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.403024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.403566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.405127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:23.407676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:23.421026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.424708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:23.448935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8744672-ebb8-4cd8-8704-d211698ec4d4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.459254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.460239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.460733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.461461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] PATH_INFO: `/v3/projects/9abce57e7d8c44fd9bd02ca59efd4d9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.463215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9abce57e7d8c44fd9bd02ca59efd4d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:23.465364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:23.567600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2658/5322] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:23 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:23.568847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.633795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf7b75-a92f-436d-86b9-77150718620b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.683419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9abce57e7d8c44fd9bd02ca59efd4d9f', 'request_id': 'req-0e289951-816a-40fb-b0ce-db16fa28d974'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:23.769644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9abce57e7d8c44fd9bd02ca59efd4d9f', 'request_id': 'req-0e289951-816a-40fb-b0ce-db16fa28d974'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:23.777081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9abce57e7d8c44fd9bd02ca59efd4d9f', 'request_id': 'req-0e289951-816a-40fb-b0ce-db16fa28d974'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:23.821397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] The token cache is being invalidate because project 9abce57e7d8c44fd9bd02ca59efd4d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:23.821397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:23.822511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:23.829579 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2665/5323] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:23 2022] DELETE /identity/v3/projects/9abce57e7d8c44fd9bd02ca59efd4d9f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:39:23.839901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.845454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:23.890711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.894298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.894298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.894298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.894298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:23.895087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:23.913559 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2659/5324] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:23.914824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:23.916964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:23.970203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9589-a910-433b-8eb9-9065f4684926 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:23.988885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:23.989973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:23.993716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:23.994280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:23.995812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:24.001410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:24.010714 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:24.032280 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2660/5325] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:24.036559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:24.061852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec25dd-c9b2-4d26-9ebb-aaf9250eadc3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:24.073182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:24.075563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:24.075563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:24.075563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] PATH_INFO: `/v3/projects/44089dca50f04a74bfcbab21c998cd45/users/2aa73c81f9fd4780b4ff5b061a9f39cc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:24.078478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e289951-816a-40fb-b0ce-db16fa28d974 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:24.096138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:24.096952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:24.097552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:24.098486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] PATH_INFO: `/v3/users/40e0caac6a61437e818be90254150727` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:24.101747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e0caac6a61437e818be90254150727)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:24.104064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:24.119455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44089dca50f04a74bfcbab21c998cd45, user_id=2aa73c81f9fd4780b4ff5b061a9f39cc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:24.125295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f755c3c-bc24-4ea7-a91f-3e18a10cb0bd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:24.276875 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2661/5326] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:24 2022] PUT /identity/v3/projects/44089dca50f04a74bfcbab21c998cd45/users/2aa73c81f9fd4780b4ff5b061a9f39cc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:24.289202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:24.289202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:24.289202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:24.353563 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:24.377496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] MFA Rules not processed for user `2aa73c81f9fd4780b4ff5b061a9f39cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:24.379959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:24.455714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e0caac6a61437e818be90254150727'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:24.587554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e0caac6a61437e818be90254150727'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:24.588633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e0caac6a61437e818be90254150727'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:24.610592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e0caac6a61437e818be90254150727'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:24.614091 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2662/5327] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:24.632135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e0caac6a61437e818be90254150727'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:24.649102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2666/5328] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:23 2022] DELETE /identity/v3/users/40e0caac6a61437e818be90254150727 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:24.655738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:24.657582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:24.798913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8de5b-6a3e-4efd-988c-fc9c903aa7e7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:24.910921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:24.912256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:24.912540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:24.913540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:24.917160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:24.998427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:25.000219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a66d-ac2e-4e6f-a598-b9348572f1e8 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:25.012574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2663/5329] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:25.108157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:25.109611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:25.248421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7757f-0979-4b5a-9c06-0768ef4c1944 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:25.254895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:25.257238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:25.257238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:25.257238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] PATH_INFO: `/v3/projects/24e1a4157f4949989263038faded96ab` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:25.258902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e1a4157f4949989263038faded96ab)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:25.261268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:25.408577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e1a4157f4949989263038faded96ab', 'request_id': 'req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:25.512809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e1a4157f4949989263038faded96ab', 'request_id': 'req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:25.532049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e1a4157f4949989263038faded96ab', 'request_id': 'req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:25.561858 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:25.582791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] The token cache is being invalidate because project 24e1a4157f4949989263038faded96ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:25.583462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:25.585869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-35fa1b9b-1ab0-4bb6-88d1-d9f3b8429fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:25.596037 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2667/5330] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:25 2022] DELETE /identity/v3/projects/24e1a4157f4949989263038faded96ab => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:25.596199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:25.596199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:25.596199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:25.653663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:25.675763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:25.694863 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:25.789291 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2664/5331] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:25.797247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:25.797810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:25.798290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:25.827899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:25.829645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:25.840987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2668/5332] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:25.844825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:25.862869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b450bd-697e-4c7a-ad2b-d147676c00ee None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:25.868845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:25.869786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:25.870659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:25.871305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:25.872198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:25.872719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:25.874878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:25.908494 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2665/5333] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:25.912728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:25.925707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e7b57-53fb-4804-a0c0-9b58826a0196 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:25.930964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:25.931930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:25.932429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:25.932903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:25.933797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:25.936214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:26.567942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2669/5334] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:25 2022] POST /identity/v3/projects => generated 375 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:26.572442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:26.598413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8851-e815-408b-8e2f-e9bfce39e6f4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:26.789241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:26.790075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:26.790847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:26.792384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:26.794294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:26.797913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:26.943927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2666/5335] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:26 2022] POST /identity/v3/users => generated 288 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:26.947518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:26.977396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74f5-5aaf-4663-a9bb-ff1e3daefdce admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:26.979084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:26.983962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:27.008369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997805b-af91-426b-9409-23000510de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.008369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997805b-af91-426b-9409-23000510de06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.008369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997805b-af91-426b-9409-23000510de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.008369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997805b-af91-426b-9409-23000510de06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.008875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997805b-af91-426b-9409-23000510de06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:27.008875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997805b-af91-426b-9409-23000510de06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:27.010071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824947c-d44b-40a2-968f-d41b603de067 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:27.031280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.031280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.031280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.031280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] PATH_INFO: `/v3/users/b8970624bde14a879846362e124c9c80` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.034325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8970624bde14a879846362e124c9c80)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:27.036528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:27.063223 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2670/5336] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:27.070057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997805b-af91-426b-9409-23000510de06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:27.102824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997805b-af91-426b-9409-23000510de06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:27.124134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.130119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.130119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.130119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.130119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:27.137088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:27.173304 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2671/5337] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:27.174287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:27.202408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71a88f-a421-44f6-9732-d9a4d19f696c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:27.218010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.218684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.218964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.219237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] PATH_INFO: `/v3/projects/28335454d2074468954956adc93c086e/users/cf432101f4be4ce191dc5cc28ec3db8e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.276730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28335454d2074468954956adc93c086e, user_id=cf432101f4be4ce191dc5cc28ec3db8e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:27.290918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a437167-7579-452a-96ba-5e1db25ddf8e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:27.317647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8970624bde14a879846362e124c9c80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:27.318438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8970624bde14a879846362e124c9c80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:27.350694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8970624bde14a879846362e124c9c80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:27.352974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8970624bde14a879846362e124c9c80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:27.445402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2672/5338] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:27 2022] PUT /identity/v3/projects/28335454d2074468954956adc93c086e/users/cf432101f4be4ce191dc5cc28ec3db8e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:27.446965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.447335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.447602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.467361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2268c447-5883-4d0f-b60d-7efa56709331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8970624bde14a879846362e124c9c80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:27.510351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] MFA Rules not processed for user `cf432101f4be4ce191dc5cc28ec3db8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:27.512620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:27.524135 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:27.539303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2667/5339] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:26 2022] DELETE /identity/v3/users/b8970624bde14a879846362e124c9c80 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:27.544614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.544614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.545016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.584708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:27.586119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:27.694338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2673/5340] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:27.695636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:27.697589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:27.705431 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2668/5341] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:27.726550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:27.731272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:27.845311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2484610-4d8b-4e3b-b2a2-8293c85a1128 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:27.906054 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:27.936760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9851e-641d-4978-9105-8873250a56a8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:27.949353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.951281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.951671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.952052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:27.971744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:27.974373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:27.982236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:27.983501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:27.984066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:27.984489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:28.021233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2669/5342] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:28.169602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:28.171916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:28.207292 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2674/5343] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:28.594910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:28.596696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:28.623352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815960f7-7fa2-4ceb-877a-76ae691ab304 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:28.633787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:28.635321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:28.656348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:28.658153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:28.659695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:28.659887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] PATH_INFO: `/v3/projects/176c24f936764c29b222d96c3864ad90` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:28.666268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176c24f936764c29b222d96c3864ad90)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:28.668298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:28.898300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c0e96-07ca-40d7-98fa-eb2d71da9b32 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:28.923445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176c24f936764c29b222d96c3864ad90', 'request_id': 'req-8ce16c65-c1a5-4926-9406-7de54a003f02'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:28.931224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176c24f936764c29b222d96c3864ad90', 'request_id': 'req-8ce16c65-c1a5-4926-9406-7de54a003f02'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:29.026016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.026814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.027098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.027400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.029345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:29.044818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:29.047123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7f830-59f0-45f7-acbb-9156566bc7f5 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:29.054228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176c24f936764c29b222d96c3864ad90', 'request_id': 'req-8ce16c65-c1a5-4926-9406-7de54a003f02'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:29.066745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] The token cache is being invalidate because project 176c24f936764c29b222d96c3864ad90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:29.067098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:29.067910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8ce16c65-c1a5-4926-9406-7de54a003f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:29.073507 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2670/5344] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:28 2022] DELETE /identity/v3/projects/176c24f936764c29b222d96c3864ad90 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:29.074342 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2675/5345] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:29.075274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.075637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.075915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.099119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:29.101766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:29.144019 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:29.226774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2671/5346] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:29.326110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.326467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.326813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.337579 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:29.356313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:29.356313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:29.364566 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2676/5347] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:29.369787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.382400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698aa9-e3ec-4f5d-b1cc-80428a80dd3a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.388370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.389155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.389487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.389764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.390422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:29.390725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:29.392933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:29.405520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2672/5348] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:29.409980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.419806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512d60c-7f0c-431e-8122-7956efb4a1f2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.424837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.430266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.430266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.430266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.430266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:29.430266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:29.587030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2677/5349] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:29 2022] POST /identity/v3/projects => generated 359 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:39:29.594982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.613111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f282d-0685-46e9-aa6b-632ed169ba10 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.729774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.730364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.730650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.731233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.732441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:29.734489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:29.827904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.829828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:29.875169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2673/5350] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:29 2022] POST /identity/v3/users => generated 280 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:29.876627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.902529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463381-053e-4c19-8cff-660c6d758a70 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.906658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.907355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.907847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.908177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.908837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:29.921649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:29.956872 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2674/5351] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:29.958436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:29.976601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c407de-745b-47d3-8a16-8a11e7680b97 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.979056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492427f-fae7-469c-adfd-565184eacada admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:29.988443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.988443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.988443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.988443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:29.989360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:29.994000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:29.994624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:29.994952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:29.995230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:30.002110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:30.002110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:30.027809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2675/5352] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:30.033306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:30.050864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bd16-b2f1-4a6c-8f24-bd9b33dd1cdc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:30.066031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:30.067341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:30.067812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:30.068249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] PATH_INFO: `/v3/projects/5765121276ee4043839466deefacd16b/users/0832c9874c0a4ef5a83c8d8ef0024257/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:30.108949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5765121276ee4043839466deefacd16b, user_id=0832c9874c0a4ef5a83c8d8ef0024257, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:30.129587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:30.153728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:30.155942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d63a-0cb3-4750-ae8b-59b750042d1a service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:30.176022 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2678/5353] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:30.243253 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2676/5354] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:30 2022] PUT /identity/v3/projects/5765121276ee4043839466deefacd16b/users/0832c9874c0a4ef5a83c8d8ef0024257/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:30.253288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387485-18b5-4257-bbdf-b2c35a666ad9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:30.253636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387485-18b5-4257-bbdf-b2c35a666ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:30.253913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68387485-18b5-4257-bbdf-b2c35a666ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:30.291136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-68387485-18b5-4257-bbdf-b2c35a666ad9 None None] MFA Rules not processed for user `0832c9874c0a4ef5a83c8d8ef0024257`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:30.292011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68387485-18b5-4257-bbdf-b2c35a666ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:30.425187 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:30.431723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2679/5355] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:30.438710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:30.440451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:30.540139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1dc6-1ac4-4927-a360-608591c24bf9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:30.547773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:30.548668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:30.549683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:30.550025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:30.580181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:30.582517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:30.586974 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:30.598562 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2677/5356] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:37.953024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:37.953979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:37.954790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:37.983873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] MFA Rules not processed for user `aba3c4de99ec4a5aae6fb006ab89fdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:37.985807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:38.106454 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2680/5357] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:40.158491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:40.159909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:40.174032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c896c1a-6fab-4d0f-9cab-8b6d58e543db service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:40.179637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:40.180261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:40.180581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:40.180855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:40.182996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:40.198076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:40.200590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:40.214891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2678/5358] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:40.432427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:40.435873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:40.606235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c966-b19a-4262-8119-c2d255c9dbf5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:40.612149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:40.612892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:40.613577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:40.614199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] PATH_INFO: `/v3/users/352cb9c0a2644e0e8743f3cc4477f88f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:40.615811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352cb9c0a2644e0e8743f3cc4477f88f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:40.618084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:40.746131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:40.748375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:40.939896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88291695-a7d9-4fa2-83f3-ba9ee259632c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:40.941982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352cb9c0a2644e0e8743f3cc4477f88f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:40.951179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:40.952044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:40.952587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:40.952967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:40.955836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:40.976790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:40.978505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2ca7-f6c0-4839-a4c0-a65b8aca7e30 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:41.010896 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2679/5359] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:39:41.067311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352cb9c0a2644e0e8743f3cc4477f88f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:41.067311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352cb9c0a2644e0e8743f3cc4477f88f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:41.095879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352cb9c0a2644e0e8743f3cc4477f88f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:41.118010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352cb9c0a2644e0e8743f3cc4477f88f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:41.128584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2681/5360] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:40 2022] DELETE /identity/v3/users/352cb9c0a2644e0e8743f3cc4477f88f => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:41.546387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:41.547008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:41.547008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:41.601708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:41.603233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:41.748702 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2680/5361] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:39:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:41.788617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:41.791184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:41.852046 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:41.981809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11bc13-b26e-41bf-95b4-fe73765a8d98 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:42.007352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:42.007979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:42.008460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:42.008916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:42.046737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:42.048687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5590453-1450-420e-b972-1bf6a7521bd5 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:42.074345 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2682/5362] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:39:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:39:42.111895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:42.118582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:42.392701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116e90-0ef6-474f-bc79-9ed0b2c4cb5a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:42.408782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:42.414230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:42.414230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:42.414230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] PATH_INFO: `/v3/projects/6716e9ebbf6c4ca1950a5a0bce33276c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:42.414230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6716e9ebbf6c4ca1950a5a0bce33276c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:42.414708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:42.456274 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:42.615808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6716e9ebbf6c4ca1950a5a0bce33276c', 'request_id': 'req-c6f536b1-a219-499a-bb3a-285162eb05a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:42.622010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6716e9ebbf6c4ca1950a5a0bce33276c', 'request_id': 'req-c6f536b1-a219-499a-bb3a-285162eb05a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:42.787174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6716e9ebbf6c4ca1950a5a0bce33276c', 'request_id': 'req-c6f536b1-a219-499a-bb3a-285162eb05a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:42.814164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] The token cache is being invalidate because project 6716e9ebbf6c4ca1950a5a0bce33276c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:42.814530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:42.817946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c6f536b1-a219-499a-bb3a-285162eb05a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:42.822363 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2681/5363] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:42 2022] DELETE /identity/v3/projects/6716e9ebbf6c4ca1950a5a0bce33276c => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:42.826991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:42.828090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:42.828363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:42.907305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:42.911336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:43.074506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2683/5364] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:43.082601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.083186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.083751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.117731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:43.119195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:43.131063 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2682/5365] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:43.140160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.195217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a449-8a43-4905-bbf4-9d81528238d3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.202262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.203504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.204910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.205623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.206756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:43.207909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.211935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.238160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.245821 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2684/5366] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:43.250762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f035c-d4dd-4d23-94a0-a40cc7370bbd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.257579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.261296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.263833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.264317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.266230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.268776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3244-d695-41ad-840d-35a87f5d5bf2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.388141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.394847 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2683/5367] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:43 2022] POST /identity/v3/projects => generated 395 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:43.407003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112479-62e7-45fa-bdea-0d32305871ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.572479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.580349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.588880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.588880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.588880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.588880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.637069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f5e47-6ef6-46dd-838e-d153df2cead8 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.637069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f5e47-6ef6-46dd-838e-d153df2cead8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.637069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f5e47-6ef6-46dd-838e-d153df2cead8 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.639077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2684/5368] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:39:43.644978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.645368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.645704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.691723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:43.696641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:43.794250 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2685/5369] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:43 2022] POST /identity/v3/users => generated 298 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:43.800696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.803631 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2685/5370] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:39:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:39:43.820738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11e0d6-e8d1-47f8-abfd-2db573dfb2bd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.831841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.831841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.831841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.831841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.832653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.835096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.847905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.851458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:43.858280 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2686/5371] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:43.859528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.872764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2be86-fd3c-4d8d-bc1e-6a89ec3acbcc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.889204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.889842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.890117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.890381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.891033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.891623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495fa22-48d4-4b3b-9151-c6b93d215fb0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.898719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.913687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.914331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.914610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.914883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:43.948318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:43.949456 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2687/5372] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:43.950390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:43.954316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27015198-d1f1-4c37-93e2-5672fb764183 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:43.971599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047479e5-ffba-4a09-a20d-5c7f9120a04d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:43.976806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2686/5373] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:43.982198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:43.983076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:43.983544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:43.983978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] PATH_INFO: `/v3/projects/0c233051e24144c8a0cf280503c9793a/users/ee0d664772db46a2ac07dddc4cf39d24/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.008630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c233051e24144c8a0cf280503c9793a, user_id=ee0d664772db46a2ac07dddc4cf39d24, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:44.012783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf153e4-a68e-4e9d-94d7-ae2a463553ac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:44.170633 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2688/5374] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:43 2022] PUT /identity/v3/projects/0c233051e24144c8a0cf280503c9793a/users/ee0d664772db46a2ac07dddc4cf39d24/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:44.174479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.174479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.174479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.239227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.241715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.386090 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2687/5375] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.397632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c11e1-6818-4747-bf4d-e1604422940d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.397913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c11e1-6818-4747-bf4d-e1604422940d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.398184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c11e1-6818-4747-bf4d-e1604422940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.416816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9a0c11e1-6818-4747-bf4d-e1604422940d None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.418041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a0c11e1-6818-4747-bf4d-e1604422940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.428512 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2689/5376] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.438050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:44.439462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.450931 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:44.560605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15a93-41df-4c4a-ab81-2456d87ce007 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:44.571080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:44.572072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.572689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.572817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.597869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:44.599540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d1efe-02d9-40f4-90c7-0341aeef2845 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:44.611311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2688/5377] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:44 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:44.636447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54e39-ac80-499b-a8f0-db70f1adef5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.636447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54e39-ac80-499b-a8f0-db70f1adef5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.636447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54e39-ac80-499b-a8f0-db70f1adef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.657688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fbc54e39-ac80-499b-a8f0-db70f1adef5e None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.658897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fbc54e39-ac80-499b-a8f0-db70f1adef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.666640 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2690/5378] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.704397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cfa1-e31d-437c-8d52-85dcb1e23e8b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.704868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cfa1-e31d-437c-8d52-85dcb1e23e8b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.704973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81cfa1-e31d-437c-8d52-85dcb1e23e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.729488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd81cfa1-e31d-437c-8d52-85dcb1e23e8b None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.731042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd81cfa1-e31d-437c-8d52-85dcb1e23e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.738867 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2689/5379] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.798780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.799150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.799491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.821952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.823239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.833836 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2691/5380] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.873006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971eb2-4b3a-4616-80cc-57de934bf7e7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:44.873262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971eb2-4b3a-4616-80cc-57de934bf7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:44.873574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36971eb2-4b3a-4616-80cc-57de934bf7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:44.899447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-36971eb2-4b3a-4616-80cc-57de934bf7e7 None None] MFA Rules not processed for user `ee0d664772db46a2ac07dddc4cf39d24`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:44.900935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36971eb2-4b3a-4616-80cc-57de934bf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:44.909753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2690/5381] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:44.958579 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:44.958579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:45.045798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661183a-8dfc-4947-ac80-91b3a27e9fcb None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:45.051350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:45.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:45.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:45.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] PATH_INFO: `/v3/users/ee0d664772db46a2ac07dddc4cf39d24` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:45.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0d664772db46a2ac07dddc4cf39d24)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:45.060383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:45.369906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0d664772db46a2ac07dddc4cf39d24'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:45.506903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0d664772db46a2ac07dddc4cf39d24'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:45.507829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0d664772db46a2ac07dddc4cf39d24'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:45.522682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0d664772db46a2ac07dddc4cf39d24'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:45.531051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0d664772db46a2ac07dddc4cf39d24'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:45.558884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2692/5382] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:44 2022] DELETE /identity/v3/users/ee0d664772db46a2ac07dddc4cf39d24 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:45.563839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:45.564131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:45.564412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:45.597434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:45.599033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:45.711574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2691/5383] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:45.723416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:45.726018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:45.817878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:45.820289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:45.844628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42481ee-ea78-483a-8cd3-5e31fe420d69 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:45.853614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:45.858357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:45.858357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:45.858357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] PATH_INFO: `/v3/users/cf432101f4be4ce191dc5cc28ec3db8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:45.858357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf432101f4be4ce191dc5cc28ec3db8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:45.860345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:45.877557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953b8f4-d047-42ef-a2c6-04da5adb27e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:45.886551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:45.887529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:45.890489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:45.890489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:45.903346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:45.904844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4758df-6a0b-47e7-b5c7-9ac57a859fc0 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:45.916708 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2693/5384] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:46.102438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf432101f4be4ce191dc5cc28ec3db8e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:46.103779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf432101f4be4ce191dc5cc28ec3db8e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:46.126279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf432101f4be4ce191dc5cc28ec3db8e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:46.127641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf432101f4be4ce191dc5cc28ec3db8e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:46.263698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf432101f4be4ce191dc5cc28ec3db8e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:46.289679 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2692/5385] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:45 2022] DELETE /identity/v3/users/cf432101f4be4ce191dc5cc28ec3db8e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:39:46.294494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:46.294781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:46.295919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:46.320777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:46.323048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:46.422677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2694/5386] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:46.456338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:46.457702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:46.535685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff648de-d7c0-4617-b040-31ed60f6593d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:46.540157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:46.540884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:46.541166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:46.541463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:46.551277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:46.552755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2fd1-9543-44aa-b355-bad379944472 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:46.562784 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2693/5387] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:46.599241 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:46.608504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:46.611294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:46.639307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49c3b-2208-458b-a657-4d8b1675172e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:46.648431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:46.649825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:46.650445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:46.650949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] PATH_INFO: `/v3/projects/0c233051e24144c8a0cf280503c9793a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:46.652514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c233051e24144c8a0cf280503c9793a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:46.656588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:46.847439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c233051e24144c8a0cf280503c9793a', 'request_id': 'req-7e9ff30f-e031-4d9b-b203-ce3d277f793c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.044235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c233051e24144c8a0cf280503c9793a', 'request_id': 'req-7e9ff30f-e031-4d9b-b203-ce3d277f793c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.061383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c233051e24144c8a0cf280503c9793a', 'request_id': 'req-7e9ff30f-e031-4d9b-b203-ce3d277f793c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.079777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] The token cache is being invalidate because project 0c233051e24144c8a0cf280503c9793a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:47.080066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.080724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7e9ff30f-e031-4d9b-b203-ce3d277f793c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.082318 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2695/5388] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:46 2022] DELETE /identity/v3/projects/0c233051e24144c8a0cf280503c9793a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:47.088007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.088518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.088518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.109974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:47.111231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.176587 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2694/5389] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:47.186404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.186692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.186967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.210085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:47.211423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.225781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.232907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2696/5390] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:47.242210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb0543-9d1d-4601-85b8-6a403cd45e18 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.249112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.250183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.251143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.251728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.252601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:47.253087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.255053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.279193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.285597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2695/5391] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:39:47.290246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d742-67e3-4219-acff-f5e31dd36acc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.306287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.308784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.308784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.308784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.308784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.310171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.364447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.367420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.382177 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:47.386858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a555941-bedd-4f50-b560-82a346a7b70a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.393406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.394940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.395354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.395729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] PATH_INFO: `/v3/projects/28335454d2074468954956adc93c086e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.397079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=28335454d2074468954956adc93c086e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.399474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.544815 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2697/5392] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:47.548959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.590291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28335454d2074468954956adc93c086e', 'request_id': 'req-956fb298-3bc6-413c-b729-757326625ebf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.602955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28335454d2074468954956adc93c086e', 'request_id': 'req-956fb298-3bc6-413c-b729-757326625ebf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.643179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202839-1b05-411f-a961-46c5930ab94d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.712098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28335454d2074468954956adc93c086e', 'request_id': 'req-956fb298-3bc6-413c-b729-757326625ebf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.729208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.732764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.734689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.734928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.737443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] The token cache is being invalidate because project 28335454d2074468954956adc93c086e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:47.737443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.737698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.738214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-956fb298-3bc6-413c-b729-757326625ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:47.741769 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2696/5393] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:47 2022] DELETE /identity/v3/projects/28335454d2074468954956adc93c086e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:47.742627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.746575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b8d7-6d96-49bb-ac93-4e490af94a99 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.747093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b8d7-6d96-49bb-ac93-4e490af94a99 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.747551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b8d7-6d96-49bb-ac93-4e490af94a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.796204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3cf3b8d7-6d96-49bb-ac93-4e490af94a99 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:47.796915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3cf3b8d7-6d96-49bb-ac93-4e490af94a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.838731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2697/5394] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:47.851117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.851462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.851683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.878991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:47.880210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.889310 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2698/5395] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:47.902020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.907306 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2698/5396] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:39:47.913155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.915050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ceb3-782e-445f-9b8c-d632a7d4c362 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.916793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:47.925095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.925757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.926034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.926301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.926950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:47.927248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.929133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.932017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63df390-205e-4418-a2aa-13b640f19e3e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.937804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.938669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.939119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.939585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.940701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.942513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.949540 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2699/5397] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:47.950600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.957567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2699/5398] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:47.959688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:47.964570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c3e93-8547-4731-b043-dda0d3a3194d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.971679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.972587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.973119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.973464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aae2b-b26c-4008-afdf-60bfe32770e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:47.974327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.976439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.978741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:47.981293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:47.982432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:47.982775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:47.983194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:47.984125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:47.986539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.005918 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2700/5399] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:39:48.010301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.025804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdd061-35dc-46a3-9ba4-67a79f9566c7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.031820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.035970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.035970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.035970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] PATH_INFO: `/v3/projects/9f9d0d541cc3496ebf8dc71af4254506/users/157c0ef579434726810bb3775388b944/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.051200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9d0d541cc3496ebf8dc71af4254506, user_id=157c0ef579434726810bb3775388b944, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.053936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d120d-c72d-4dfb-ac41-dd82c7e687ee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.115632 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2700/5400] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:47 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:48.118679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.203399 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2701/5401] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:48 2022] PUT /identity/v3/projects/9f9d0d541cc3496ebf8dc71af4254506/users/157c0ef579434726810bb3775388b944/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:48.204967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.205480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.205901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.220953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e1253-7b42-405a-9b5a-5ab3f60c4b98 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.234923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:48.236395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:48.360800 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2702/5402] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:48.370759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.372116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.372643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.373114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.373461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.373963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.375346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:48.376374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.461253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c72d2-2aba-4357-800c-81b9686467a4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.465069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.466353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.466353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.466353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.476373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.481006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.489239 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2703/5403] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:48.516148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2701/5404] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:48 2022] POST /identity/v3/users => generated 285 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:48.517587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.533485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3455142-afb2-4926-95cc-de2a310e5ebf service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.539399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.540013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.540355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.541003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.542213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.544424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.561411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2704/5405] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:48.563405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.579515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe6f30-fd84-42e0-aa6d-e7b5847be507 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.589713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.590338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.590615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.591011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.591662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.593439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88082f-033e-447a-a30c-9824734fd451 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.607745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2702/5406] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:48.608898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:48.620355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040546-870e-4887-9b04-96fa34be286f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:48.626303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:48.627094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.627973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.628171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] PATH_INFO: `/v3/projects/88bd1f7c254e42b5b01150436f6f0ae2/users/ca5da22f11834a2c86d7fcece63dd074/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.649564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bd1f7c254e42b5b01150436f6f0ae2, user_id=ca5da22f11834a2c86d7fcece63dd074, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:48.673495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:48.849054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2705/5407] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:48 2022] PUT /identity/v3/projects/88bd1f7c254e42b5b01150436f6f0ae2/users/ca5da22f11834a2c86d7fcece63dd074/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:48.856452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:48.857147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:48.857910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:48.921458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] MFA Rules not processed for user `ca5da22f11834a2c86d7fcece63dd074`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:48.923651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:49.041375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2703/5408] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:49.047607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.150147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431a9b-bd79-464f-b9c3-156a1499e862 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.156278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.157237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.158030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.158535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.159591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.162614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.279671 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2706/5409] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:49.284459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.297180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e063d-f972-4d8b-b029-755cb0bdec57 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.370259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.370879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.371158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.371432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.372135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.374849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.519861 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2704/5410] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:49 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:39:49.524183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.535868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87ee69-43ad-48cd-8d67-9df199c4ff40 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.543243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.544247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.544588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.544952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.545887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.547963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.564832 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2707/5411] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:49.568225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.582276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5640e-9d2d-4beb-badd-505fb92addb6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.590129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.593816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.593816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.593816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] PATH_INFO: `/v3/projects/22ccf364e0c041c5a0e6321378e9b583/users/9a436f2871d8443bb2ab8caec14cfbc4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.623983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ccf364e0c041c5a0e6321378e9b583, user_id=9a436f2871d8443bb2ab8caec14cfbc4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.626731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.668581 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:49.714738 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2705/5412] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:49 2022] PUT /identity/v3/projects/22ccf364e0c041c5a0e6321378e9b583/users/9a436f2871d8443bb2ab8caec14cfbc4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:49.716415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.728658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c3dcc-6486-4cf2-b48d-8c63fa2ad86e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.838551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.840924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.841211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.841528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.842904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.844365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c4462-c68f-4827-a558-0879b170b4a1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.856058 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2708/5413] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:49.859705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:49.871141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce862-1cb3-4215-8362-207d9386d851 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:49.876512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:49.877254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.877641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.877989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] PATH_INFO: `/v3/projects/22ccf364e0c041c5a0e6321378e9b583/users/9a436f2871d8443bb2ab8caec14cfbc4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.880182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ccf364e0c041c5a0e6321378e9b583, user_id=9a436f2871d8443bb2ab8caec14cfbc4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:49.883833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:49.896967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2706/5414] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:49 2022] PUT /identity/v3/projects/22ccf364e0c041c5a0e6321378e9b583/users/9a436f2871d8443bb2ab8caec14cfbc4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:39:49.909411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:49.909411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:49.909729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:49.945857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] MFA Rules not processed for user `9a436f2871d8443bb2ab8caec14cfbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:49.947186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:50.047022 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2709/5415] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:50.059650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:50.062021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:50.118274 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:50.149696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7dfec-afd8-4d26-851a-1d960b16d7d2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:50.154037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:50.154708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:50.154979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:50.155252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:50.180701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:50.182862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:50.206043 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2707/5416] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:50.489237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:50.507514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11999eea-fbd9-4181-8eec-6ca48ba0aaf3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:50.512822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:50.514550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:50.515895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:50.516395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:50.588934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:50.590677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1802fcf-82b2-44a6-8120-92185857b3da service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:50.602650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2710/5417] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:51.487472 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:52.472816 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:53.510665 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:55.384264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:55.385782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:55.455733 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:55.501771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953de-31e2-4638-bfba-8fb38cb91165 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:55.508601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:55.509626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:55.509983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:55.510332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] PATH_INFO: `/v3/users/2aa73c81f9fd4780b4ff5b061a9f39cc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:55.511695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa73c81f9fd4780b4ff5b061a9f39cc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:55.513864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:55.792191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa73c81f9fd4780b4ff5b061a9f39cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:55.796691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa73c81f9fd4780b4ff5b061a9f39cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:55.819270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa73c81f9fd4780b4ff5b061a9f39cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:55.825382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa73c81f9fd4780b4ff5b061a9f39cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:56.201446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa73c81f9fd4780b4ff5b061a9f39cc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:56.201446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2708/5418] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:39:55 2022] DELETE /identity/v3/users/2aa73c81f9fd4780b4ff5b061a9f39cc => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:56.202899 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2711/5419] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:56.204382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:56.204382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:56.281395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae764e60-4064-4125-bae0-a0894357714e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:56.298713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:56.298852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:56.299303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:56.300176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:56.325383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:56.327172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eb279-4769-441a-976e-8452fb5b8aca service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:56.355725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2709/5420] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:39:57.091664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:57.093397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:57.113770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ad948-fedb-4ebd-8182-5505cc54c613 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:57.126366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:57.127277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:57.127689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:57.128095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] PATH_INFO: `/v3/projects/44089dca50f04a74bfcbab21c998cd45` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:57.130254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44089dca50f04a74bfcbab21c998cd45)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:57.132361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:57.316592 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:57.363430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44089dca50f04a74bfcbab21c998cd45', 'request_id': 'req-8fc0e340-6b9f-4c87-94be-a4e579d7867f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:57.454953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44089dca50f04a74bfcbab21c998cd45', 'request_id': 'req-8fc0e340-6b9f-4c87-94be-a4e579d7867f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:57.466307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44089dca50f04a74bfcbab21c998cd45', 'request_id': 'req-8fc0e340-6b9f-4c87-94be-a4e579d7867f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:57.498426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] The token cache is being invalidate because project 44089dca50f04a74bfcbab21c998cd45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:39:57.498828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:57.504043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:39:57.509914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2712/5421] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:39:57 2022] DELETE /identity/v3/projects/44089dca50f04a74bfcbab21c998cd45 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:57.515420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ffd4-8057-4f8f-911c-abe36437ffc7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:57.515910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ffd4-8057-4f8f-911c-abe36437ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:57.516195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865ffd4-8057-4f8f-911c-abe36437ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:57.563859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a865ffd4-8057-4f8f-911c-abe36437ffc7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:57.565170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a865ffd4-8057-4f8f-911c-abe36437ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:57.650231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:57.651740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:57.682449 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:57.743693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2710/5422] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:57.751169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:57.751421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:57.751818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:57.803313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0e340-6b9f-4c87-94be-a4e579d7867f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:57.807072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:57.811492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:57.819131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:57.819845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:57.820197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:57.820543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:57.823132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:57.842408 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2711/5423] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:39:57.846552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:57.865033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:57.867359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:57.874050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3a45c-c05c-4fd1-97e2-f5433d3ac99c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:57.904798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:57.905375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:57.905685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:57.910878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:57.910878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:39:57.910878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:57.911130 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2713/5424] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:39:57.916978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:57.964008 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2712/5425] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:39:57.968190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:58.008067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948417b8-b4c8-49f9-aaa9-22b4c773a964 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:58.024968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:58.027403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.027977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.028457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.029427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:58.031738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:58.176384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2714/5426] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:57 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:58.180922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:58.198922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94696b-a5a5-4fcb-bc64-b84fd2096767 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:58.319370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:58.320076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.320375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.320656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.321533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:58.323637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:58.473839 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2713/5427] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:58 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:58.477981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:58.490286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae756-4b18-4d1f-9d54-ae2bf9b7dd3f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:58.503345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:58.504256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.504716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.505771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.507267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:58.510246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:58.538836 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2715/5428] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:58.545452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:58.568863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bdfcb-0a75-406e-9efa-7d2010bb0c5a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:58.578986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:58.579604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.579885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.580158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.580791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:58.582431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea8098-3fb5-4f75-89a3-6a7866da248c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:58.601074 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2714/5429] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:58.602262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:58.613638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293850d7-a2b9-4649-b37b-6881ed345090 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:58.619636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:58.620474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.620756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.621054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] PATH_INFO: `/v3/projects/bd9a98bdcde24218af3b0f507f15a251/users/e09288d5a50e42ea8ebc8f3638e6b5c3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.645052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9a98bdcde24218af3b0f507f15a251, user_id=e09288d5a50e42ea8ebc8f3638e6b5c3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:58.648210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:58.763574 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2716/5430] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:58 2022] PUT /identity/v3/projects/bd9a98bdcde24218af3b0f507f15a251/users/e09288d5a50e42ea8ebc8f3638e6b5c3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:39:58.775272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:58.775828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:58.776830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:58.853937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] MFA Rules not processed for user `e09288d5a50e42ea8ebc8f3638e6b5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:58.858485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:59.028640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2715/5431] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:59.034023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:59.163392 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:59.197598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3bb7f-701f-4cbf-80b3-e35abbf25d79 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:59.216561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:59.218447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.218879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.219519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.220424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:59.223636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d457eca-b764-4058-af4e-90355442e077 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:59.376510 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2717/5432] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:39:59 2022] POST /identity/v3/projects => generated 381 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:59.384176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:59.402122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.402407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.403426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.410651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44491844-511d-41b3-9a6a-f42a04a6af29 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:59.467772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:39:59.469633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:39:59.502162 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:39:59.560809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:59.562093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.562513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.562912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.563693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:59.566222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:59.626973 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2718/5433] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:39:59.646908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:59.698072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2716/5434] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:39:59 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:39:59.701164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:59.764248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa4ba-4e50-456c-8a6f-2837671db74f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:59.781288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:59.782634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.783076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.783480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.784580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:59.788326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:59.811473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2717/5435] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:39:59.814847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:39:59.818382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8da8-d8b7-4e18-998b-afc6ae377490 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:59.832174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:59.832940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.833305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.833538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.836848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39503ee-c389-4f42-ac91-27286461323f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:39:59.847755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:39:59.848668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:39:59.849143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:39:59.849648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] PATH_INFO: `/v3/projects/cbfacc1bd28943448db76ee68b26d4cb/users/f023c0d745b7407cbc769603771e35f0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:39:59.850385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:59.852054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:39:59.864303 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2719/5436] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:39:59.888500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfacc1bd28943448db76ee68b26d4cb, user_id=f023c0d745b7407cbc769603771e35f0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:39:59.891445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:00.018481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2718/5437] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:39:59 2022] PUT /identity/v3/projects/cbfacc1bd28943448db76ee68b26d4cb/users/f023c0d745b7407cbc769603771e35f0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:00.022628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:00.044223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11de31-cc3b-48c0-9673-9ab71a0ef8e3 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:00.174048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:00.174675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:00.174958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:00.175230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:00.175877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:00.178356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82413014-1069-480c-bbd3-f64d3d77340b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:00.192474 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2720/5438] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:00.202043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:00.213475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8487f4-b860-476c-9861-0d3c82b8e28b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:00.234077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:00.234761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:00.235051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:00.236299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] PATH_INFO: `/v3/projects/cbfacc1bd28943448db76ee68b26d4cb/users/f023c0d745b7407cbc769603771e35f0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:00.239221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfacc1bd28943448db76ee68b26d4cb, user_id=f023c0d745b7407cbc769603771e35f0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:00.242989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:00.254783 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2719/5439] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:00 2022] PUT /identity/v3/projects/cbfacc1bd28943448db76ee68b26d4cb/users/f023c0d745b7407cbc769603771e35f0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:00.265194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:00.265526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:00.265801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:00.344507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] MFA Rules not processed for user `f023c0d745b7407cbc769603771e35f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:00.346123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:00.454202 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2721/5440] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:00.472443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:00.476915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:00.498683 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:00.576280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb46d-5fc4-4025-8873-9552a7add198 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:00.578965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:00.579738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:00.580070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:00.580409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:00.602604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:00.604373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:00.637573 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2720/5441] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:40:00.788293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:00.807652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5de6c-a9ac-4f34-aaf4-de66e28fc438 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:00.816057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:00.816696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:00.817000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:00.818125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:00.933900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:00.935510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a2400-5d58-4cc3-863f-8b490c7809eb service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:00.988814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2722/5442] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:03.982931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:03.986104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:04.451052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b62e5-9be1-452c-a798-5c3d191e3434 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:04.478118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:04.480522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:04.481675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:04.482546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:04.529173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:04.580861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:04.584021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:04.611882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2721/5443] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:05.533189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b827-9f6c-4ae3-82b4-babd211946ed None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:05.533671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b827-9f6c-4ae3-82b4-babd211946ed None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:05.538268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b827-9f6c-4ae3-82b4-babd211946ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:05.593562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b798b827-9f6c-4ae3-82b4-babd211946ed None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:05.594849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b798b827-9f6c-4ae3-82b4-babd211946ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:05.788916 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2723/5444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:10.670674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:10.701731 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:10.838087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df79b-53e3-4a25-88d0-b561a729536f service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:10.855294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:10.862272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:10.862568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:10.863075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] PATH_INFO: `/v3/users/e09288d5a50e42ea8ebc8f3638e6b5c3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:10.866001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09288d5a50e42ea8ebc8f3638e6b5c3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:10.868499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:11.185147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09288d5a50e42ea8ebc8f3638e6b5c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:11.185920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09288d5a50e42ea8ebc8f3638e6b5c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:11.196931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09288d5a50e42ea8ebc8f3638e6b5c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:11.197728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09288d5a50e42ea8ebc8f3638e6b5c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:11.329599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09288d5a50e42ea8ebc8f3638e6b5c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:11.358203 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2722/5445] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:40:10 2022] DELETE /identity/v3/users/e09288d5a50e42ea8ebc8f3638e6b5c3 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:11.362251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:11.363050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:11.363472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:11.402903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:11.407334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:11.422090 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:11.616111 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2724/5446] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:11.644212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:11.647280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:11.757763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658ad19-f48f-49b6-9a67-27edb866a4a0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:11.766373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:11.767261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:11.767750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:11.768144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:11.779556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:11.782109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:11.799374 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2723/5447] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:12.755647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:12.758736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:12.789934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150e6ac-8c7f-4d5c-b213-2f2ce3d71b17 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:12.806880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:12.808910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:12.809608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:12.810669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] PATH_INFO: `/v3/projects/bd9a98bdcde24218af3b0f507f15a251` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:12.818883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9a98bdcde24218af3b0f507f15a251)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:12.818883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:13.112971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9a98bdcde24218af3b0f507f15a251', 'request_id': 'req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.248857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9a98bdcde24218af3b0f507f15a251', 'request_id': 'req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.263525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9a98bdcde24218af3b0f507f15a251', 'request_id': 'req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.284160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] The token cache is being invalidate because project bd9a98bdcde24218af3b0f507f15a251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:40:13.284452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.285116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.287841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2725/5448] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:40:12 2022] DELETE /identity/v3/projects/bd9a98bdcde24218af3b0f507f15a251 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:13.294735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:13.307022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4a83e-6ad4-4961-9292-4e4511c46b01 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:13.335054 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:13.369134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:13.369803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:13.370082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:13.370354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] PATH_INFO: `/v3/users/f023c0d745b7407cbc769603771e35f0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:13.372037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f023c0d745b7407cbc769603771e35f0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:13.374392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:13.582804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f023c0d745b7407cbc769603771e35f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.583456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f023c0d745b7407cbc769603771e35f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.590405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f023c0d745b7407cbc769603771e35f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.594424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f023c0d745b7407cbc769603771e35f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.843563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-79b6c835-98d2-4b3f-b6cf-b4e2f1660c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f023c0d745b7407cbc769603771e35f0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:13.868023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2724/5449] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:40:13 2022] DELETE /identity/v3/users/f023c0d745b7407cbc769603771e35f0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:14.567288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:14.573024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:14.586060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd7b2-d25f-4edd-acdf-f6c8c38bfc0a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:14.666032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:14.666698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:14.667038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:14.667426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] PATH_INFO: `/v3/projects/cbfacc1bd28943448db76ee68b26d4cb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:14.674237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfacc1bd28943448db76ee68b26d4cb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:14.676417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:14.890323 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:14.925170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfacc1bd28943448db76ee68b26d4cb', 'request_id': 'req-6d123da0-7306-4d1c-ba6a-df14f6dd8746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:15.085015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfacc1bd28943448db76ee68b26d4cb', 'request_id': 'req-6d123da0-7306-4d1c-ba6a-df14f6dd8746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:15.096942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfacc1bd28943448db76ee68b26d4cb', 'request_id': 'req-6d123da0-7306-4d1c-ba6a-df14f6dd8746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:15.108432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] The token cache is being invalidate because project cbfacc1bd28943448db76ee68b26d4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:40:15.108726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:15.110348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d123da0-7306-4d1c-ba6a-df14f6dd8746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:15.114191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2726/5450] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:40:14 2022] DELETE /identity/v3/projects/cbfacc1bd28943448db76ee68b26d4cb => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:15.118865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.119345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.119479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.141989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:15.143662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:15.252245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2725/5451] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:40:15.262399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.264909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.265464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.301207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:15.302861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:15.327605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2727/5452] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:15.332087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:15.352721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7c7ac-7456-43dd-b9e1-2c651eb3e0c5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:15.358526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:15.359254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.359546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.360016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.361721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:40:15.365262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:15.367486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:15.396154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:15.396358 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2726/5453] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:40:15.406567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdd60c-21e0-4e57-8484-49d38a4d7e2d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:15.413847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:15.413847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.413847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.413847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.414720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:15.416757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:15.585897 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2728/5454] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:40:15 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:40:15.591297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:15.608947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca3594-b313-48fa-a803-599e26842acf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:15.654913 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:15.691397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:15.692615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.693595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.693917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.694699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:15.699090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:15.907976 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2727/5455] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:40:15 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:15.908157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:15.934314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ccb76-d40a-4c4d-acaa-7b8fd6689d9e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:15.971685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:15.972603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:15.973033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:15.978206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:15.978206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:15.978206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:15.988613 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2729/5456] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:15.997319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:16.022765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9625-ecf3-4647-b8a5-bf67d8d571e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:16.056462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:16.057137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:16.058187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:16.058187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:16.064470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:16.065144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6599b-61c5-4718-9b9e-3a0056d38e1f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:16.116894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2728/5457] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:16.131906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:16.152969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cca55d-c381-44f2-b4b7-aa6f102726ff admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:16.158927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:16.159596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:16.159879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:16.160208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] PATH_INFO: `/v3/projects/79c8e633308e4b89855579a51c597824/users/92a76238e16041e9b12d531d2e8c431b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:16.184199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c8e633308e4b89855579a51c597824, user_id=92a76238e16041e9b12d531d2e8c431b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:16.187488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:16.358256 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2730/5458] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:16 2022] PUT /identity/v3/projects/79c8e633308e4b89855579a51c597824/users/92a76238e16041e9b12d531d2e8c431b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:16.369573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:16.370838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:16.371311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:16.416158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] MFA Rules not processed for user `92a76238e16041e9b12d531d2e8c431b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:16.416158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:16.543837 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2729/5459] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:16.548019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:16.682697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fc94f-8ca2-4348-8047-6de4037b878b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:16.691517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:16.692216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:16.692623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:16.692938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:16.693691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:16.699999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:16.865940 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2731/5460] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:40:16 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:16.866835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:16.879641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce773-ee01-4614-8e78-fb18edf75bc5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:17.028265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:17.028898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:17.029183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:17.029491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:17.030209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:17.040732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:17.185655 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2730/5461] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:40:16 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:17.187310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:17.204925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf73ba-84d2-4599-b0b3-2374233b7dcf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:17.218795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:17.219742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:17.220208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:17.220680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:17.221576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:17.224049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:17.270986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2732/5462] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:17.273640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:17.289503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36765794-b682-430e-a4e8-63a5ce7fb231 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:17.327860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:17.328813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:17.329253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:17.329728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:17.330607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:17.345561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb71acb-8d86-4a4d-8e30-3d4a5f12c266 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:17.374770 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2731/5463] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:17.380916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:17.403354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce07a-37d5-423a-9850-18f10cc502ee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:17.415050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:17.415727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:17.416006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:17.416278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] PATH_INFO: `/v3/projects/fe0e3803c0c740258d78f3daedee6ac5/users/e6f64d0b5a27418ba842d759cd83cc6a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:17.461893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0e3803c0c740258d78f3daedee6ac5, user_id=e6f64d0b5a27418ba842d759cd83cc6a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:17.474635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:17.584359 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2733/5464] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:17 2022] PUT /identity/v3/projects/fe0e3803c0c740258d78f3daedee6ac5/users/e6f64d0b5a27418ba842d759cd83cc6a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:17.595074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861d18-1b61-442d-b448-24c569546772 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:17.595383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861d18-1b61-442d-b448-24c569546772 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:17.595965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2861d18-1b61-442d-b448-24c569546772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:17.660828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c2861d18-1b61-442d-b448-24c569546772 None None] MFA Rules not processed for user `e6f64d0b5a27418ba842d759cd83cc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:17.660828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2861d18-1b61-442d-b448-24c569546772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:17.699931 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:17.874251 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2732/5465] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:17.874434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:17.890955 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:18.028649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb94a-e3ad-447b-988f-784abed5f379 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:18.037760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:18.038382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:18.038663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:18.038998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:18.039569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:18.041891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:18.151665 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2734/5466] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:40:17 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:18.156326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861d18-1b61-442d-b448-24c569546772 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:18.170692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2861d18-1b61-442d-b448-24c569546772 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:18.351755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:18.354813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:18.355316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:18.355799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:18.356847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:18.359173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:18.490929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2733/5467] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:40:18 2022] POST /identity/v3/users => generated 295 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:18.501533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:18.516286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8bfb-7069-4103-9ed2-3a4522a9e73b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:18.522895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:18.523666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:18.524613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:18.524613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:18.530999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:18.530999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:18.545981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:18.553913 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2735/5468] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:40:18.565632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3adfe0-a1af-4006-b4d9-7950b2862c89 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:18.587230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:18.590610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:18.590610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:18.590610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] PATH_INFO: `/v3/projects/7d2ffe4b2d91403181f5729ff4229e56/users/2bc4e0e223744a4fbfb731d533282c91/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:18.632248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ffe4b2d91403181f5729ff4229e56, user_id=2bc4e0e223744a4fbfb731d533282c91, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:18.647534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:18.763885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2734/5469] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:18 2022] PUT /identity/v3/projects/7d2ffe4b2d91403181f5729ff4229e56/users/2bc4e0e223744a4fbfb731d533282c91/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:40:18.768021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:18.788978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256852e-0fa5-463e-9ad6-32115cfbd583 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:18.992149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:18.993636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:18.993927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:18.994252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:18.994974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:18.996605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcce7b5-26f2-4f3d-81c0-fb03a1698b5b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:19.010343 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2736/5470] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:19.013684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:19.033591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7182bd-2777-4fee-bce9-65f37e92208e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:19.038409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:19.039084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:19.039367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:19.039646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] PATH_INFO: `/v3/projects/7d2ffe4b2d91403181f5729ff4229e56/users/2bc4e0e223744a4fbfb731d533282c91/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:19.063739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2ffe4b2d91403181f5729ff4229e56, user_id=2bc4e0e223744a4fbfb731d533282c91, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:19.066672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:19.111342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:19.114762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:19.116499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:19.119866 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2735/5471] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:19 2022] PUT /identity/v3/projects/7d2ffe4b2d91403181f5729ff4229e56/users/2bc4e0e223744a4fbfb731d533282c91/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:19.176967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] MFA Rules not processed for user `2bc4e0e223744a4fbfb731d533282c91`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:19.178595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:19.446972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2737/5472] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:19.486800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:19.488522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:19.666785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f834a02-49f5-4500-916b-b07e7a0da3ce admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:19.674241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:19.675092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:19.677216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:19.677805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:19.718836 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:19.809936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:19.811987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:19.846788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2736/5473] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:23.887714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:23.923109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f486d-d8e6-4b53-aa22-98ba06df9e26 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:23.927703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:23.928349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:23.928837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:23.929183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:23.939712 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:24.060462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:24.061952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777bbc4-b201-4097-8aaa-2f049db37e04 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:24.076527 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2738/5474] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:26.370988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:26.372445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:26.396564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf745-96a8-4fd7-a88c-3d8b5e29fc6d service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:26.406767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:26.407659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:26.408104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:26.408372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:26.448946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:26.450588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:26.476122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2737/5475] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:34.071357 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=25 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:36.461182 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=25 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:37.210943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cc622-544b-4094-bab2-096ae0b7f610 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:37.211395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cc622-544b-4094-bab2-096ae0b7f610 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:37.211508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cc622-544b-4094-bab2-096ae0b7f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:37.278983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-207cc622-544b-4094-bab2-096ae0b7f610 None None] MFA Rules not processed for user `93d18cf1316742dab78a102a257608ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:37.283628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-207cc622-544b-4094-bab2-096ae0b7f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:37.451674 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2739/5476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:37.789553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:37.934321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583714-19cc-4d58-88a8-02b361d19291 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:37.949560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:37.950317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:37.950839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:37.951337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] PATH_INFO: `/v3/users/92a76238e16041e9b12d531d2e8c431b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:37.963354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a76238e16041e9b12d531d2e8c431b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:37.969137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:38.266853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a76238e16041e9b12d531d2e8c431b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:38.270321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a76238e16041e9b12d531d2e8c431b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:38.298194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a76238e16041e9b12d531d2e8c431b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:38.300855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a76238e16041e9b12d531d2e8c431b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:38.435272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a76238e16041e9b12d531d2e8c431b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:38.499146 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2738/5477] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:40:37 2022] DELETE /identity/v3/users/92a76238e16041e9b12d531d2e8c431b => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:38.503696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:38.504179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:38.504255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:38.569096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:38.570382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:38.776939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2740/5478] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:38.784050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:38.787341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:38.965718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c823-a559-45c5-ab98-a75b7b84657e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:38.979433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:38.980519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:38.980951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:38.981427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:39.008795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:39.008795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:39.023684 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2739/5479] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:39.682229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:39.694053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:39.740987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:39.742585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:39.772587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae1ccf-cdf7-4e1f-ba0c-465b061b73a8 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:39.797637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:39.798992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:39.802442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:39.802442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] PATH_INFO: `/v3/projects/79c8e633308e4b89855579a51c597824` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:39.804545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c8e633308e4b89855579a51c597824)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:39.806861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:39.833652 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:39.835601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c4f02-3a1d-4093-9a9c-a3229a38f86c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:39.842697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:39.843569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:39.844769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:39.845200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:39.870136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:40.000152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:40.006639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:40.017426 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:40.024346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c8e633308e4b89855579a51c597824', 'request_id': 'req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.050317 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2741/5480] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:40.055975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c8e633308e4b89855579a51c597824', 'request_id': 'req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.165764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c8e633308e4b89855579a51c597824', 'request_id': 'req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.184238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] The token cache is being invalidate because project 79c8e633308e4b89855579a51c597824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:40:40.184975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.190013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.195767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2740/5481] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:40:39 2022] DELETE /identity/v3/projects/79c8e633308e4b89855579a51c597824 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:40.204429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:40.238561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63ed3-ad45-4285-a93b-50564575f6a7 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:40.359943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:40.361231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:40.361759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:40.362235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] PATH_INFO: `/v3/users/e6f64d0b5a27418ba842d759cd83cc6a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:40.364917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f64d0b5a27418ba842d759cd83cc6a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:40.369143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:40.571285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f64d0b5a27418ba842d759cd83cc6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.626113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f64d0b5a27418ba842d759cd83cc6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.626748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f64d0b5a27418ba842d759cd83cc6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.644405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f64d0b5a27418ba842d759cd83cc6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.652749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f64d0b5a27418ba842d759cd83cc6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:40.660843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2742/5482] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:40:40 2022] DELETE /identity/v3/users/e6f64d0b5a27418ba842d759cd83cc6a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:41.378217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:41.380773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:41.404900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff86d6d-58e8-4ddf-98b6-d8e5c6dc95c0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:41.567336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:41.568147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:41.568504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:41.568893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] PATH_INFO: `/v3/projects/fe0e3803c0c740258d78f3daedee6ac5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:41.570372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0e3803c0c740258d78f3daedee6ac5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:41.574280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:41.721250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0e3803c0c740258d78f3daedee6ac5', 'request_id': 'req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:41.750958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0e3803c0c740258d78f3daedee6ac5', 'request_id': 'req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:41.870525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0e3803c0c740258d78f3daedee6ac5', 'request_id': 'req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:41.900349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] The token cache is being invalidate because project fe0e3803c0c740258d78f3daedee6ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:40:41.900349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:41.900349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:41.901511 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2741/5483] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:40:41 2022] DELETE /identity/v3/projects/fe0e3803c0c740258d78f3daedee6ac5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:41.904611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:41.906144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:41.929252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0c4d-9f78-4b2e-88f3-b69b81de84ff admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:42.064778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:42.066792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:42.067317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:42.067760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] PATH_INFO: `/v3/users/2bc4e0e223744a4fbfb731d533282c91` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:42.070955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc4e0e223744a4fbfb731d533282c91)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:42.081265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:42.127655 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:42.293834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc4e0e223744a4fbfb731d533282c91'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:42.377728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc4e0e223744a4fbfb731d533282c91'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:42.379968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc4e0e223744a4fbfb731d533282c91'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:42.404853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc4e0e223744a4fbfb731d533282c91'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:42.437787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca50c62c-5fab-410c-9f26-a88aa4905d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc4e0e223744a4fbfb731d533282c91'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:42.459108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2743/5484] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:40:41 2022] DELETE /identity/v3/users/2bc4e0e223744a4fbfb731d533282c91 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:43.564265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:43.566271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:43.588573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad453a-0c2b-4eb8-a7aa-c6409287c9a6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:43.676782 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:43.711287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:43.711944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:43.712223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:43.712847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] PATH_INFO: `/v3/projects/7d2ffe4b2d91403181f5729ff4229e56` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:43.714445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2ffe4b2d91403181f5729ff4229e56)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:43.716680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:43.884518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2ffe4b2d91403181f5729ff4229e56', 'request_id': 'req-7502165a-8f3c-417f-88c7-19a13f383435'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:43.951666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2ffe4b2d91403181f5729ff4229e56', 'request_id': 'req-7502165a-8f3c-417f-88c7-19a13f383435'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:44.052833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2ffe4b2d91403181f5729ff4229e56', 'request_id': 'req-7502165a-8f3c-417f-88c7-19a13f383435'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:44.086135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] The token cache is being invalidate because project 7d2ffe4b2d91403181f5729ff4229e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:40:44.086496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:44.088875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7502165a-8f3c-417f-88c7-19a13f383435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:40:44.104735 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2742/5485] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:40:43 2022] DELETE /identity/v3/projects/7d2ffe4b2d91403181f5729ff4229e56 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:44.109762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:44.110303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:44.110303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:44.181222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:44.182590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:44.407627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:44.407982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:44.408227 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2744/5486] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:44.408344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:44.457965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:44.463449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:44.484803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2743/5487] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:44.490386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:44.501120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10071137-d4ce-44df-8a00-8e2e455e2c7c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:44.527943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:44.528582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:44.528865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:44.529114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:44.530176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:40:44.530485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:44.532167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:44.567237 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2745/5488] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:40:44.571927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:44.589850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf925dd-da7c-4de8-a055-a3e46f089688 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:44.592149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:44.593300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:44.593765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:44.594231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:44.595031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:44.599672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:44.833017 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2744/5489] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:44.837452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:44.848562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efc434-4ba8-4bd7-9658-708927208866 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:44.987307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:44.987994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:44.988279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:44.988553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:44.989473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:44.992385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:45.134878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2746/5490] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:40:44 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:40:45.138735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:45.154846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746dd6-8393-4f1a-99d3-c5817f8e01ba admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:45.165507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:45.166124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:45.166404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:45.166676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:45.167320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:45.169028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:45.200062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2745/5491] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:45.203645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:45.215390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b3130-741b-4e44-b441-683fcc87808c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:45.229067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:45.229783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:45.230198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:45.230696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:45.231343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:45.232935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65498b0-0827-4642-a769-aba380310469 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:45.262886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:45.263453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2747/5492] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:40:45.275448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5094388-bb6a-42ec-a6e0-5046567855f0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:45.281237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:45.281932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:45.282211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:45.282478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] PATH_INFO: `/v3/projects/8512b08f05db4a469827368f47fb4c28/users/2ea515c9dbf645828f6f67c9f6bbc541/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:45.302438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8512b08f05db4a469827368f47fb4c28, user_id=2ea515c9dbf645828f6f67c9f6bbc541, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:45.308243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:45.415652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2746/5493] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:40:45 2022] PUT /identity/v3/projects/8512b08f05db4a469827368f47fb4c28/users/2ea515c9dbf645828f6f67c9f6bbc541/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:40:45.420644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a5f-f37c-47e7-b912-e51d1e494a99 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:45.420932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a5f-f37c-47e7-b912-e51d1e494a99 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:45.421195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a5f-f37c-47e7-b912-e51d1e494a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:45.437352 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:45.454811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f1939a5f-f37c-47e7-b912-e51d1e494a99 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:45.456042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f1939a5f-f37c-47e7-b912-e51d1e494a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:45.562027 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2748/5494] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:45.572575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:45.574992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:45.704433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71323699-6b94-4e35-ada5-37320c0af782 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:45.719071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:45.719909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:45.720256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:45.720538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:45.732024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:45.733633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:45.767988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2747/5495] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:48.386899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d805621-690a-4027-892e-dbda37564be2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:48.386899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d805621-690a-4027-892e-dbda37564be2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:48.386899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d805621-690a-4027-892e-dbda37564be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:48.483667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1d805621-690a-4027-892e-dbda37564be2 None None] MFA Rules not processed for user `2ea515c9dbf645828f6f67c9f6bbc541`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:48.483667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d805621-690a-4027-892e-dbda37564be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:48.639456 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2749/5496] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:48.703706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:48.705743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:48.716492 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:40:48.848625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e15b-3f44-40c9-8076-552815a28595 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:48.853550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:48.854167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:48.854453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:48.854727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:48.865408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:48.866849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:48.882943 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2748/5497] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:40:52.013156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a624f-10b6-4ca7-afc3-71338b03c25f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:52.015007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a624f-10b6-4ca7-afc3-71338b03c25f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:52.015649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a624f-10b6-4ca7-afc3-71338b03c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:52.057907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-845a624f-10b6-4ca7-afc3-71338b03c25f None None] MFA Rules not processed for user `2ea515c9dbf645828f6f67c9f6bbc541`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:40:52.060351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-845a624f-10b6-4ca7-afc3-71338b03c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:52.077193 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2750/5498] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:40:52.663715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:40:52.665570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:52.686167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b607-d821-470b-80b3-fe98a8ff49f1 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:40:52.691232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:40:52.692746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:40:52.693435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:40:52.693960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:40:52.696506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:40:52.716960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:40:52.718910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:40:52.735616 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2749/5499] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:02.034679 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=60 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:02.724529 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=30 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:08.396576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f545d6-50a2-4e58-831b-301bf6dce556 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:08.397130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f545d6-50a2-4e58-831b-301bf6dce556 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:08.397495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f545d6-50a2-4e58-831b-301bf6dce556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:08.441203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b1f545d6-50a2-4e58-831b-301bf6dce556 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:08.443041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b1f545d6-50a2-4e58-831b-301bf6dce556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:08.561084 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2751/5500] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:08.735939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:08.737704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:08.952467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6eefe-488d-46f6-a64b-eb5e9172e16b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:08.974505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:08.976516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:08.979541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:08.981357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:09.007894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:09.009786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3cf0a-0613-4ad8-acef-9ee1b0ece4e7 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:09.044960 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2750/5501] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:41:18.551103 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=25 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:19.021245 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=32 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:23.732771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:23.733271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:23.733543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:23.769771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] MFA Rules not processed for user `2ea515c9dbf645828f6f67c9f6bbc541`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:23.771129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:23.805474 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2752/5502] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:33.807180 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=15 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:41.343127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:41.343666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:41.343880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:41.388118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:41.392642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:41.562440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:41.563462 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2751/5503] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:41:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:41.594181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ffe27-8ed3-4daf-b55c-fe7264f3ae2a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:41.603561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:41.604740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:41.605443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:41.605974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:41.619502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:41.621804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:41.634367 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2753/5504] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:41:45.994895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:45.997087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:46.167525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5255b2-013d-4197-a5ef-c3d2db14c29d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:46.177825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:46.179553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:46.180027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:46.181148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:46.185116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:46.397908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:46.403508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:46.405161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:46.408201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:46.434686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2752/5505] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:46.447812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371fbb-1580-405d-8583-b7449e463b30 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:46.462235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:46.463141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:46.463684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:46.464163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] PATH_INFO: `/v3/users/0832c9874c0a4ef5a83c8d8ef0024257` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:46.465950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0832c9874c0a4ef5a83c8d8ef0024257)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:46.468196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:46.725084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0832c9874c0a4ef5a83c8d8ef0024257'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:46.899161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0832c9874c0a4ef5a83c8d8ef0024257'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:46.899905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0832c9874c0a4ef5a83c8d8ef0024257'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:46.971270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0832c9874c0a4ef5a83c8d8ef0024257'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.004013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-40eeeb1a-a672-4e4c-82b4-c4a732a0a601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0832c9874c0a4ef5a83c8d8ef0024257'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.027205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:47.040408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2754/5506] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:46 2022] DELETE /identity/v3/users/0832c9874c0a4ef5a83c8d8ef0024257 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:47.048820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:47.049110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:47.049415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:47.072096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521f24b-92ea-4f5b-b411-5e0775154c10 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:47.136833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:47.148697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:47.243855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:47.244538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:47.244829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:47.246545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:47.251682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:47.286910 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2755/5507] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:47.293379 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:47.297431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:47.299123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:47.435343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:47.443073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:47.444492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb0f26-2f45-4a99-97da-e974e2a29317 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:47.453531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:47.453531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:47.453531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:47.453531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:47.461679 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:47.468133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:47.471856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:47.484603 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2753/5508] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:47.485560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:47.487003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:47.501513 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2756/5509] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:41:47.513626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75addf59-60ef-4257-b87f-4bf58479dc5e service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:47.525849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:47.526498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:47.526846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:47.527122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] PATH_INFO: `/v3/users/9a18405b6d9143fcb1c31f8616242597` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:47.531380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a18405b6d9143fcb1c31f8616242597)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:47.534850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:47.803245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a18405b6d9143fcb1c31f8616242597'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.806061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a18405b6d9143fcb1c31f8616242597'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.847848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a18405b6d9143fcb1c31f8616242597'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.851012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a18405b6d9143fcb1c31f8616242597'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:47.964474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de762527-534e-42f2-88a2-9fd2930dfc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a18405b6d9143fcb1c31f8616242597'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.014252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:48.015676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.056370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502da12-b796-4fb8-9c8d-fd3d36d79128 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:48.070976 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2754/5510] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:47 2022] DELETE /identity/v3/users/9a18405b6d9143fcb1c31f8616242597 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:48.073157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.073481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.073761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.139104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:48.143435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.252308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:48.253108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.253479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.253825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] PATH_INFO: `/v3/projects/5765121276ee4043839466deefacd16b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.255774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5765121276ee4043839466deefacd16b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:48.272788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2755/5511] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:48.272960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:48.281487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:48.283035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.342405 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:48.383654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96465d6-9c2e-4bbd-b89b-00f18c0b72b1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:48.387839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:48.389087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.389664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.390144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.405019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:48.406863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:48.419177 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2756/5512] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:41:48.501578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5765121276ee4043839466deefacd16b', 'request_id': 'req-c31aea7a-1673-4303-abe9-30a8f88475a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.529722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:48.531186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.584480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5765121276ee4043839466deefacd16b', 'request_id': 'req-c31aea7a-1673-4303-abe9-30a8f88475a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.590422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881b9b3-c958-48dc-9c16-f88d7b64da5d service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:48.592913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5765121276ee4043839466deefacd16b', 'request_id': 'req-c31aea7a-1673-4303-abe9-30a8f88475a1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.618292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] The token cache is being invalidate because project 5765121276ee4043839466deefacd16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:48.618724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.619990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c31aea7a-1673-4303-abe9-30a8f88475a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:48.625537 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2757/5513] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:48 2022] DELETE /identity/v3/projects/5765121276ee4043839466deefacd16b => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:41:48.630932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e140e-6c62-4d6f-a7fc-ed1c174df4d5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.631214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e140e-6c62-4d6f-a7fc-ed1c174df4d5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.631570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e140e-6c62-4d6f-a7fc-ed1c174df4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.699584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aa9e140e-6c62-4d6f-a7fc-ed1c174df4d5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:48.701010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aa9e140e-6c62-4d6f-a7fc-ed1c174df4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.828561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:48.830265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.831714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.834762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] PATH_INFO: `/v3/users/ca5da22f11834a2c86d7fcece63dd074` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.842627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5da22f11834a2c86d7fcece63dd074)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:48.843402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2758/5514] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:41:48.852597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:48.882226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:48.882226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:48.882226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:48.937372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:48.939739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:48.977525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2759/5515] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:48.979194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.001573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb8688-7cf0-4fda-9df6-fafd302df731 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.006962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.007575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.007972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.008096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.009073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:41:49.009408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.011601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.036680 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:49.049642 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2760/5516] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:41:49.051079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.062288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf870db5-aecc-4ab6-98dd-af811851d06b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.067918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.068731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.069160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.069632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.070521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.073265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.165700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5da22f11834a2c86d7fcece63dd074'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:49.166992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5da22f11834a2c86d7fcece63dd074'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:49.186918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5da22f11834a2c86d7fcece63dd074'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:49.189114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5da22f11834a2c86d7fcece63dd074'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:49.189717 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2761/5517] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:41:49 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:49.191577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.195512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.303822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dfa0e-d667-4d1c-9564-117cf8de20a2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.309359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.310373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.310692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.310929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.315986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.318159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.321734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1e26f18-b3f8-4af1-9527-20ec83030dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5da22f11834a2c86d7fcece63dd074'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:49.355956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2757/5518] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:48 2022] DELETE /identity/v3/users/ca5da22f11834a2c86d7fcece63dd074 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:41:49.364113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.370558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.370558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.412282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:49.412853 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2762/5519] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:41:49 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:49.414469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.418932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.422345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.480307 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:49.506073 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2758/5520] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:49.507250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.519238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d139f-49ab-4542-904e-99f9442d10e0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.530868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.531520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.531798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.532718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.533406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.538919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.556124 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2759/5521] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:49.561012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.565934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.610606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392657c2-fdc8-40ae-966c-c3d307d2a2fd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.671275 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:49.700768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.702094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.702381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.702655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.705251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0308c-3cf4-484c-bdcf-d3c1db1695be admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.707190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.710856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.711618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.712133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.712537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.721803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.723190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.725787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.727563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.738400 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2763/5522] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:49.739275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2760/5523] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:49.740529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.741054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.741993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:49.762332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39e3f-cd93-41ad-8656-6d69894cb892 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.768667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db530ee-6143-47db-94d4-bab354f63965 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.777230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.778425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.778702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.778970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] PATH_INFO: `/v3/projects/8a0f8b357f174f559084ef648b246202` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.781111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0f8b357f174f559084ef648b246202)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.786048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.787132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.787411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.787700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.788350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.789421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.790033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:49.802106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2764/5524] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:49.807129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:49.827428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b78fe7-c2e6-47cf-a6a3-a942248eb3a4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:49.839925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:49.840620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:49.840891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:49.841169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] PATH_INFO: `/v3/projects/aa0dcee2948d4be382415678882c9bb1/users/98686ad909e64ef2be4ea1339d571d4c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:49.859474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0dcee2948d4be382415678882c9bb1, user_id=98686ad909e64ef2be4ea1339d571d4c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:49.863010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024b73a-4e77-4198-bb46-25f53883d0f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:50.143761 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2765/5525] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:49 2022] PUT /identity/v3/projects/aa0dcee2948d4be382415678882c9bb1/users/98686ad909e64ef2be4ea1339d571d4c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:50.154869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:50.155128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:50.155408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:50.206714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0f8b357f174f559084ef648b246202', 'request_id': 'req-01b71644-cf46-4484-8c6b-c2904b6b38f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.219035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0f8b357f174f559084ef648b246202', 'request_id': 'req-01b71644-cf46-4484-8c6b-c2904b6b38f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.240342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] MFA Rules not processed for user `98686ad909e64ef2be4ea1339d571d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:50.241615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:50.314369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0f8b357f174f559084ef648b246202', 'request_id': 'req-01b71644-cf46-4484-8c6b-c2904b6b38f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.334223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] The token cache is being invalidate because project 8a0f8b357f174f559084ef648b246202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:50.334517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.335339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.340445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2761/5526] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:49 2022] DELETE /identity/v3/projects/8a0f8b357f174f559084ef648b246202 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:50.344268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:50.349474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:50.419978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2766/5527] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:50.466346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:50.467972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:50.510870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71644-cf46-4484-8c6b-c2904b6b38f1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:50.520379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:50.521738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:50.522335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:50.522614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] PATH_INFO: `/v3/users/a2355930aa5e49719556606954d41134` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:50.523811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2355930aa5e49719556606954d41134)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:50.526019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:50.533837 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:50.607907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988813d2-55f5-4d40-ad9f-479ebf7f1c3a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:50.616391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:50.617065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:50.617368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:50.617653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:50.647754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:50.649246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:50.666362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2767/5528] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:41:50.667272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:50.676200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:50.695544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bfd58-6966-41b7-bb98-aa8654c37c16 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:50.706470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:50.708955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:50.709246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:50.712176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] PATH_INFO: `/v3/projects/88bd1f7c254e42b5b01150436f6f0ae2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:50.716833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bd1f7c254e42b5b01150436f6f0ae2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:50.722513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:50.864640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2355930aa5e49719556606954d41134'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.868066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2355930aa5e49719556606954d41134'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.885733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2355930aa5e49719556606954d41134'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.886738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2355930aa5e49719556606954d41134'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.948323 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:50.967338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2355930aa5e49719556606954d41134'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:50.996447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bd1f7c254e42b5b01150436f6f0ae2', 'request_id': 'req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.017545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2762/5529] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:50 2022] DELETE /identity/v3/users/a2355930aa5e49719556606954d41134 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:51.026281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:51.032365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:51.107278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bd1f7c254e42b5b01150436f6f0ae2', 'request_id': 'req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.117230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bd1f7c254e42b5b01150436f6f0ae2', 'request_id': 'req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.143021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] The token cache is being invalidate because project 88bd1f7c254e42b5b01150436f6f0ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:51.143331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.144754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.153772 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2768/5530] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:50 2022] DELETE /identity/v3/projects/88bd1f7c254e42b5b01150436f6f0ae2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:51.154818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:51.157979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:51.227387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ed9cb-4882-4c82-ab91-00384f0848e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:51.240304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:51.242435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:51.243272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:51.243568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] PATH_INFO: `/v3/users/98686ad909e64ef2be4ea1339d571d4c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:51.246960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98686ad909e64ef2be4ea1339d571d4c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:51.252927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:51.336918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a073a35-bba4-4c59-8cf1-1ba0794d44bc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:51.345676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:51.346956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:51.347644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:51.348308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] PATH_INFO: `/v3/users/9a436f2871d8443bb2ab8caec14cfbc4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:51.353779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a436f2871d8443bb2ab8caec14cfbc4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:51.356075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:51.527908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98686ad909e64ef2be4ea1339d571d4c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.529082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98686ad909e64ef2be4ea1339d571d4c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.545765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98686ad909e64ef2be4ea1339d571d4c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.550729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98686ad909e64ef2be4ea1339d571d4c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.596331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a436f2871d8443bb2ab8caec14cfbc4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.696665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de1db936-f7e7-4b64-a0fa-91a79fdde46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98686ad909e64ef2be4ea1339d571d4c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.717740 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:51.725721 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2763/5531] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:51 2022] DELETE /identity/v3/users/98686ad909e64ef2be4ea1339d571d4c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:51.730172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:51.730496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:51.730781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:51.772433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:51.773933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:51.779431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a436f2871d8443bb2ab8caec14cfbc4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.780151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a436f2871d8443bb2ab8caec14cfbc4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.802311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a436f2871d8443bb2ab8caec14cfbc4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.816086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a436f2871d8443bb2ab8caec14cfbc4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:51.828400 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2769/5532] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:51 2022] DELETE /identity/v3/users/9a436f2871d8443bb2ab8caec14cfbc4 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:51.903058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2764/5533] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:51.929905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:51.931975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:52.075036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaebb2-1b7d-4857-8663-e010f4e4dc3b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:52.082155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:52.083101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.083597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.084075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.184619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:52.186778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:52.212979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60e15c-048b-4258-a57a-e7cdbc4cc13e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:52.230126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:52.231634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4afbe-265a-46fb-937f-2d58a89afb00 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:52.232380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:52.233084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.233402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.233738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] PATH_INFO: `/v3/projects/ea8dc1ba7d0a4879966488880b5695bf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.234837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea8dc1ba7d0a4879966488880b5695bf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:52.238426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:52.247935 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2770/5534] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:52.301289 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:52.432295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea8dc1ba7d0a4879966488880b5695bf', 'request_id': 'req-633c04a6-9d7e-44b0-83d4-529b95888379'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:52.444073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea8dc1ba7d0a4879966488880b5695bf', 'request_id': 'req-633c04a6-9d7e-44b0-83d4-529b95888379'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:52.520176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea8dc1ba7d0a4879966488880b5695bf', 'request_id': 'req-633c04a6-9d7e-44b0-83d4-529b95888379'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:52.549968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] The token cache is being invalidate because project ea8dc1ba7d0a4879966488880b5695bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:52.550637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:52.551683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:52.554075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2765/5535] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:52 2022] DELETE /identity/v3/projects/ea8dc1ba7d0a4879966488880b5695bf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:52.559105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c87c-d9c9-4dbd-8ef1-3346205f4ec6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.559897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c87c-d9c9-4dbd-8ef1-3346205f4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.560389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64c87c-d9c9-4dbd-8ef1-3346205f4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.593294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7d64c87c-d9c9-4dbd-8ef1-3346205f4ec6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:52.596308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7d64c87c-d9c9-4dbd-8ef1-3346205f4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:52.651093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:52.652817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:52.816056 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2771/5536] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:52.817626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.817918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.818192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.831336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c04a6-9d7e-44b0-83d4-529b95888379 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:52.845373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:52.846119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.846484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.846802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] PATH_INFO: `/v3/projects/22ccf364e0c041c5a0e6321378e9b583` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.849534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ccf364e0c041c5a0e6321378e9b583)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:52.855500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:52.870165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:52.872374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:52.903218 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2772/5537] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:52.913685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:52.950309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f45f0e-b640-4f42-9b69-010a5064985c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:52.969177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:52.972210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:52.972746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:52.973177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:52.975717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:41:52.976209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:52.982058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.010779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2773/5538] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:41:53.014092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.046521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907789b-40c8-400f-ae77-6307bcb8771d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.054509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.055256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.056086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.056454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.057177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.060381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.066644 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:53.094209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ccf364e0c041c5a0e6321378e9b583', 'request_id': 'req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.106201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ccf364e0c041c5a0e6321378e9b583', 'request_id': 'req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.217213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2774/5539] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:41:53 2022] POST /identity/v3/projects => generated 359 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:41:53.221367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.229938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ccf364e0c041c5a0e6321378e9b583', 'request_id': 'req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.250483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] The token cache is being invalidate because project 22ccf364e0c041c5a0e6321378e9b583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:53.252601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.254337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b87b20a5-c547-45b0-8cfa-5cd35c0e7901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.257236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2766/5540] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:52 2022] DELETE /identity/v3/projects/22ccf364e0c041c5a0e6321378e9b583 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:53.263283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89857f-262c-4a86-83b8-e6a07bef4a46 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.269422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89857f-262c-4a86-83b8-e6a07bef4a46 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.269422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89857f-262c-4a86-83b8-e6a07bef4a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.320682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e89857f-262c-4a86-83b8-e6a07bef4a46 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:53.322873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e89857f-262c-4a86-83b8-e6a07bef4a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:53.436367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c958ee-12e1-4fa9-a909-82417e165583 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.456447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.457088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.457383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.457658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.462474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.467663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.537451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2767/5541] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:53.545730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.547039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.548471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.577704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:53.582379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:53.599571 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2768/5542] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:41:53.601829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.606335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:53.620196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cb806-14cd-49bb-9f2a-1de91a0eb2c5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.629026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.630397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.630800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.640629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] PATH_INFO: `/v3/projects/aa0dcee2948d4be382415678882c9bb1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.640629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0dcee2948d4be382415678882c9bb1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.640629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.666133 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2775/5543] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:41:53 2022] POST /identity/v3/users => generated 280 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:53.667216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.687803 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:53.698368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38da99a-d8fd-400a-b721-3dc79209a411 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.719670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.720690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.720690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.721061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.721767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:41:53.722074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.726014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.763020 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2776/5544] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:41:53.763722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.769014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:53.794554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de64e-d0e1-4594-9e37-0d2feb5d9623 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.801501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.802165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.802447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.802720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.803387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.805382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.819353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2777/5545] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:53.819933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:53.844799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06ddb-17a2-42d5-8ba3-cf8199bc867f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:53.849269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0dcee2948d4be382415678882c9bb1', 'request_id': 'req-6619f3e5-65ab-48ab-bad3-38fde880aa2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.856938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0dcee2948d4be382415678882c9bb1', 'request_id': 'req-6619f3e5-65ab-48ab-bad3-38fde880aa2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.930641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:53.931473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:53.933808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:53.933808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:53.933808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:53.935756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d7704-92f4-4772-8b0d-613d688e1e0d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:53.953079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0dcee2948d4be382415678882c9bb1', 'request_id': 'req-6619f3e5-65ab-48ab-bad3-38fde880aa2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.977957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] The token cache is being invalidate because project aa0dcee2948d4be382415678882c9bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:53.978673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:53.979724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:54.000079 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2769/5546] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:53 2022] DELETE /identity/v3/projects/aa0dcee2948d4be382415678882c9bb1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:54.000079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.000079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:54.024056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f3e5-65ab-48ab-bad3-38fde880aa2f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.042144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.042956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.043319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.043692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.044474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.049007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.072651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2778/5547] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:41:53 2022] POST /identity/v3/projects => generated 361 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:54.072944 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2770/5548] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:54.074303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.074633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.075107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.078597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.081954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:54.114292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05574075-082a-41ba-bd04-a697e61af055 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.124474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:54.127615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:54.267172 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2779/5549] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:54.268051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.268763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.269487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.269779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.270044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.270681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.276382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb664ce-4f60-4144-aef9-1960578f05b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.291019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b954a-4e31-44ce-88b9-950a2d6fe1e7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.300152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.300952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.301238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.301637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] PATH_INFO: `/v3/projects/96ab65c6974646538880a78b5459bfe2/users/417069e9e2ef476b8be538f97bb66276/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.320539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ab65c6974646538880a78b5459bfe2, user_id=417069e9e2ef476b8be538f97bb66276, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.323405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.430232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2771/5550] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:41:54 2022] POST /identity/v3/users => generated 281 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:54.434741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.435019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.435300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.452021 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2780/5551] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:54 2022] PUT /identity/v3/projects/96ab65c6974646538880a78b5459bfe2/users/417069e9e2ef476b8be538f97bb66276/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:54.457779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.502718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:54.504275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:54.573133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f6d3-f034-48f2-a442-52e771a3bfca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.585009 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:54.590338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.591461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.591837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.592607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.596065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.600730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1b462-e905-4a94-afec-d93411b59c3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.621945 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2781/5552] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:54.621945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.621945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.621945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.630751 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2772/5553] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:54.631679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.652593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0905-b883-46eb-af96-7f470b5af039 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.663238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.663859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.664189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.664466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.665120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.668412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.697370 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2773/5554] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:54.697370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.710843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] MFA Rules not processed for user `417069e9e2ef476b8be538f97bb66276`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:54.716995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:54.718915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a7d0-70f8-45c9-9a47-336d1ee82ca3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.734253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.736029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.736335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.736608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.738474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:41:54.738784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.742259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.771524 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2774/5555] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:41:54.775697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.809014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030a42-da75-42a5-afa1-5d0c335695e4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.827375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:54.833280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:54.833280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:54.833280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] PATH_INFO: `/v3/projects/ad9e93fed0754b49b736b0bf01cb5e8e/users/e1cb499d7e1543c6abd85edbba430260/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:54.858400 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:54.887807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9e93fed0754b49b736b0bf01cb5e8e, user_id=e1cb499d7e1543c6abd85edbba430260, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:54.891170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:54.946778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2782/5556] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:54.948685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:54.980302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606937f-4f13-4aa6-a9e7-3a69d33390af None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:54.988615 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2775/5557] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:54 2022] PUT /identity/v3/projects/ad9e93fed0754b49b736b0bf01cb5e8e/users/e1cb499d7e1543c6abd85edbba430260/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:54.997707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:55.001263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:55.092343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e064ba7-619f-43b6-bf3c-d37862700092 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:55.114753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:55.115872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.116464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.116810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.196010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:55.197947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a0f88-b792-4bbc-83ae-960efb850950 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:55.212057 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2776/5558] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:55.214993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.216357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.216798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.262157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:55.262796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.263090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.263345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.263983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:55.265923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:55.311685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] MFA Rules not processed for user `e1cb499d7e1543c6abd85edbba430260`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:55.316283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:55.452185 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2783/5559] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:41:54 2022] POST /identity/v3/projects => generated 405 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:55.456829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:55.540655 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2777/5560] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:55.545724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:55.579754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc2b3-4279-43f2-aa38-a1908a09fa1d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:55.635892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cc6e4-35b6-40fc-857e-4cc552bc962f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:55.648466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:55.650785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.653875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.653875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] PATH_INFO: `/v3/users/417069e9e2ef476b8be538f97bb66276` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.656028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=417069e9e2ef476b8be538f97bb66276)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:55.663983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:55.707739 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:55.778059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:55.778712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.778976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.779248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.779883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:55.781877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:55.913741 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2778/5561] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:41:55 2022] POST /identity/v3/users => generated 303 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:55.914642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:55.972305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219f64-502f-41ac-a5ec-0ca67149ed49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:55.990082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:55.991038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:55.991551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:55.992652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:55.993490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:55.995725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:56.145707 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:56.178869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417069e9e2ef476b8be538f97bb66276'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:56.191871 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2779/5562] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:41:55 2022] POST /identity/v3/projects => generated 361 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:56.193046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:56.264966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417069e9e2ef476b8be538f97bb66276'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:56.265683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417069e9e2ef476b8be538f97bb66276'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:56.291428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417069e9e2ef476b8be538f97bb66276'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:56.322853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-678844ca-6581-4499-9bdf-9f18cbe6e45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417069e9e2ef476b8be538f97bb66276'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:56.336272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2784/5563] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:41:55 2022] DELETE /identity/v3/users/417069e9e2ef476b8be538f97bb66276 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:56.337584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d1c-7683-4ab8-b5d2-b9f29cdbf401 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:56.337866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d1c-7683-4ab8-b5d2-b9f29cdbf401 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:56.338736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d1c-7683-4ab8-b5d2-b9f29cdbf401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:56.421663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35360f2-1eb0-4a43-b014-bb3c7c2cf727 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:56.451824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c2552d1c-7683-4ab8-b5d2-b9f29cdbf401 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:56.457927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c2552d1c-7683-4ab8-b5d2-b9f29cdbf401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:56.704609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:56.705256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:56.705555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:56.705828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:56.706508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:56.716704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:56.748824 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2780/5564] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:56.751023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:56.768354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:56.798733 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2785/5565] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:56.802642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:56.802642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:56.814628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:56.814911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc107249-a773-44b0-a5d4-482959c9eee2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:56.864843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:56.865805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:56.866233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:56.866655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:56.867542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:56.870076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:56.906337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:57.051405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:57.051405 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2786/5566] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:57.051405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.051405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:57.051405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746cbd3-5f38-4bf0-b242-ffa4922d5e10 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.052889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.052889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.052889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.052889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.055228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.055228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.055228 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2787/5567] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:57.055228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.055228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:57.067330 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:57.184919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc0775-407c-4fa3-a75e-e464b26213f3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.202081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.203085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.204193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.205072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.240927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.244190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.258449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2788/5568] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:41:57.259295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.260761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:57.278298 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2781/5569] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:41:56 2022] POST /identity/v3/users => generated 287 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:41:57.279280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.297906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ccd1c-5f3e-4e59-b04a-ebd896ea576d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.303745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.304627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.305065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.305737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] PATH_INFO: `/v3/projects/112ac44144ed43d9836d36cc6af1c2ec/users/540b0ddd370048adae27aa610bf76b9c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.325103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112ac44144ed43d9836d36cc6af1c2ec, user_id=540b0ddd370048adae27aa610bf76b9c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.329643 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:57.338317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7c307-f6ab-495f-b36e-b95505487180 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.356304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc12714-cf64-4a56-8501-81bf39499942 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.362830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.363405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.363746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.364114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.384128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.387580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.400760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2789/5570] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:57.401528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.416504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee56a7-ccf4-4cc9-8059-33f902197554 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.421942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.422703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.423052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.423391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.424122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.426137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.441083 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2790/5571] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:57.446104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.462402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2782/5572] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:57 2022] PUT /identity/v3/projects/112ac44144ed43d9836d36cc6af1c2ec/users/540b0ddd370048adae27aa610bf76b9c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:57.467638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.467929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.468216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.488422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b22fc1-3df1-424a-9067-47485a6b149d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:57.564441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:57.576541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:57.667832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:57.667832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:57.667832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:57.667832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] PATH_INFO: `/v3/projects/121297e7f65044e680bdfa622cbd3346/users/7e12983787c54b25bce8f2b158036d1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:57.696060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=121297e7f65044e680bdfa622cbd3346, user_id=7e12983787c54b25bce8f2b158036d1e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:57.710656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:57.750834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2783/5573] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:41:57.784721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:57.827711 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2791/5574] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:57 2022] PUT /identity/v3/projects/121297e7f65044e680bdfa622cbd3346/users/7e12983787c54b25bce8f2b158036d1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:57.829511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:58.135285 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:58.150649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08908cc-52ca-47c4-bc31-f1b937e2f519 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:58.165156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fdc22-9542-4a86-96c5-d466ffb849ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:58.205156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:58.205929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:58.206204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:58.207154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:58.216970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:58.218975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:58.271270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2792/5575] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:41:58.276952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:58.292670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:58.314672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cb692-7019-4a6d-8849-f06d35383344 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:58.333604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:58.333604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:58.333881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:58.334144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:58.339844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:58.340645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:58.340927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:58.347910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] PATH_INFO: `/v3/projects/121297e7f65044e680bdfa622cbd3346/users/7e12983787c54b25bce8f2b158036d1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:58.356734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121297e7f65044e680bdfa622cbd3346, user_id=7e12983787c54b25bce8f2b158036d1e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:58.360552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:58.361009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:58.362765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf85b07-85c8-4bcd-bbb0-76735792240b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:58.394163 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2784/5576] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:58.423461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2793/5577] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:41:58 2022] PUT /identity/v3/projects/121297e7f65044e680bdfa622cbd3346/users/7e12983787c54b25bce8f2b158036d1e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:58.439243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:58.439526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:58.439803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:58.530205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] MFA Rules not processed for user `7e12983787c54b25bce8f2b158036d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:58.531445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:58.746685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2785/5578] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:58.762889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:58.764254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:58.816532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:58.818225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:58.995536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010f740-f27c-46c0-9372-0370608e09b6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:59.007135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:59.007769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:59.008050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:59.008348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:59.023195 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:41:59.042515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:59.046557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4404e-2069-48fe-beca-047cbf4fff2e service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:59.059929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e5594-dcb5-4c19-bd37-58657c9a36a7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:41:59.081867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2794/5579] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:41:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:41:59.082705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:41:59.083361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:59.083645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:59.083925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] PATH_INFO: `/v3/projects/96ab65c6974646538880a78b5459bfe2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:59.089105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ab65c6974646538880a78b5459bfe2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:41:59.091064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:41:59.314341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ab65c6974646538880a78b5459bfe2', 'request_id': 'req-f8f47cf2-4497-45a8-8f80-dd4da9521390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:59.332194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ab65c6974646538880a78b5459bfe2', 'request_id': 'req-f8f47cf2-4497-45a8-8f80-dd4da9521390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:59.398852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ab65c6974646538880a78b5459bfe2', 'request_id': 'req-f8f47cf2-4497-45a8-8f80-dd4da9521390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:59.427179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] The token cache is being invalidate because project 96ab65c6974646538880a78b5459bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:41:59.427806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:59.430113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f8f47cf2-4497-45a8-8f80-dd4da9521390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:41:59.433814 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2786/5580] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:41:58 2022] DELETE /identity/v3/projects/96ab65c6974646538880a78b5459bfe2 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:41:59.439533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:59.440520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:59.441240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:59.504835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:59.508155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:59.755520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2795/5581] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:41:59.759031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:41:59.759506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:41:59.759774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:41:59.796245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:41:59.798422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:41:59.823310 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2787/5582] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:41:59.829223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:41:59.848053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebe7d2-a4c8-48e6-a129-03492600686d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.191324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.191324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.191324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.191324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.235956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:00.235956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.235956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:00.235956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2796/5583] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:00.237766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:00.237766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60705a0c-3167-4ce4-8e8e-49d3cd062df3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.237766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.237766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.238738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.238738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.238738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.238738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:00.360752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:00.370344 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2788/5584] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:00 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:00.401115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b3f1-573a-484b-9bbb-f11fc763c62a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.459214 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:00.565186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.566297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.566800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.567342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.570718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.573001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:00.688443 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2797/5585] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:00 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:00.705467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:00.725207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7f5e-01f5-4e41-8dc0-11e953b9a87b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.749217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.749217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.749217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.749217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.749759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.754763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:00.794820 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2789/5586] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:00.798240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:00.816074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56c52f-fc2c-4099-8a75-eab3388c4638 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.832312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.832312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.832312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.832312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.832761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.834065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f34f2-05d1-4789-86f5-82c11d2ec1f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:00.848478 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2798/5587] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:00.854404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:00.885103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a4b4-87c8-48f2-990e-0a8844c3969c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:00.924770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:00.925552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:00.925833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:00.926114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] PATH_INFO: `/v3/projects/0407cd0c81cb4985b44c533303f987f2/users/3f2305e0bb7c479399344e45a96a333b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:00.974955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0407cd0c81cb4985b44c533303f987f2, user_id=3f2305e0bb7c479399344e45a96a333b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:00.987371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:01.181102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2790/5588] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:00 2022] PUT /identity/v3/projects/0407cd0c81cb4985b44c533303f987f2/users/3f2305e0bb7c479399344e45a96a333b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:01.182606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:01.182896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:01.183172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:01.225545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:01.228974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:01.300677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] MFA Rules not processed for user `3f2305e0bb7c479399344e45a96a333b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:01.304128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:01.401709 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:01.435415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934cb38-92e6-4d2f-be0f-dc05bd664aa1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:01.450611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:01.457760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:01.457760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:01.457760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] PATH_INFO: `/v3/users/e1cb499d7e1543c6abd85edbba430260` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:01.457760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cb499d7e1543c6abd85edbba430260)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:01.461919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:01.503817 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2799/5589] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:42:01.517348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:01.525707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:01.647673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150475bc-42a6-4e15-89ad-1e4f096c164c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:01.659148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:01.661423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:01.661954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:01.663045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:01.684299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:01.688205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b7cc-f538-4def-9eec-11ab67d09b07 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:01.756863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2800/5590] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:01.763972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:01.768334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:01.768620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:01.792576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cb499d7e1543c6abd85edbba430260'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:01.793993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cb499d7e1543c6abd85edbba430260'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:01.823376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cb499d7e1543c6abd85edbba430260'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:01.824938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cb499d7e1543c6abd85edbba430260'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:01.873642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] MFA Rules not processed for user `540b0ddd370048adae27aa610bf76b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:01.878175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:01.950872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dae178f4-2bd7-439a-b50a-7d7f5e3622e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cb499d7e1543c6abd85edbba430260'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:01.998653 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2791/5591] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:01 2022] DELETE /identity/v3/users/e1cb499d7e1543c6abd85edbba430260 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:02.001882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:02.002175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:02.002639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:02.019940 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:02.125224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:02.140577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:02.319948 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2801/5592] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:02.324490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:02.335687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:02.364635 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2792/5593] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:02.368037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a75750-7aed-4051-a6a2-6804dfbc37e1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:02.376153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:02.380741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:02.383277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:02.383913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:02.384678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:02.384957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:02.387056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:02.389782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:02.518050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2802/5594] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:02 2022] POST /identity/v3/projects => generated 405 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:02.523566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:02.621755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df44ef-23dd-412a-a86d-3de1ea2e2278 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:02.632802 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:02.762587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78682bb-1cf8-4984-a24a-a740ca2f118c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:02.778050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:02.778674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:02.778965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:02.779230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:02.779877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:02.781945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:02.782253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:02.783516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:02.786674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:02.787341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:02.828246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:02.830791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:02.858388 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2793/5595] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:02.949056 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2803/5596] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:02 2022] POST /identity/v3/users => generated 309 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:02.949199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:02.961545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940e314-e3dd-4dd4-8d7c-e48f1c39a45b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:02.969392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:02.970506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:02.971024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:02.971477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:02.972299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:02.974212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:02.993365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2794/5597] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:03.001405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:03.024602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c405e0-c39d-4fed-a7ea-b4294997bd7c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:03.041526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:03.042212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:03.042567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:03.042984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] PATH_INFO: `/v3/projects/a737da9769c445ecb6709f10cb65a6ad/users/a2183c9f57b347d2b1f569cdd5f01f93/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:03.093672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a737da9769c445ecb6709f10cb65a6ad, user_id=a2183c9f57b347d2b1f569cdd5f01f93, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:03.097894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:03.205365 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2804/5598] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:02 2022] PUT /identity/v3/projects/a737da9769c445ecb6709f10cb65a6ad/users/a2183c9f57b347d2b1f569cdd5f01f93/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:03.206983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:03.222550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c4ee2-8024-441b-8d24-b98d2e60a105 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:03.380235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:03.382033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:03.383977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:03.386713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:03.389161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:03.396636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:03.447755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2795/5599] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:03.448811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:03.519724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db7e4-d4db-4e59-8c2c-1563e3e9961a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:03.556263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:03.557699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:03.558214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:03.559443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] PATH_INFO: `/v3/projects/a737da9769c445ecb6709f10cb65a6ad/users/a2183c9f57b347d2b1f569cdd5f01f93/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:03.564369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a737da9769c445ecb6709f10cb65a6ad, user_id=a2183c9f57b347d2b1f569cdd5f01f93, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:03.576371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:03.674873 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2805/5600] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:03 2022] PUT /identity/v3/projects/a737da9769c445ecb6709f10cb65a6ad/users/a2183c9f57b347d2b1f569cdd5f01f93/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:04.414060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:04.416026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:04.445003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b021-b4e8-48ef-a706-2a53b2b1ed72 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:04.574965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:04.576566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:04.577685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:04.578652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] PATH_INFO: `/v3/projects/ad9e93fed0754b49b736b0bf01cb5e8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:04.581103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9e93fed0754b49b736b0bf01cb5e8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:04.584382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:04.819040 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:04.834756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9e93fed0754b49b736b0bf01cb5e8e', 'request_id': 'req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:04.852521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9e93fed0754b49b736b0bf01cb5e8e', 'request_id': 'req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:04.964660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9e93fed0754b49b736b0bf01cb5e8e', 'request_id': 'req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:04.994208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] The token cache is being invalidate because project ad9e93fed0754b49b736b0bf01cb5e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:04.999747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.003235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2e6d31bc-7d11-41e2-8ad6-19a395cf1585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.010469 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2796/5601] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:04 2022] DELETE /identity/v3/projects/ad9e93fed0754b49b736b0bf01cb5e8e => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:05.016470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:05.017543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:05.062592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971819c-f5d3-40af-869a-8c81dcd2aeb9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:05.303145 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:05.340602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:05.341277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:05.341586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:05.341863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] PATH_INFO: `/v3/users/7e12983787c54b25bce8f2b158036d1e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:05.351545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e12983787c54b25bce8f2b158036d1e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:05.356385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:05.646421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e12983787c54b25bce8f2b158036d1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.762311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e12983787c54b25bce8f2b158036d1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.766340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e12983787c54b25bce8f2b158036d1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.810036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e12983787c54b25bce8f2b158036d1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.846614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e12983787c54b25bce8f2b158036d1e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:05.864765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2806/5602] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:05 2022] DELETE /identity/v3/users/7e12983787c54b25bce8f2b158036d1e => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:07.053185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9294a6-c1a8-4686-bb6d-9c8b29b65b48 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:07.053185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9294a6-c1a8-4686-bb6d-9c8b29b65b48 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:07.053185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9294a6-c1a8-4686-bb6d-9c8b29b65b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:07.134531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5f9294a6-c1a8-4686-bb6d-9c8b29b65b48 None None] MFA Rules not processed for user `a2183c9f57b347d2b1f569cdd5f01f93`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:07.136000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f9294a6-c1a8-4686-bb6d-9c8b29b65b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:07.335451 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2797/5603] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:07.361993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:07.364060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:07.591058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3f14f-4a05-42a1-91af-de04f60d5c0c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:07.607337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:07.607904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:07.608190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:07.608461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] PATH_INFO: `/v3/projects/121297e7f65044e680bdfa622cbd3346` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:07.612981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] RBAC: Authorizing `identity:delete_project(project_id=121297e7f65044e680bdfa622cbd3346)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:07.615038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:07.957670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121297e7f65044e680bdfa622cbd3346', 'request_id': 'req-e407361f-3cf4-415c-a081-9b20d2b8303e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:08.046702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121297e7f65044e680bdfa622cbd3346', 'request_id': 'req-e407361f-3cf4-415c-a081-9b20d2b8303e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:08.055902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121297e7f65044e680bdfa622cbd3346', 'request_id': 'req-e407361f-3cf4-415c-a081-9b20d2b8303e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:08.122118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] The token cache is being invalidate because project 121297e7f65044e680bdfa622cbd3346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:08.122311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:08.122999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e407361f-3cf4-415c-a081-9b20d2b8303e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:08.127792 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2807/5604] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:07 2022] DELETE /identity/v3/projects/121297e7f65044e680bdfa622cbd3346 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:08.129476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:08.129937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:08.130017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:08.259505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:08.260919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:08.492081 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2798/5605] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:08.500915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e354f-955e-4a66-b5bd-405043814847 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:08.501474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e354f-955e-4a66-b5bd-405043814847 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:08.501474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e354f-955e-4a66-b5bd-405043814847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:08.512190 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:08.525952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-518e354f-955e-4a66-b5bd-405043814847 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:08.527606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-518e354f-955e-4a66-b5bd-405043814847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:08.548023 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2808/5606] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:08.550938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:08.572193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487d953-35d4-43f0-a421-fb6244a03be1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:08.585372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:08.586014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:08.586297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:08.586573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:08.587235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:08.587551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:08.589168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:08.637085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2799/5607] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:42:08.637292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e354f-955e-4a66-b5bd-405043814847 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:08.654552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e354f-955e-4a66-b5bd-405043814847 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:08.675200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:08.676176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:08.676645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:08.677109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:08.677986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:08.682802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f8d0d-178a-4bdb-bff9-e71032d07797 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:08.826462 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2809/5608] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:08 2022] POST /identity/v3/projects => generated 365 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:08.832452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:08.844063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84184582-0127-4e53-825f-7ba08410476e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:08.940981 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:09.058714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.059417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.059777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.060279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.061113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:09.066125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:09.124714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.125036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.125576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.200839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:09.203486 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2800/5609] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:08 2022] POST /identity/v3/users => generated 283 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:09.204739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:09.207191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:09.230429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac7c8-bd7c-487f-acc5-857bd2b5d4a3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:09.250221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.251693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.252205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.252695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.253586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:09.255444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:09.331718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2801/5610] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:09.332728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:09.353552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b6395-62d7-407e-a5cf-9e3b8ea465be admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:09.366901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2810/5611] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:42:09.372657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.373552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.373991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.375463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.379437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:09.382709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:09.428435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:09.436988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2802/5612] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:09.441117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:09.444653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff661e2-9edc-4647-927c-ac7562ec27c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:09.445379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:09.456900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.457698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.458065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.458901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] PATH_INFO: `/v3/projects/d848a2b7dede4cecb8bacfb316ef7944/users/75d86a8ce2184bc68dc8011c943eddeb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.498172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d848a2b7dede4cecb8bacfb316ef7944, user_id=75d86a8ce2184bc68dc8011c943eddeb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:09.501279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e3edf-5850-4e68-a075-79ac60a91e14 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:09.592299 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2811/5613] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:09 2022] PUT /identity/v3/projects/d848a2b7dede4cecb8bacfb316ef7944/users/75d86a8ce2184bc68dc8011c943eddeb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:09.603383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.603704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.603917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.660263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] MFA Rules not processed for user `75d86a8ce2184bc68dc8011c943eddeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:09.662869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:09.748302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa14d2c-7fed-459c-98c0-64e9b8f04b4c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:09.854857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2812/5614] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:09.855854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:09.935721 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:09.957280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.959725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.961598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.962062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.978785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a0b28-3a9b-4f18-800b-648d8aa58b39 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:09.991167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:09.993797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:09.995682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:09.996277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:09.998293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:10.003242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:10.071320 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:10.097797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:10.099762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:10.112045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2803/5615] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:42:10.245651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2813/5616] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:09 2022] POST /identity/v3/projects => generated 363 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:10.250636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:10.281919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e134e0-a626-41a1-a36f-aaa2ca47370a service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:10.508030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:10.513180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:10.513414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:10.514216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:10.518290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:10.523681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:10.679199 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2804/5617] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:10 2022] POST /identity/v3/users => generated 288 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:10.685030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:10.701955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d98028-1d78-459d-aeec-0893e455eae5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:10.720889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:10.724697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:10.724985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:10.726790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:10.727694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:10.734155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:10.778719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:10.784353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2814/5618] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:10.797213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e14a-2e1a-4488-a1c4-685d5ff02be6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:10.810114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:10.811926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:10.812220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:10.817162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] PATH_INFO: `/v3/projects/b62c7c658cc64c309db1739786c91c22/users/01e4d25c70a54456bfe433003db3e446/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:10.846484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62c7c658cc64c309db1739786c91c22, user_id=01e4d25c70a54456bfe433003db3e446, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:10.849145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:10.930256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:10.938626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2805/5619] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:10 2022] PUT /identity/v3/projects/b62c7c658cc64c309db1739786c91c22/users/01e4d25c70a54456bfe433003db3e446/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:10.947395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f77f68-3e27-43d0-9593-f9f40f40e4e3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:11.100466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:11.103906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:11.105152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:11.115350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:11.118463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:11.120392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80ada-9b76-48e0-9d8d-ce0c98346ea4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:11.136129 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2815/5620] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:42:11.139544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:11.157290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994020bd-068e-43f8-8604-8e43e9277f86 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:11.190181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:11.190868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:11.191145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:11.191421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] PATH_INFO: `/v3/projects/b62c7c658cc64c309db1739786c91c22/users/01e4d25c70a54456bfe433003db3e446/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:11.198210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62c7c658cc64c309db1739786c91c22, user_id=01e4d25c70a54456bfe433003db3e446, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:11.207532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:11.254421 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2806/5621] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:11 2022] PUT /identity/v3/projects/b62c7c658cc64c309db1739786c91c22/users/01e4d25c70a54456bfe433003db3e446/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:11.266866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:11.267068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:11.281739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:11.363591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] MFA Rules not processed for user `01e4d25c70a54456bfe433003db3e446`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:11.399435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:11.650077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:11.652158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:11.787535 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2816/5622] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:11.816899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:11.818430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:11.866394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087b3b-45b0-4a05-925b-a9940db61158 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:11.880355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:11.881210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:11.883154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:11.883588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] PATH_INFO: `/v3/users/540b0ddd370048adae27aa610bf76b9c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:11.891186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=540b0ddd370048adae27aa610bf76b9c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:11.893366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:11.993808 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:12.033529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9546-0267-4ce2-b27b-b79e3d8b8da3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:12.047776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:12.048414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:12.050482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:12.050482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:12.095238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:12.096745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:12.099519 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:12.121809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540b0ddd370048adae27aa610bf76b9c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:12.124408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540b0ddd370048adae27aa610bf76b9c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:12.143961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2817/5623] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:12.144956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540b0ddd370048adae27aa610bf76b9c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:12.145968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540b0ddd370048adae27aa610bf76b9c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:12.219381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540b0ddd370048adae27aa610bf76b9c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:12.244077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2807/5624] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:11 2022] DELETE /identity/v3/users/540b0ddd370048adae27aa610bf76b9c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:12.639155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:12.700547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d4379-1b64-4566-849d-565db5562ebb service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:13.013175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:13.013816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:13.013988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:13.014390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:13.014390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:13.015532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:13.029326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:13.176379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc2fa-3adb-4fce-a37a-9e6c063fbdfc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:13.190297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:13.191751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:13.195643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:13.196282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:13.196567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:13.196831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] PATH_INFO: `/v3/projects/112ac44144ed43d9836d36cc6af1c2ec` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:13.200286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] RBAC: Authorizing `identity:delete_project(project_id=112ac44144ed43d9836d36cc6af1c2ec)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:13.202228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:13.226723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2818/5625] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:13.480701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112ac44144ed43d9836d36cc6af1c2ec', 'request_id': 'req-becb241f-fc95-4ede-87f2-cce157f7800d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:13.488019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112ac44144ed43d9836d36cc6af1c2ec', 'request_id': 'req-becb241f-fc95-4ede-87f2-cce157f7800d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:13.572359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112ac44144ed43d9836d36cc6af1c2ec', 'request_id': 'req-becb241f-fc95-4ede-87f2-cce157f7800d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:13.595411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] The token cache is being invalidate because project 112ac44144ed43d9836d36cc6af1c2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:13.595706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:13.596508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:13.600567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2808/5626] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:13 2022] DELETE /identity/v3/projects/112ac44144ed43d9836d36cc6af1c2ec => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:13.604268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:13.632949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f14cdb-e597-47d3-85bf-1e928bc6e2e0 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:13.872406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:13.873131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:13.875640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:13.875747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] PATH_INFO: `/v3/users/a2183c9f57b347d2b1f569cdd5f01f93` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:13.884280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2183c9f57b347d2b1f569cdd5f01f93)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:13.888274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:14.214784 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:14.245750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2183c9f57b347d2b1f569cdd5f01f93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:14.362874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2183c9f57b347d2b1f569cdd5f01f93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:14.363921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2183c9f57b347d2b1f569cdd5f01f93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:14.381470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2183c9f57b347d2b1f569cdd5f01f93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:14.395649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2183c9f57b347d2b1f569cdd5f01f93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:14.428919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2819/5627] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:13 2022] DELETE /identity/v3/users/a2183c9f57b347d2b1f569cdd5f01f93 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:14.878308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:14.880268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:14.904991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb241f-fc95-4ede-87f2-cce157f7800d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:14.920972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:14.920972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:15.002256 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:15.056430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:15.057518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:15.058251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:15.059897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] PATH_INFO: `/v3/users/3f2305e0bb7c479399344e45a96a333b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:15.061476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2305e0bb7c479399344e45a96a333b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:15.067263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:15.080258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d352c8b-81ed-4347-95a6-343989d3296a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:15.107173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:15.108662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:15.111134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:15.111799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] PATH_INFO: `/v3/projects/a737da9769c445ecb6709f10cb65a6ad` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:15.114080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a737da9769c445ecb6709f10cb65a6ad)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:15.122385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:15.350182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2305e0bb7c479399344e45a96a333b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.351262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a737da9769c445ecb6709f10cb65a6ad', 'request_id': 'req-332dc805-1165-4d43-8cca-c919d850feed'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.351776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2305e0bb7c479399344e45a96a333b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.382526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2305e0bb7c479399344e45a96a333b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.384117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2305e0bb7c479399344e45a96a333b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.490118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a737da9769c445ecb6709f10cb65a6ad', 'request_id': 'req-332dc805-1165-4d43-8cca-c919d850feed'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.501072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a737da9769c445ecb6709f10cb65a6ad', 'request_id': 'req-332dc805-1165-4d43-8cca-c919d850feed'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.541282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] The token cache is being invalidate because project a737da9769c445ecb6709f10cb65a6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:15.544112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.549802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-332dc805-1165-4d43-8cca-c919d850feed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.551153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a97ed5ae-0a81-4fb9-b1d4-98ebbd3df852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2305e0bb7c479399344e45a96a333b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:15.553257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2820/5628] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:14 2022] DELETE /identity/v3/projects/a737da9769c445ecb6709f10cb65a6ad => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:15.560974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca332e-7dc8-45ba-ae48-7321bb6825a1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:15.563350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca332e-7dc8-45ba-ae48-7321bb6825a1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:15.563875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca332e-7dc8-45ba-ae48-7321bb6825a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:15.595493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2809/5629] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:14 2022] DELETE /identity/v3/users/3f2305e0bb7c479399344e45a96a333b => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:15.599838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:15.600090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:15.600320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:15.631350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-06ca332e-7dc8-45ba-ae48-7321bb6825a1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:15.632970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-06ca332e-7dc8-45ba-ae48-7321bb6825a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:15.680209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:15.681918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:15.804154 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:15.852348 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2821/5630] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:15.863323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:15.863656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:15.863922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:15.916244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:15.932297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2810/5631] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:15.940378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:15.947240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:15.948827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:15.994284 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2822/5632] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:16.005147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.058533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f6c58-d15b-4c8b-89d6-d255b08081a7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.086413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.087718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.087999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.088270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.096637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:16.096951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.151821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.247479 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2823/5633] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:16.253760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.278092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2adeb-096b-4da8-a8f9-669f88752dfd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.284012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.284923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.285616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.286057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.286853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.288919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.299090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc777f7f-bbdc-4146-99ce-25d17a8a5324 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.322986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.323798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.324452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.325796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.356201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.359743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.367227 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:16.411375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2811/5634] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:16.436264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2824/5635] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:16 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:16.441801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.468627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fea51-febf-48ff-a4bd-d7589727a5a0 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.551948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.552660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.552942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.553220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.558888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.570271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.683532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2812/5636] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:16 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:16.684795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.707717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9e8d6-d07c-4c68-bde8-0784a1f2ee31 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.741037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.749032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.749032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.749032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.749032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.749032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.791323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2825/5637] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:42:16.792535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.810316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401583-5dfe-4c03-a9a1-dca0716f7664 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.838951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.839592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.839863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.840142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:16.840847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:16.851634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2285f-a35f-4f77-b3ab-99ae69347e09 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:16.901536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2813/5638] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:16.902578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:16.946560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89686f1-d4b9-4a9a-abd4-4d769598f6af admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:16.969402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:16.970074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:16.976967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:16.976967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] PATH_INFO: `/v3/projects/8c010cf9fd704a1088567cc3ff190512/users/a221329f367f4a64b5ed05ed342549f1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:17.074045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c010cf9fd704a1088567cc3ff190512, user_id=a221329f367f4a64b5ed05ed342549f1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:17.078085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:17.180747 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2826/5639] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:16 2022] PUT /identity/v3/projects/8c010cf9fd704a1088567cc3ff190512/users/a221329f367f4a64b5ed05ed342549f1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:17.194510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:17.194510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:17.195127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:17.277106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] MFA Rules not processed for user `a221329f367f4a64b5ed05ed342549f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:17.278786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:17.471807 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2814/5640] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:17.476498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:17.605674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390f4fc-3840-4ddf-a0ad-cde718feca63 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:17.621462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:17.623213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:17.623213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:17.623213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:17.624156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:17.626349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:17.694095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:17.695564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:17.718938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183c0b9-65b0-47a8-b753-f03a9b8c6c0e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:17.736277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:17.737195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:17.737499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:17.737840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] PATH_INFO: `/v3/projects/0407cd0c81cb4985b44c533303f987f2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:17.740087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0407cd0c81cb4985b44c533303f987f2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:17.742149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:17.859176 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2827/5641] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:17 2022] POST /identity/v3/projects => generated 369 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:17.861892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:17.945878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0407cd0c81cb4985b44c533303f987f2', 'request_id': 'req-ffb9be09-385e-410d-8598-ea163ec9063c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:17.955812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0407cd0c81cb4985b44c533303f987f2', 'request_id': 'req-ffb9be09-385e-410d-8598-ea163ec9063c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:17.961779 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:18.140487 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:18.147129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfeb15-c3d7-48fd-8f43-0e6bd272772d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.315451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.316112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.316466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.316860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.317676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.321737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.403825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0407cd0c81cb4985b44c533303f987f2', 'request_id': 'req-ffb9be09-385e-410d-8598-ea163ec9063c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:18.438922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] The token cache is being invalidate because project 0407cd0c81cb4985b44c533303f987f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:18.447606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:18.448010 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2828/5642] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:17 2022] POST /identity/v3/users => generated 291 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:18.448010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.449840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ffb9be09-385e-410d-8598-ea163ec9063c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:18.454774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2815/5643] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:17 2022] DELETE /identity/v3/projects/0407cd0c81cb4985b44c533303f987f2 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:18.460733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd35461-5a8c-4094-98bb-dc5ce52e507d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.461902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14bf-2721-430c-9155-4716b0d1bdbb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.462186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14bf-2721-430c-9155-4716b0d1bdbb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.462467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14bf-2721-430c-9155-4716b0d1bdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.467724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.470054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.470605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.471077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.471986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.473936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.513558 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2829/5644] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:42:18.516657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.518559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e1fb14bf-2721-430c-9155-4716b0d1bdbb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:18.519785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1fb14bf-2721-430c-9155-4716b0d1bdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:18.521646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:18.553018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2816/5645] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:18.557549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.557833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.558113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.560269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee7674-cd4d-41a6-93b2-7d52451804ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.591233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.591655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:18.591992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.592274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.594222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:18.601620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] PATH_INFO: `/v3/projects/d1add890b2fd42079a5a65d5d6c000e6/users/e4455f7b26554cc1b40c55cb275915b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.612233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2817/5646] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:18.612233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.624136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9620b8-8af3-43be-b497-292e3dfcefd5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.636041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.636772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.637062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.637447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.638130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:18.642828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.644651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.692040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1add890b2fd42079a5a65d5d6c000e6, user_id=e4455f7b26554cc1b40c55cb275915b2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.700345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.707261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2818/5647] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:18.717107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.768108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c290-6e8f-447b-a170-c7db98498c1c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.784094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.784993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.787355 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2830/5648] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:18 2022] PUT /identity/v3/projects/d1add890b2fd42079a5a65d5d6c000e6/users/e4455f7b26554cc1b40c55cb275915b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:18.790376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.790672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.791373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.791826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.794044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.960651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3054-0223-4c1c-8039-8e659650f3ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:18.982467 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2819/5649] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:18 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:18.985078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:18.986061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:18.986832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:18.987382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:18.989558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:18.991473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:18.991621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:18.998407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:19.049209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2831/5650] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:19.057315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:19.101094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adfdc8-11ac-4b76-ba03-deb2d5c23cf1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:19.212361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369bd5c-1935-4074-a18e-acaf467af4e1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:19.243872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:19.251917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:19.255276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:19.255492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] PATH_INFO: `/v3/users/75d86a8ce2184bc68dc8011c943eddeb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:19.258598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d86a8ce2184bc68dc8011c943eddeb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:19.261813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:19.313627 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:19.338320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:19.339444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:19.339883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:19.342867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:19.346800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:19.351753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:19.511385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2832/5651] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:19 2022] POST /identity/v3/users => generated 286 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:19.513061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:19.536280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df8cb-43ad-4581-8c98-ef55963360c0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:19.549839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:19.550773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:19.553054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:19.553665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] PATH_INFO: `/v3/projects/d1add890b2fd42079a5a65d5d6c000e6/users/e4455f7b26554cc1b40c55cb275915b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:19.559476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1add890b2fd42079a5a65d5d6c000e6, user_id=e4455f7b26554cc1b40c55cb275915b2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:19.570015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:19.609983 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2833/5652] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:19 2022] PUT /identity/v3/projects/d1add890b2fd42079a5a65d5d6c000e6/users/e4455f7b26554cc1b40c55cb275915b2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:19.609983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:19.623995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d86a8ce2184bc68dc8011c943eddeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:19.628014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d86a8ce2184bc68dc8011c943eddeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:19.655001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d86a8ce2184bc68dc8011c943eddeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:19.656628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d86a8ce2184bc68dc8011c943eddeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:19.758974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e7b75-1420-49b4-9c2f-c34c0bf22b52 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:19.770932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:19.772016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:19.772870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:19.775338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:19.776511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:19.779808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559bc13-c97f-43b5-ad91-c8e7e22f0ea4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:19.830373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d86a8ce2184bc68dc8011c943eddeb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:19.855989 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2834/5653] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:19.866926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:19.867367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:19.867894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:19.944494 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2820/5654] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:18 2022] DELETE /identity/v3/users/75d86a8ce2184bc68dc8011c943eddeb => generated 0 bytes in 955 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:19.945434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:19.954773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.081613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] MFA Rules not processed for user `e4455f7b26554cc1b40c55cb275915b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:20.081613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.082659 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:20.142297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f88a0a-5cf1-4a2f-9c50-c616ec77e40c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:20.166153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:20.169779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.169779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.169779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.169779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:20.177380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c92ce-3221-4b6e-a930-e98a9afafb39 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:20.209315 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2821/5655] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:20.214931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.215223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.215504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.228196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2835/5656] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:20.230204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:20.238776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:20.240210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.245090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef782d1-1b47-4dbf-a2c8-83e8a8bf70f5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:20.252629 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2822/5657] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:20.253215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:20.254012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.254331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:20.254447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.254822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] PATH_INFO: `/v3/projects/d99869b9cb22465b8f7dcd8f8dae95e2/users/a45cbd0e2a234c79a643ccfc567931a4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.262377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.285696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99869b9cb22465b8f7dcd8f8dae95e2, user_id=a45cbd0e2a234c79a643ccfc567931a4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:20.291040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0d4d1-2621-468d-bccc-3afe54b032e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:20.351666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394baa4-0c30-4092-9322-57450104e9ea None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:20.356035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:20.358909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.358909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.358909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.369100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:20.370744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:20.385273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2823/5658] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:20.386383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:20.388474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.425202 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2836/5659] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:20 2022] PUT /identity/v3/projects/d99869b9cb22465b8f7dcd8f8dae95e2/users/a45cbd0e2a234c79a643ccfc567931a4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:20.437101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.437668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.438115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.502095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70534-514f-4102-8594-c34140c34449 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:20.584269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] MFA Rules not processed for user `a45cbd0e2a234c79a643ccfc567931a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:20.584269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:20.647377 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:20.680919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:20.683091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:20.684696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:20.685678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:20.763550 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:20.796831 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2837/5660] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:42:20.835379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:20.837092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:20.854315 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2824/5661] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:20.875019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:21.047044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309224dc-bd6d-4b18-b6e4-0305e17df635 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:21.058249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:21.058893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:21.059208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:21.059498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:21.082707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:21.084186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556393a8-6b7a-4d75-b809-bebdddeb51ab service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:21.109264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2838/5662] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:21.162230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:21.183620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe49f6-1dd5-48d8-a435-3e04e36698b3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:21.225386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:21.226481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:21.227018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:21.227503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] PATH_INFO: `/v3/users/a45cbd0e2a234c79a643ccfc567931a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:21.230709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45cbd0e2a234c79a643ccfc567931a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:21.244797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:21.606514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45cbd0e2a234c79a643ccfc567931a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:21.609067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45cbd0e2a234c79a643ccfc567931a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:21.639659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45cbd0e2a234c79a643ccfc567931a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:21.641733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45cbd0e2a234c79a643ccfc567931a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:21.742253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45cbd0e2a234c79a643ccfc567931a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:21.815185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2825/5663] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:21 2022] DELETE /identity/v3/users/a45cbd0e2a234c79a643ccfc567931a4 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:21.819750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:21.820615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:21.821053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:21.905962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:21.907219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:22.139599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:22.142259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:22.178194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2839/5664] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:22.195821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb997a9-4027-4d95-ad24-7c9d8ad0e567 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:22.198981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:22.207733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:22.208400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:22.208684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:22.208963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] PATH_INFO: `/v3/projects/d848a2b7dede4cecb8bacfb316ef7944` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:22.210587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d848a2b7dede4cecb8bacfb316ef7944)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:22.212531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:22.217081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:22.360337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da175e-6061-470e-96ea-a13331fb8a65 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:22.366921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:22.367561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:22.367835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:22.372189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:22.397506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:22.399319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:22.430711 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2840/5665] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:22.443756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd848a2b7dede4cecb8bacfb316ef7944', 'request_id': 'req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:22.456489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd848a2b7dede4cecb8bacfb316ef7944', 'request_id': 'req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:22.564597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd848a2b7dede4cecb8bacfb316ef7944', 'request_id': 'req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:22.585731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] The token cache is being invalidate because project d848a2b7dede4cecb8bacfb316ef7944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:22.586223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:22.591122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:22.596762 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2826/5666] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:22 2022] DELETE /identity/v3/projects/d848a2b7dede4cecb8bacfb316ef7944 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:22.597590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:22.603517 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:22.611112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96832284-fa2d-4399-9bf1-18870a156ef3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:22.729740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:22.741600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:22.745551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:22.745702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] PATH_INFO: `/v3/users/01e4d25c70a54456bfe433003db3e446` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:22.747781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e4d25c70a54456bfe433003db3e446)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:22.758594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:23.011704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e4d25c70a54456bfe433003db3e446'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.132160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e4d25c70a54456bfe433003db3e446'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.133209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e4d25c70a54456bfe433003db3e446'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.167255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e4d25c70a54456bfe433003db3e446'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.181202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c1f6d38c-f340-4455-8a5a-cd171cd5384e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e4d25c70a54456bfe433003db3e446'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.191030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2841/5667] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:22 2022] DELETE /identity/v3/users/01e4d25c70a54456bfe433003db3e446 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:23.340703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:23.343765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:23.367367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd210b9-0f08-43f1-96fb-e95c06c2f5da admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:23.458214 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:23.611073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:23.612123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:23.612262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:23.612540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] PATH_INFO: `/v3/projects/d99869b9cb22465b8f7dcd8f8dae95e2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:23.622945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99869b9cb22465b8f7dcd8f8dae95e2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:23.626544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:23.875443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99869b9cb22465b8f7dcd8f8dae95e2', 'request_id': 'req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:23.891026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99869b9cb22465b8f7dcd8f8dae95e2', 'request_id': 'req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.035178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99869b9cb22465b8f7dcd8f8dae95e2', 'request_id': 'req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.060417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] The token cache is being invalidate because project d99869b9cb22465b8f7dcd8f8dae95e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:24.060417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.060417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.060417 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2827/5668] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:23 2022] DELETE /identity/v3/projects/d99869b9cb22465b8f7dcd8f8dae95e2 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:24.065841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ac64-ae54-4a37-a398-5260a0cc0c9c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.066308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ac64-ae54-4a37-a398-5260a0cc0c9c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.066683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ac64-ae54-4a37-a398-5260a0cc0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.112936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d245ac64-ae54-4a37-a398-5260a0cc0c9c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:24.114407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d245ac64-ae54-4a37-a398-5260a0cc0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:24.175700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:24.178361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:24.348075 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2842/5669] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:24.356413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.357257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.358061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.442043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6f4c2-61de-429d-8a01-7d8e3ab21a7e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:24.464553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:24.466559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.467132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.467621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] PATH_INFO: `/v3/projects/b62c7c658cc64c309db1739786c91c22` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.480150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62c7c658cc64c309db1739786c91c22)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:24.482646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:24.552291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:24.552291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:24.576187 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2843/5670] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:24.577326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:24.600795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1a916-3d71-4aaf-83cb-d9b52d7f0fe2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:24.613623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:24.613623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.613623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.613623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.618096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:24.618420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:24.622666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:24.658556 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2844/5671] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:42:24.664496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:24.684015 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:24.691051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810123-9088-4287-adf0-3efb9b74d3b0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:24.698732 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:24.704757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62c7c658cc64c309db1739786c91c22', 'request_id': 'req-0240019a-0d00-4b85-a8ab-35a9753dcfd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.731549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62c7c658cc64c309db1739786c91c22', 'request_id': 'req-0240019a-0d00-4b85-a8ab-35a9753dcfd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.797139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:24.797902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.798248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.798584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.799547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:24.801891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:24.848093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62c7c658cc64c309db1739786c91c22', 'request_id': 'req-0240019a-0d00-4b85-a8ab-35a9753dcfd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.873734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] The token cache is being invalidate because project b62c7c658cc64c309db1739786c91c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:24.886058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.889424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0240019a-0d00-4b85-a8ab-35a9753dcfd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:24.908399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2828/5672] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:24 2022] DELETE /identity/v3/projects/b62c7c658cc64c309db1739786c91c22 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:24.910597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f206fab-c5b2-4ea0-ac78-b57865401c57 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.911554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f206fab-c5b2-4ea0-ac78-b57865401c57 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.913667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f206fab-c5b2-4ea0-ac78-b57865401c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:24.972272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0f206fab-c5b2-4ea0-ac78-b57865401c57 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:24.973785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f206fab-c5b2-4ea0-ac78-b57865401c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:24.987891 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2829/5673] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:24.991585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:24.991866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:24.992137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.000167 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2845/5674] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:24 2022] POST /identity/v3/projects => generated 371 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:25.004542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.007119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:25.044621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:25.064653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:25.241867 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2830/5675] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:25.245638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8344ec-b505-44ff-bc82-c95a862a3ef7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.246876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.267359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.267989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.268271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.268536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.269160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.275809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94058-b331-4abc-b4c6-72495e18b16d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.278873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.307544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.307773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.308535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.308535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.308997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:25.309300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.310957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.368473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2831/5676] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:25.372070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.394149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b9571-b730-42c0-86eb-d1ffd67c0c01 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.401268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.402116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.402395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.402686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.404522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.406711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.462464 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2846/5677] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:25 2022] POST /identity/v3/users => generated 286 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:25.462464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.508699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67721f-5c2f-4195-9573-5d7b15b0f51b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.527476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.534711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.534711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.534711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.534711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.534711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.565243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2832/5678] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:25 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:25.568952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.571316 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2847/5679] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:25.572416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.595136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c54d8c-1c21-4919-9934-5eb82472baab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.694595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723d42a-5dbb-4d59-957a-8f24e57c5ed1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.708211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.708840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.709114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.709405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.710039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.716502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.723972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.724634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.724913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.728666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.729845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.731704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.751914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2848/5680] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:25.756044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.764645 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:25.769258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af7ed5-c619-4c94-be41-e76cb99aa8b9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.776406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.777300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.777627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.778873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] PATH_INFO: `/v3/projects/8d68930ed61745eea8adfda72f3d139f/users/759025c4133f4074ba59beb1a08c7a21/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.820434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d68930ed61745eea8adfda72f3d139f, user_id=759025c4133f4074ba59beb1a08c7a21, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.829956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e8fd1-1535-4171-af24-bfe181fe2b52 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.873308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2833/5681] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:25 2022] POST /identity/v3/users => generated 284 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:25.874690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.901762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec824-010d-4227-95ea-93a9aba12745 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:25.926158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:25.926796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.927072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.927351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.928008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:25.930283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:25.948899 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2834/5682] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:25.950069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:25.970334 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2849/5683] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:25 2022] PUT /identity/v3/projects/8d68930ed61745eea8adfda72f3d139f/users/759025c4133f4074ba59beb1a08c7a21/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:25.972955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:25.973248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:25.973555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:25.986374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8739b6-3db9-4fb4-8e9c-818bdc953970 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:26.007107 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:26.029041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:26.033597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:26.160263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:26.160843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.161131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.161442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.162284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:26.163922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:26.184940 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2850/5684] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:26.195708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:26.196731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2835/5685] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:26.197221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:26.200532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:26.225215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0290-2f48-487c-b115-ce0efadb346e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:26.231889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:26.233133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.233259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.239613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] PATH_INFO: `/v3/projects/105f89d4825c4f48b375a2f5d80b764f/users/e2ff22463e4c4ec6a65cd95f1b28cc99/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.268183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] RBAC: Authorizing `identity:create_grant(project_id=105f89d4825c4f48b375a2f5d80b764f, user_id=e2ff22463e4c4ec6a65cd95f1b28cc99, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:26.270349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:26.319820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2644e-1e72-4a3b-9ee2-af0a92b3dd68 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:26.323686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:26.324407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.324785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.325238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.337258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:26.339600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482c88a-714e-4320-88c9-40e78806aef3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:26.351595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2836/5686] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:26 2022] PUT /identity/v3/projects/105f89d4825c4f48b375a2f5d80b764f/users/e2ff22463e4c4ec6a65cd95f1b28cc99/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:26.351879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:26.357245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2851/5687] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:26.362184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.362383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:26.363361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.363719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.438228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] MFA Rules not processed for user `e2ff22463e4c4ec6a65cd95f1b28cc99`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:26.439474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:26.553977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c07169-f995-4ccd-9232-ef472ddd036f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:26.559855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:26.560773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.561218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.562184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] PATH_INFO: `/v3/users/a221329f367f4a64b5ed05ed342549f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.564939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a221329f367f4a64b5ed05ed342549f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:26.568140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:26.595963 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2852/5688] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:26.599626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:26.620231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609fa5f-1dd4-4cb3-99b4-e633808052ad None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:26.635860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:26.637921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:26.638405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:26.638833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:26.640970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:26.643643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:26.662741 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:26.881634 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2853/5689] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:26 2022] POST /identity/v3/projects => generated 367 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:26.887797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:26.909578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a221329f367f4a64b5ed05ed342549f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:26.912288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a221329f367f4a64b5ed05ed342549f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:26.960536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a221329f367f4a64b5ed05ed342549f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:26.964032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a221329f367f4a64b5ed05ed342549f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:27.069729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a221329f367f4a64b5ed05ed342549f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:27.107648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2837/5690] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:26 2022] DELETE /identity/v3/users/a221329f367f4a64b5ed05ed342549f1 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:27.109374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.110564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a353942-e1ac-4b49-b487-43cf5f1c67b6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.115126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:27.129883 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:27.216884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.217753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.218591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.218855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.219492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.222199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.254461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f0e2-5ee2-4223-87c1-3b191d137a1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.272262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.272262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.272262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.272262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.272717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:27.301400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.305720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cb9f6-316c-434d-9f6c-c71b3faff5a9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.337573 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2838/5691] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:27.339855 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2854/5692] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:26 2022] POST /identity/v3/users => generated 290 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:27.341143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.341659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.342145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.344354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.352246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:27.398260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139386d-de94-4820-8e1a-6523fb88503b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.412282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:27.415308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.416482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.419772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:27.425534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.429044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.431543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.433583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.450932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2855/5693] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:27.454408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.455078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2839/5694] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:27.473485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90895ff7-5267-4921-bb87-d733e4a07809 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.479870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.480083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.480781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.481148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.481636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] PATH_INFO: `/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9/users/c169787da9844ca7b71a931011a707b6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.502483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c79e5-2174-4543-91cb-529e7c5723b1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.518559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.518559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.518559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.518559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.528597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2f97bd11c84a398cc56a9c4ca221f9, user_id=c169787da9844ca7b71a931011a707b6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.532793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.571417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.576509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.606074 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2840/5695] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:27.624161 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2856/5696] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:27 2022] PUT /identity/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9/users/c169787da9844ca7b71a931011a707b6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:27.629136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.641240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f836-26d4-43da-baa6-aa91364cfbe3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.828713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.829921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.829921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.829921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.830534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.832156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68f8c-830d-4425-aac5-831e9dc076bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.871921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2841/5697] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:42:27.873084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:27.895365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff2c3-7073-4913-8275-4139a8453870 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:27.906108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:27.906792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.907067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.907338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] PATH_INFO: `/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9/users/c169787da9844ca7b71a931011a707b6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:27.911534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2f97bd11c84a398cc56a9c4ca221f9, user_id=c169787da9844ca7b71a931011a707b6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:27.913969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:27.943540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2857/5698] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:27 2022] PUT /identity/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9/users/c169787da9844ca7b71a931011a707b6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:27.954941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2642a-0f0c-4e8d-a38b-a3abac62f4ff None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:27.955460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2642a-0f0c-4e8d-a38b-a3abac62f4ff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:27.955919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2642a-0f0c-4e8d-a38b-a3abac62f4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:28.052966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a6b2642a-0f0c-4e8d-a38b-a3abac62f4ff None None] MFA Rules not processed for user `c169787da9844ca7b71a931011a707b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:28.057795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6b2642a-0f0c-4e8d-a38b-a3abac62f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:28.244818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2842/5699] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:28.254390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:28.256348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:28.351300 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:28.378038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2abd16-d5d2-46ba-b9f6-2bf24955c7d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:28.388609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:28.389403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:28.389819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:28.391946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:28.429868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:28.431589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:28.464275 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2858/5700] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:28.730111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:28.730616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:28.730715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:28.773518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:28.782745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:28.789706 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:28.845136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:28.893076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f8016-b024-4b29-91c1-e62153f44775 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:28.917097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:28.918749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:28.919189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:28.919668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:28.931224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:29.051099 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2843/5701] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:42:29.078043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:29.084366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:29.193663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2780-fb71-49f3-b5d4-92569b9e387f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:29.193918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:29.195585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:29.205188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:29.209181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:29.209815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:29.210258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:29.224595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:29.226249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:29.226960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2859/5702] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:29.238340 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2844/5703] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:42:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:42:30.262500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:30.265438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:30.500218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680d514-9b2a-43ee-98cb-0c048d008ec9 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:30.515163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:30.516023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:30.516445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:30.516860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] PATH_INFO: `/v3/projects/8c010cf9fd704a1088567cc3ff190512` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:30.520810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c010cf9fd704a1088567cc3ff190512)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:30.529663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:30.690956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c010cf9fd704a1088567cc3ff190512', 'request_id': 'req-007e5572-7362-4088-a4f7-d1142cdee58b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:30.799224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c010cf9fd704a1088567cc3ff190512', 'request_id': 'req-007e5572-7362-4088-a4f7-d1142cdee58b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:30.810628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c010cf9fd704a1088567cc3ff190512', 'request_id': 'req-007e5572-7362-4088-a4f7-d1142cdee58b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:30.867779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] The token cache is being invalidate because project 8c010cf9fd704a1088567cc3ff190512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:30.871861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:30.875136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:30.882687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2860/5704] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:30 2022] DELETE /identity/v3/projects/8c010cf9fd704a1088567cc3ff190512 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:30.886777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:30.911809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3f5f6-364a-45d7-a116-20c38d379552 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:31.191796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:31.192522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:31.195204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:31.195204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] PATH_INFO: `/v3/users/e4455f7b26554cc1b40c55cb275915b2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:31.206677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4455f7b26554cc1b40c55cb275915b2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:31.219410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:31.572141 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:31.581105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4455f7b26554cc1b40c55cb275915b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:31.583115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4455f7b26554cc1b40c55cb275915b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:31.635752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4455f7b26554cc1b40c55cb275915b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:31.640922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4455f7b26554cc1b40c55cb275915b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:31.757751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bd9c7aba-7085-4fa9-a4f9-0dac00f08fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4455f7b26554cc1b40c55cb275915b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:31.799661 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2845/5705] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:30 2022] DELETE /identity/v3/users/e4455f7b26554cc1b40c55cb275915b2 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:33.733761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:33.735293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:33.774308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e5572-7362-4088-a4f7-d1142cdee58b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:33.805691 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:34.028722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:34.028722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:34.028722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:34.028722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] PATH_INFO: `/v3/projects/d1add890b2fd42079a5a65d5d6c000e6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:34.029670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1add890b2fd42079a5a65d5d6c000e6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:34.033915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:34.299335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1add890b2fd42079a5a65d5d6c000e6', 'request_id': 'req-cade8b4a-856a-4246-b445-b6a8c7a816f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:34.409491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1add890b2fd42079a5a65d5d6c000e6', 'request_id': 'req-cade8b4a-856a-4246-b445-b6a8c7a816f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:34.418840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1add890b2fd42079a5a65d5d6c000e6', 'request_id': 'req-cade8b4a-856a-4246-b445-b6a8c7a816f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:34.473760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] The token cache is being invalidate because project d1add890b2fd42079a5a65d5d6c000e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:34.474062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:34.494090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cade8b4a-856a-4246-b445-b6a8c7a816f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:34.501306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:34.502170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:34.502627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:34.506086 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2861/5706] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:33 2022] DELETE /identity/v3/projects/d1add890b2fd42079a5a65d5d6c000e6 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:34.558875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:34.561996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:34.786889 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2846/5707] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:34.795658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:34.802438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:34.802438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:34.835249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:34.836598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:34.858942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2862/5708] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:34.865188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:34.876632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06b01f-ff12-4bf8-bd84-3b9f742a1264 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:34.895337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:34.898062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:34.898350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:34.898628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:34.899938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:34.899938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:34.901321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:34.958056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:34.971686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5d65e-1900-48ce-b642-f5821eaaf0e8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:34.972992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2847/5709] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:34.988025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:34.990908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:34.991591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:34.993528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:34.994340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:35.001091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:35.165051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2863/5710] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:34 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:35.166367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:35.183762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd128d-f6f2-4478-8220-14e8ee2023a1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:35.349192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:35.349852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:35.350134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:35.350413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:35.351047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:35.366598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:35.537042 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2848/5711] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:35 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:35.541273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:35.554234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1cd70-14e1-45e4-9bcd-e1e5b572a84a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:35.576428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:35.577640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:35.577924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:35.578195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:35.578858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:35.580464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:35.623362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:35.632387 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2864/5712] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:35.650721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aee77-5361-428c-9042-266b911565e8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:35.674092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:35.674719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:35.674999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:35.675270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:35.675921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:35.677590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cabaaa-277a-4dd7-99ea-bfd8644586e3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:35.732386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:35.741623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2849/5713] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:35.754927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6f94-9841-403c-a6d1-69bb0a0fd74f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:35.772843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:35.773576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:35.773839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:35.774117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] PATH_INFO: `/v3/projects/8309f6a0053247cc853a99a4b42b62ce/users/a4fa314eafaa4c5aabd7f18e62cc34f4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:35.820927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8309f6a0053247cc853a99a4b42b62ce, user_id=a4fa314eafaa4c5aabd7f18e62cc34f4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:35.824452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:35.961445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:35.962058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:35.962502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:35.966476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2865/5714] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:35 2022] PUT /identity/v3/projects/8309f6a0053247cc853a99a4b42b62ce/users/a4fa314eafaa4c5aabd7f18e62cc34f4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:36.850942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] MFA Rules not processed for user `a4fa314eafaa4c5aabd7f18e62cc34f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:36.852329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:36.925767 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:37.089377 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2850/5715] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 1125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:37.090220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:37.209104 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:37.301434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821d27b-462f-4a33-8c42-312a8de67912 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:37.324851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:37.325734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:37.326190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:37.326623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:37.327563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:37.329699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:37.502889 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2866/5716] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:37 2022] POST /identity/v3/projects => generated 375 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:37.503997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:37.531675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f140a-00af-4889-a77c-84d5a69ce718 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:37.741360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:37.742211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:37.742659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:37.745312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:37.754824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:37.754824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:37.907315 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2851/5717] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:37 2022] POST /identity/v3/users => generated 294 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:37.908300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:37.925723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd87b6-7237-46e6-a906-10aca49b56b9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:37.947963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:37.949865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:37.956834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:37.959110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:37.960320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:37.968795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:38.035066 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2867/5718] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:38.038258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:38.054609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ea2e7-88f2-4dbd-afa4-f557e9b72988 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:38.096768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:38.103417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:38.103692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:38.103979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] PATH_INFO: `/v3/projects/051d52f039304d79ad6e3456704399e3/users/fb007eb66fcb4e02ba1526b925baac22/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:38.216987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=051d52f039304d79ad6e3456704399e3, user_id=fb007eb66fcb4e02ba1526b925baac22, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:38.220313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:38.362290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2852/5719] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:38 2022] PUT /identity/v3/projects/051d52f039304d79ad6e3456704399e3/users/fb007eb66fcb4e02ba1526b925baac22/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:38.366266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:38.385630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688e89-046f-46ad-9891-679ca40775ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:38.738142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:38.738812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:38.739100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:38.739371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:38.758760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:38.770170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d5c28-2ddf-4022-8e6a-d26f06c24ece admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:38.824348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:38.836112 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2868/5720] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:38.847500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e0f2-7fce-424c-911b-1ffd2574d46f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:38.863094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:38.864703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:38.867301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:38.867759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] PATH_INFO: `/v3/projects/051d52f039304d79ad6e3456704399e3/users/fb007eb66fcb4e02ba1526b925baac22/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:38.881106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051d52f039304d79ad6e3456704399e3, user_id=fb007eb66fcb4e02ba1526b925baac22, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:38.886471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:38.915728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2853/5721] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:38 2022] PUT /identity/v3/projects/051d52f039304d79ad6e3456704399e3/users/fb007eb66fcb4e02ba1526b925baac22/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:38.931247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:38.931528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:38.931765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:39.076152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] MFA Rules not processed for user `fb007eb66fcb4e02ba1526b925baac22`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:39.088079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:39.687554 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2869/5722] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 747 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:39.864337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:39.866182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:40.204832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f05e-2b1f-41ef-8013-e5fbc88a3457 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:40.225229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:40.226138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:40.226509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:40.226852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:40.258396 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:40.313805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:40.315957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:40.338395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2854/5723] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:40.894671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:40.897025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:41.030802 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:41.156369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc1614-ad3e-4e70-9701-ad9c2faba5ce None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:41.171195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:41.174818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:41.177417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:41.177417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] PATH_INFO: `/v3/users/aba3c4de99ec4a5aae6fb006ab89fdb9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:41.181216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba3c4de99ec4a5aae6fb006ab89fdb9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:41.183254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:41.499253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba3c4de99ec4a5aae6fb006ab89fdb9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:41.586184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba3c4de99ec4a5aae6fb006ab89fdb9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:41.587029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba3c4de99ec4a5aae6fb006ab89fdb9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:41.629191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba3c4de99ec4a5aae6fb006ab89fdb9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:41.651914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-947e2fa3-b729-410c-87a1-ac00dcdcf38d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba3c4de99ec4a5aae6fb006ab89fdb9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:41.683344 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2870/5724] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:40 2022] DELETE /identity/v3/users/aba3c4de99ec4a5aae6fb006ab89fdb9 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:42.429677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:42.483589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b1fb9-b34e-4f51-888f-3061e04fe313 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:42.815905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:42.817971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:42.821710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:42.822195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] PATH_INFO: `/v3/projects/7c1e4ce82aba40a2a013f2d107877b72` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:42.825420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1e4ce82aba40a2a013f2d107877b72)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:42.845546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:43.067358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1e4ce82aba40a2a013f2d107877b72', 'request_id': 'req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:43.087718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1e4ce82aba40a2a013f2d107877b72', 'request_id': 'req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:43.184318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1e4ce82aba40a2a013f2d107877b72', 'request_id': 'req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:43.227290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] The token cache is being invalidate because project 7c1e4ce82aba40a2a013f2d107877b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:43.229286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:43.231930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-387ad6bd-b9a0-4521-8fd0-34c4f53110ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:43.240988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2855/5725] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:42 2022] DELETE /identity/v3/projects/7c1e4ce82aba40a2a013f2d107877b72 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:43.242815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:43.244767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:43.245217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:43.319882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:43.323052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:43.656223 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2871/5726] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:43.668794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:43.670660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:43.671286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:43.731902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:43.739367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:43.770693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2856/5727] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:43.770931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:43.786457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74cc85-6c1c-4105-a87f-4a0ac8c43ca2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:43.816791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:43.817876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:43.824631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:43.827191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:43.833141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:43.854526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:43.854526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:43.966204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:43.969699 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2872/5728] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:42:44.000323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9830a-a969-4935-8dbe-8d06a2308ead None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:44.020070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:44.021026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:44.021655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:44.022092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:44.023506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:44.032452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:44.422958 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2857/5729] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:43 2022] POST /identity/v3/projects => generated 373 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:44.424383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:44.447314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e261b-1b63-4bf0-9ddc-f15385b6fbc6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:44.656852 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:44.667930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:44.670140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:44.840679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:44.841684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:44.842424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:44.843833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:44.846820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:44.850769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:44.885759 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:45.024101 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2873/5730] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:44 2022] POST /identity/v3/users => generated 287 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:45.028712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:45.060342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f867f-db89-49b4-9405-89ceb6d1aee0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:45.068159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:45.068797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:45.069086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:45.069372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:45.070213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:45.072072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb2e77-bdb3-4be8-a126-310401a234ce admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:45.074636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:45.094544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:45.095473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:45.095981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:45.096487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:45.098543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:45.107322 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2874/5731] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:45.107322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:45.149883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a131c1-5bcb-470e-a02f-e8eda021963d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:45.164294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:45.166284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62d84a-6026-4af5-b5c1-0f09dbbc8b39 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:45.167345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:45.167968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:45.168337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:45.168614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:45.169317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:45.187084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:45.234575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2875/5732] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:45.237672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:45.244005 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2858/5733] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:45.274083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a21fc-2a51-49d3-9f82-8824ac3541d3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:45.305805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:45.311898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:45.312190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:45.313929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] PATH_INFO: `/v3/projects/4f18aff2d4054db8988f4840a0f29838/users/21c1838f010e44b3a8ee349ccc2dbbb5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:45.375561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f18aff2d4054db8988f4840a0f29838, user_id=21c1838f010e44b3a8ee349ccc2dbbb5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:45.402445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:45.541054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2876/5734] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:45 2022] PUT /identity/v3/projects/4f18aff2d4054db8988f4840a0f29838/users/21c1838f010e44b3a8ee349ccc2dbbb5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:45.556687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:45.556687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:45.557117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:45.688340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] MFA Rules not processed for user `21c1838f010e44b3a8ee349ccc2dbbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:45.689974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:46.023745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2859/5735] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:46.591642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:46.594640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:46.965521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27da68-527b-42ef-b1f5-6052978f9fea admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:46.985932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:46.987173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:46.987690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:46.988481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:47.023894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:47.025748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a03cd8-1e26-4394-81ac-c4a518ee84c8 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:47.053585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2877/5736] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:47.730763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:47.792634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:47.793168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:47.793168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:47.873194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] MFA Rules not processed for user `759025c4133f4074ba59beb1a08c7a21`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:47.882894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:47.984229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78440-81c5-40d0-adf7-b7131885c4db None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:48.014710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:48.015376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:48.015659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:48.015933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] PATH_INFO: `/v3/users/21c1838f010e44b3a8ee349ccc2dbbb5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:48.020675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c1838f010e44b3a8ee349ccc2dbbb5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:48.022675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:48.046850 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:48.146123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2878/5737] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:42:48.151511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:48.152894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:48.190273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d0ff5-02cd-4153-86b4-3e42151bddf3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:48.203976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:48.204615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:48.204899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:48.205171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:48.205844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:48.207782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:48.345843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2879/5738] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:48 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:48.358668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:48.361297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c1838f010e44b3a8ee349ccc2dbbb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:48.363170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c1838f010e44b3a8ee349ccc2dbbb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:48.365821 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:48.383515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c1838f010e44b3a8ee349ccc2dbbb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:48.389604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c1838f010e44b3a8ee349ccc2dbbb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:48.517444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6323889d-7aaf-432f-a4b0-aa185f44587f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c1838f010e44b3a8ee349ccc2dbbb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:48.561903 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2860/5739] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:47 2022] DELETE /identity/v3/users/21c1838f010e44b3a8ee349ccc2dbbb5 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:48.566379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:48.567954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:48.567954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:48.572483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ae0ce-90b0-4d16-81fa-726b080bd440 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:48.635245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:48.638424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:48.796601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:48.804556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:48.805101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:48.805564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:48.806501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:48.811842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:48.919862 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2861/5740] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:48.922250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:48.943755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:48.953902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2880/5741] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:48 2022] POST /identity/v3/users => generated 293 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:48.957659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:48.961772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:49.006720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1790ff-30f2-4702-88d0-970431e42a7f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:49.031761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:49.034866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:49.035335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:49.036190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:49.037824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:49.043462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:49.101974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2881/5742] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:42:49.103174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:49.140378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a0e4c-b93d-4dae-83a2-6554840a391b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:49.160537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:49.161505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:49.162469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:49.162990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] PATH_INFO: `/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49/users/b518f0cfeb024924b4181145412d3703/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:49.205789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9548ed-86de-4e64-b17c-3de5d19e16bc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:49.206582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0c005a5fbf4b48a378f2b0948b1e49, user_id=b518f0cfeb024924b4181145412d3703, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:49.210591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:49.219866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:49.220502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:49.220778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:49.221050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:49.253181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:49.261635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:49.281241 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2862/5743] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:49.307078 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2882/5744] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:49 2022] PUT /identity/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49/users/b518f0cfeb024924b4181145412d3703/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:49.312080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:49.327775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3d3c-8ce7-4cd6-8f26-f50b56232f63 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:49.622884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:49.623114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:49.623421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:49.623699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:49.624371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:49.627231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:49.673773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:49.686998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2863/5745] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:49.695846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788a348-4a35-4060-b5f5-aedd4278e235 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:49.727150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:49.728247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:49.728641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:49.729020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] PATH_INFO: `/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49/users/b518f0cfeb024924b4181145412d3703/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:49.733816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0c005a5fbf4b48a378f2b0948b1e49, user_id=b518f0cfeb024924b4181145412d3703, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:49.744785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:49.794150 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2883/5746] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:49 2022] PUT /identity/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49/users/b518f0cfeb024924b4181145412d3703/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:50.646007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:50.647997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:50.674909 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:50.681983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1487a3-8cb5-43a1-9a4b-38b4db98c071 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:50.716917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:50.719015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:50.735133 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:50.902435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5d69-903c-4a11-abb5-90d9b9047cf0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:50.919119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:50.919749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:50.920846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:50.921289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] PATH_INFO: `/v3/users/e2ff22463e4c4ec6a65cd95f1b28cc99` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:50.925940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ff22463e4c4ec6a65cd95f1b28cc99)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:50.928274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:50.977937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:50.978593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:50.978897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:50.979158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] PATH_INFO: `/v3/projects/4f18aff2d4054db8988f4840a0f29838` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:50.992516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f18aff2d4054db8988f4840a0f29838)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:51.003158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:51.261084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f18aff2d4054db8988f4840a0f29838', 'request_id': 'req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.285247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f18aff2d4054db8988f4840a0f29838', 'request_id': 'req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.345747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ff22463e4c4ec6a65cd95f1b28cc99'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.361983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f18aff2d4054db8988f4840a0f29838', 'request_id': 'req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.399814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] The token cache is being invalidate because project 4f18aff2d4054db8988f4840a0f29838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:51.400102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.407288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9cba4ab-e21c-47e0-b8f0-6eeccab62631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.414795 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2864/5747] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:50 2022] DELETE /identity/v3/projects/4f18aff2d4054db8988f4840a0f29838 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:51.424732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14154-5ef4-415b-8f13-991ef05444c5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:51.425020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14154-5ef4-415b-8f13-991ef05444c5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:51.425869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14154-5ef4-415b-8f13-991ef05444c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:51.491322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ff22463e4c4ec6a65cd95f1b28cc99'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.495508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ff22463e4c4ec6a65cd95f1b28cc99'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.548201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ff22463e4c4ec6a65cd95f1b28cc99'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.575818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e4b14154-5ef4-415b-8f13-991ef05444c5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:51.578450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e4b14154-5ef4-415b-8f13-991ef05444c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:51.580238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7748d3c-a016-4766-8aa1-ad09ba9da9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ff22463e4c4ec6a65cd95f1b28cc99'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:51.614778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2884/5748] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:50 2022] DELETE /identity/v3/users/e2ff22463e4c4ec6a65cd95f1b28cc99 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:51.619031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:51.619373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:51.619578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:51.694374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:51.707759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:51.840327 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2865/5749] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:51.849829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:51.852482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:51.852898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:51.943259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:51.953146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:51.973466 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2866/5750] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:51.977304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:51.987168 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2885/5751] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:52.003583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:52.005202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50ee7-813f-483e-b46c-acdc50727a08 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.005467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:52.020451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.021357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.021819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.022262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.023068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:52.023524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:52.025281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:52.078603 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2867/5752] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:42:52.080035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:52.091630 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:52.116645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4570-4209-470e-a388-2b38c698828d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.149592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.150025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.150396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.150925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.151573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:52.153508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:52.182042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23868a1-12a4-4aa2-a57e-8df7d26d28e4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.191919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.200144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.200812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.202405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.227304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:52.229532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:52.238820 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:52.256501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2886/5753] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:42:52.339982 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2868/5754] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:52 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:52.344462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:52.356771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f37b1-b3fd-49b9-8148-6218902155da service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.486582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:52.550831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:52.741808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.742726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.743171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.743606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.744617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:52.747493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:52.778280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c273b2-5848-41d3-93aa-04784883a26e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.793874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.803613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.804012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.804365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.815681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:52.886421 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2887/5755] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:52 2022] POST /identity/v3/users => generated 289 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:52.890614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:52.906845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ffa-4251-4706-bc66-62665eabe7a1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:52.921312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:52.925990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:52.925990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:52.925990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:52.925990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:52.929144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:52.992217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2888/5756] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:52.995092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:53.028855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ed6b9-1622-4fdf-b36d-57cc930d7005 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:53.035809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:53.049534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:53.067509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:53.069879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:53.070508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:53.072796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:53.075800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:53.092886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a753ee-5087-46ab-9f4e-31ff0537cfe7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:53.114693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2869/5757] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:42:53.146394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:53.160763 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2889/5758] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:53.168992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab383d52-3905-40c2-be1c-49b8d81adb9e service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:53.185501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:53.187738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:53.188779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:53.192786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] PATH_INFO: `/v3/projects/24263fb6b29b4d6f943e55f98b75bc8d/users/3b73cee7518045f5aac211bfd060f58e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:53.256517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24263fb6b29b4d6f943e55f98b75bc8d, user_id=3b73cee7518045f5aac211bfd060f58e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:53.264717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:53.385975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:53.386365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:53.388015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:53.400875 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2870/5759] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:53 2022] PUT /identity/v3/projects/24263fb6b29b4d6f943e55f98b75bc8d/users/3b73cee7518045f5aac211bfd060f58e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:53.491285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] MFA Rules not processed for user `3b73cee7518045f5aac211bfd060f58e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:53.494909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:53.674962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2890/5760] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:53.680192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:53.893993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a48bc-980a-4b5b-9654-12cbdf51ee3f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:53.903725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:53.904926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:53.905700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:53.907320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:53.910551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:53.916109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:54.117033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:54.130821 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2871/5761] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:53 2022] POST /identity/v3/projects => generated 377 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:54.133288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b832f0-57ac-4adb-9000-8b1a3266abfe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:54.182335 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:54.303417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:54.304090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:54.304373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:54.304640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:54.305393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:54.318137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:54.354360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:54.354360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:54.372035 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:54.379210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777d1a2-f8ae-447b-8f70-b23df7ac6638 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:54.384119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:54.384696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:54.386546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:54.386800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] PATH_INFO: `/v3/projects/105f89d4825c4f48b375a2f5d80b764f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:54.387988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105f89d4825c4f48b375a2f5d80b764f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:54.390616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:54.451244 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2891/5762] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:42:54 2022] POST /identity/v3/users => generated 295 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:54.453401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:54.495125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee32f-273c-4399-bff8-53d2680021fc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:54.522723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:54.523374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:54.523655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:54.523929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:54.524706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:54.526371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:54.566942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2892/5763] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:54.571456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:54.597217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3c836-3d2d-4d65-a8ce-d4d043628440 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:54.629891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105f89d4825c4f48b375a2f5d80b764f', 'request_id': 'req-aab15fee-75a2-42ee-9354-2ec35fdf78b5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:54.656290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105f89d4825c4f48b375a2f5d80b764f', 'request_id': 'req-aab15fee-75a2-42ee-9354-2ec35fdf78b5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:54.745799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105f89d4825c4f48b375a2f5d80b764f', 'request_id': 'req-aab15fee-75a2-42ee-9354-2ec35fdf78b5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:54.780593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] The token cache is being invalidate because project 105f89d4825c4f48b375a2f5d80b764f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:54.781858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:54.787326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:54.793197 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2872/5764] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:54 2022] DELETE /identity/v3/projects/105f89d4825c4f48b375a2f5d80b764f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:42:54.797954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:54.809906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:54.930597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:54.931868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:54.932401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:54.932897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] PATH_INFO: `/v3/projects/5594140a9e034e088d5942cbd2b82298/users/e40701e383b14b0bbcdf1f606795edad/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:54.979756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5594140a9e034e088d5942cbd2b82298, user_id=e40701e383b14b0bbcdf1f606795edad, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:54.983568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:55.079030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15fee-75a2-42ee-9354-2ec35fdf78b5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:55.093830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:55.094486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:55.096752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:55.097066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] PATH_INFO: `/v3/users/c169787da9844ca7b71a931011a707b6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:55.102690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c169787da9844ca7b71a931011a707b6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:55.104657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:55.105548 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2893/5765] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:54 2022] PUT /identity/v3/projects/5594140a9e034e088d5942cbd2b82298/users/e40701e383b14b0bbcdf1f606795edad/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:55.110657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:55.114016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:55.435613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ae7d3-4df1-4a06-819e-fae51e3d60d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:55.469814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:55.470454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:55.470730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:55.470996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:55.472197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:55.474535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:55.476504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c169787da9844ca7b71a931011a707b6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:55.480639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c169787da9844ca7b71a931011a707b6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:55.505563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c169787da9844ca7b71a931011a707b6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:55.508145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c169787da9844ca7b71a931011a707b6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:55.517132 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2894/5766] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:55.518973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:55.524088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:55.562575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f97ce-b897-4881-810b-b2aaa684bd80 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:55.578063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:55.578865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:55.579240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:55.579612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] PATH_INFO: `/v3/projects/5594140a9e034e088d5942cbd2b82298/users/e40701e383b14b0bbcdf1f606795edad/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:55.584232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5594140a9e034e088d5942cbd2b82298, user_id=e40701e383b14b0bbcdf1f606795edad, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:55.592776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d571c80-3649-4bf5-80b8-cbd842b9c396 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:55.619670 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2895/5767] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:42:55 2022] PUT /identity/v3/projects/5594140a9e034e088d5942cbd2b82298/users/e40701e383b14b0bbcdf1f606795edad/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:55.621420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:55.622180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:55.622563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:55.650690 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:55.687714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] MFA Rules not processed for user `e40701e383b14b0bbcdf1f606795edad`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:42:55.689015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:55.751617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c169787da9844ca7b71a931011a707b6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:55.804774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2873/5768] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:54 2022] DELETE /identity/v3/users/c169787da9844ca7b71a931011a707b6 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:55.931478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:55.931763 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2896/5769] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:42:55.949171 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:56.184246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd046b2-897a-4d1f-941f-a8e36fc61ca7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:56.199746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:56.200296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:56.200594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:56.224806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:56.225616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:56.227858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:56.360264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2874/5770] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:55 2022] POST /identity/v3/projects => generated 333 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:56.364085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:56.375652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef791-e27e-407b-820e-42f905ed90f5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:56.573944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:56.579474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:56.579474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:56.579474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:56.579474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:56.579474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:56.720427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:56.721318 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2897/5771] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:42:56 2022] POST /identity/v3/projects => generated 333 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:42:56.763009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949d020-7f7f-4ae8-ad37-d5e60615ef1b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:57.002181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:57.005183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:57.005544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:57.005830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:57.006600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:57.012154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:57.219084 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2875/5772] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:42:56 2022] POST /identity/v3/projects => generated 358 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:42:57.220499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:57.240308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1ec4-19cf-44d8-b9a1-8dedf74d1edc tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:57.399381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:57.400010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:57.400290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:57.400562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:57.401202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:57.403513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:57.469358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:57.486040 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2898/5773] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:42:57 2022] GET /identity/v3/projects => generated 7927 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:42:57.488540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a7500-fbc5-435d-b722-f3e946beda9d tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:57.501189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:57.502965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:57.504625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:57.505165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:57.509063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:57.509607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:57.511856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:57.566770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:57.570254 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2876/5774] 10.222.0.13 () {58 vars in 1158 bytes} [Sun Oct 30 01:42:57 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:42:57.580253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becec404-cc07-462f-b988-fe187e845fff tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:57.594927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:57.599463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:57.599923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:57.600351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:57.601394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Adding query filter params (parent_id=4f74b9c20ced4321b3de1c90a76cb67b) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:42:57.602078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:57.604130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:57.666354 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:57.679535 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2899/5775] 10.222.0.13 () {58 vars in 1216 bytes} [Sun Oct 30 01:42:57 2022] GET /identity/v3/projects?parent_id=4f74b9c20ced4321b3de1c90a76cb67b => generated 498 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:42:57.684184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:57.696954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6db71-5fb2-4fc3-af09-7facf5d9becf tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:57.713310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:57.716010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:57.716624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:57.717117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects/85bbe4bfb73445e7b792b5f7b0140039` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:57.718835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85bbe4bfb73445e7b792b5f7b0140039)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:57.721011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:57.886122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bbe4bfb73445e7b792b5f7b0140039', 'request_id': 'req-f0f98655-f7e6-421b-860e-6129a5497daa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:57.890902 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:57.910532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bbe4bfb73445e7b792b5f7b0140039', 'request_id': 'req-f0f98655-f7e6-421b-860e-6129a5497daa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.020291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bbe4bfb73445e7b792b5f7b0140039', 'request_id': 'req-f0f98655-f7e6-421b-860e-6129a5497daa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.037013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] The token cache is being invalidate because project 85bbe4bfb73445e7b792b5f7b0140039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:58.037755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.038751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.042619 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2877/5776] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:57 2022] DELETE /identity/v3/projects/85bbe4bfb73445e7b792b5f7b0140039 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:58.046957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:58.048940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:58.081567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5dad-fe15-460e-9f5f-61067ad71611 tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:58.350049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:58.350709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:58.350993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:58.351270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects/4f74b9c20ced4321b3de1c90a76cb67b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:58.352500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f74b9c20ced4321b3de1c90a76cb67b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:58.354585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:58.563871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f74b9c20ced4321b3de1c90a76cb67b', 'request_id': 'req-6b105441-26cf-42b7-9653-bf069074fd0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.717118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f74b9c20ced4321b3de1c90a76cb67b', 'request_id': 'req-6b105441-26cf-42b7-9653-bf069074fd0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.732568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f74b9c20ced4321b3de1c90a76cb67b', 'request_id': 'req-6b105441-26cf-42b7-9653-bf069074fd0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.746878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] The token cache is being invalidate because project 4f74b9c20ced4321b3de1c90a76cb67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:58.747235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.748532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:58.755079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:58.758564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2900/5777] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:58 2022] DELETE /identity/v3/projects/4f74b9c20ced4321b3de1c90a76cb67b => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:58.770359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f98655-f7e6-421b-860e-6129a5497daa tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:58.795428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:58.796951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:59.029649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40701e383b14b0bbcdf1f606795edad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5594140a9e034e088d5942cbd2b82298', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:59.040865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:59.042304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:59.048345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] PATH_INFO: `/v3/projects/06f85f1c5ea442dca51f001c91d65a17` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:59.065496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06f85f1c5ea442dca51f001c91d65a17)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:59.093941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:59.198015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105441-26cf-42b7-9653-bf069074fd0f tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:59.208076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:59.209102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:59.209573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:59.210080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] PATH_INFO: `/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:59.212422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2f97bd11c84a398cc56a9c4ca221f9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:59.214784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:59.362254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f85f1c5ea442dca51f001c91d65a17', 'request_id': 'req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.386174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f85f1c5ea442dca51f001c91d65a17', 'request_id': 'req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.392663 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:59.455060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2f97bd11c84a398cc56a9c4ca221f9', 'request_id': 'req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.491446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f85f1c5ea442dca51f001c91d65a17', 'request_id': 'req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.515322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] The token cache is being invalidate because project 06f85f1c5ea442dca51f001c91d65a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:59.516753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.521035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.526621 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2878/5778] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:58 2022] DELETE /identity/v3/projects/06f85f1c5ea442dca51f001c91d65a17 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:59.532221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:59.538423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:59.634275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2f97bd11c84a398cc56a9c4ca221f9', 'request_id': 'req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.647871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2f97bd11c84a398cc56a9c4ca221f9', 'request_id': 'req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.668761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] The token cache is being invalidate because project 8f2f97bd11c84a398cc56a9c4ca221f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:42:59.669391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.671191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:42:59.672587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab375ff-7f40-4b66-8bfd-dfa6991c656b tempest-ListProjectsTestJSON-2078932302 tempest-ListProjectsTestJSON-2078932302-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:59.673491 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2901/5779] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:42:58 2022] DELETE /identity/v3/projects/8f2f97bd11c84a398cc56a9c4ca221f9 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:42:59.674638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:42:59.676363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:59.742881 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:42:59.796657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:59.798611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:59.799198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:59.799734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:59.801964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:42:59.829841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f71e-3f4f-4a57-b327-46a78d9007c8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:42:59.842665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:42:59.843320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:42:59.843602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:42:59.843871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] PATH_INFO: `/v3/users/3b73cee7518045f5aac211bfd060f58e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:42:59.845161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b73cee7518045f5aac211bfd060f58e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:59.852355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:59.940683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:42:59.947051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a58ef-5ea3-4830-9e56-7ed576de39d4 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:42:59.995445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2879/5780] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:42:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:00.001224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c83b-a407-4e98-aaa2-c2e9dfd0b9b5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.001666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c83b-a407-4e98-aaa2-c2e9dfd0b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.002974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18c83b-a407-4e98-aaa2-c2e9dfd0b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.112516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ad18c83b-a407-4e98-aaa2-c2e9dfd0b9b5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:00.114267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad18c83b-a407-4e98-aaa2-c2e9dfd0b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.147393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b73cee7518045f5aac211bfd060f58e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:00.175734 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2880/5781] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:00.185753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.185753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.185753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.230488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:00.232510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.246519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2881/5782] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:00.250957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b73cee7518045f5aac211bfd060f58e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:00.251628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b73cee7518045f5aac211bfd060f58e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:00.251749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:00.289979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b73cee7518045f5aac211bfd060f58e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:00.290508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc5c20-a714-4aba-a501-2f04668bf596 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:00.299928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-17ed97ef-9ee4-4c38-9da4-c71a0ad23fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b73cee7518045f5aac211bfd060f58e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:00.314415 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2902/5783] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:42:59 2022] DELETE /identity/v3/users/3b73cee7518045f5aac211bfd060f58e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:00.323462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.323765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.329082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.335893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:00.345558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.350962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.350962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.350962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:00.350962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:00.358554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:00.362871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:00.364409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.422046 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:00.439469 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2882/5784] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:00.439696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:00.449459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.497545 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2903/5785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:00.500183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:00.503889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.548144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309890f4-fb38-42e3-b4e1-be8700c277ba None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:00.566271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:00.570929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.571368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.571579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.572250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:00.592643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:00.657036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabdbb-04c5-4216-abdd-851329c0be78 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:00.743684 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2904/5786] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:00 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:00.748693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:00.842752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:00.844097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.845568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.845945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:00.851210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:00.885660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:00.890216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:00.908741 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:00.936127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2883/5787] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:00.941887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3891e7-80dc-47ec-9c0e-7e05a8afdb80 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:00.943851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:00.961929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:00.963141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:00.963141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:00.963511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:01.030750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a0b5-6ff2-44d8-8b4a-76d1557de056 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:01.136958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:01.139607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:01.164198 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2905/5788] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:01.416051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:01.417560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:01.420174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:01.421644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:01.424492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:01.428908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:01.627532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2884/5789] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:00 2022] POST /identity/v3/users => generated 285 bytes in 690 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:01.632209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:01.660092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68804-63de-4f03-bb9e-bb32081a23d7 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:01.677811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:01.677811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:01.677811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:01.677811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:01.678152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:01.678152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:01.714883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:01.728681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2906/5790] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:01.737955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e582de-578e-472f-9694-d4a493d52ab9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:01.783815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:01.784362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:01.784644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:01.785722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:01.786305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:01.795369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116d6e5-c200-41f6-964b-b09d1ce8b0a6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:01.828618 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2885/5791] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:01.832700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:01.855976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b43d-5b54-4ac6-90e4-d34696c9310a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:01.863179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:01.863855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:01.864180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:01.864453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] PATH_INFO: `/v3/projects/40b880a16cd64342a92c80b215d94d7a/users/c71189cb33a24ae88231dcb08512597b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:01.895171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b880a16cd64342a92c80b215d94d7a, user_id=c71189cb33a24ae88231dcb08512597b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:01.897280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:02.024129 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2907/5792] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:01 2022] PUT /identity/v3/projects/40b880a16cd64342a92c80b215d94d7a/users/c71189cb33a24ae88231dcb08512597b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:02.036221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:02.037241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:02.037942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:02.103634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] MFA Rules not processed for user `c71189cb33a24ae88231dcb08512597b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:02.105664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:02.303744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2886/5793] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:02.314295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:02.316715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:02.365714 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:02.394806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604adaa6-47ee-4ea8-987d-2d44940e99c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:02.399941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:02.400558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:02.400832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:02.401116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:02.410805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:02.412252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b833f7-6f30-48bb-86a9-21c4dc330052 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:02.423821 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2908/5794] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:02.927951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:02.930025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.035842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5af7f-f7fb-4400-a399-d002cd8091c6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:03.038006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5af7f-f7fb-4400-a399-d002cd8091c6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:03.041324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5af7f-f7fb-4400-a399-d002cd8091c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:03.051815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fb9e8-607f-4869-a963-e88c51b4d2e2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:03.079098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-70d5af7f-f7fb-4400-a399-d002cd8091c6 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:03.079339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:03.082949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:03.082949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:03.082949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:03.085578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70d5af7f-f7fb-4400-a399-d002cd8091c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.088842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.158274 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:03.322885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:03.322885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:03.364367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2887/5795] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:03.370981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:03.375580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.455623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2909/5796] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:03.459753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:03.460204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:03.460578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:03.501955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:03.504911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.543184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2910/5797] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:03.547027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:03.561919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:03.588057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6ee40-e0b3-4cd6-822c-ca4695517881 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:03.598287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:03.599162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:03.599602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:03.600032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] PATH_INFO: `/v3/projects/24263fb6b29b4d6f943e55f98b75bc8d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:03.605208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=24263fb6b29b4d6f943e55f98b75bc8d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:03.608565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:03.841149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b1d35-3f9c-4c82-b363-415ec646fb61 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:03.857472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:03.858213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:03.858357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:03.858713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:03.908965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:03.910517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:03.932680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24263fb6b29b4d6f943e55f98b75bc8d', 'request_id': 'req-73fbe430-32c4-4c55-8ecc-c54ebc621aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:03.940397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2911/5798] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:43:03.940803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24263fb6b29b4d6f943e55f98b75bc8d', 'request_id': 'req-73fbe430-32c4-4c55-8ecc-c54ebc621aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:03.941366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:03.969897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9add5f-9f45-42f4-9bc7-e7313f0f315a service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:04.045849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24263fb6b29b4d6f943e55f98b75bc8d', 'request_id': 'req-73fbe430-32c4-4c55-8ecc-c54ebc621aca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.092032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] The token cache is being invalidate because project 24263fb6b29b4d6f943e55f98b75bc8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:04.093294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.095257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.102136 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2888/5799] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:03 2022] DELETE /identity/v3/projects/24263fb6b29b4d6f943e55f98b75bc8d => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:04.103255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:04.109267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:04.109860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:04.109993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:04.110433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:04.111833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:04.115866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:04.131642 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:04.254660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbe430-32c4-4c55-8ecc-c54ebc621aca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:04.255937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:04.258172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a612a28-01cd-4e34-aad0-58c69d608063 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:04.268382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:04.269475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:04.271410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:04.271410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] PATH_INFO: `/v3/users/e40701e383b14b0bbcdf1f606795edad` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:04.272275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40701e383b14b0bbcdf1f606795edad)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:04.274408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:04.280309 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2912/5800] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:43:04.575399 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:04.691274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40701e383b14b0bbcdf1f606795edad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.692306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40701e383b14b0bbcdf1f606795edad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.702149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40701e383b14b0bbcdf1f606795edad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.707950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40701e383b14b0bbcdf1f606795edad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.874688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40701e383b14b0bbcdf1f606795edad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:04.915399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2889/5801] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:04 2022] DELETE /identity/v3/users/e40701e383b14b0bbcdf1f606795edad => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:05.767111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:05.767999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:05.768423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:05.800404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] MFA Rules not processed for user `b518f0cfeb024924b4181145412d3703`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:05.801990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:05.999560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2913/5802] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:06.012128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:06.022613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:06.055073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:06.055662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:06.223848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8d61d-09b6-46a9-aa5b-114dcfe8014d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:06.226023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb038c-67f1-4117-af6f-4e5b9007f74f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:06.242517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:06.242517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:06.244629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:06.245068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:06.245356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:06.248961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:06.249820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:06.250492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:06.252360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:06.258272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:06.280777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:06.283332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:06.322796 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2914/5803] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:06.322796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:06.323007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:06.357947 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:06.445739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:06.447763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019faf5-a34a-4a9c-aa3b-364201fd84bf service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:06.471826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2890/5804] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:06.563125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265d4e-75a1-430f-91ac-d4a15c05daaa service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:06.602789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:06.606399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:06.606399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:06.606399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] PATH_INFO: `/v3/projects/5594140a9e034e088d5942cbd2b82298` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:06.606399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5594140a9e034e088d5942cbd2b82298)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:06.627343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:06.732621 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:06.837035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5594140a9e034e088d5942cbd2b82298', 'request_id': 'req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:06.916572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5594140a9e034e088d5942cbd2b82298', 'request_id': 'req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:06.930732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5594140a9e034e088d5942cbd2b82298', 'request_id': 'req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:06.971402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] The token cache is being invalidate because project 5594140a9e034e088d5942cbd2b82298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:06.972550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:06.976929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46ab90f7-6ac4-4e0d-ae2c-4837228647ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:06.982719 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2915/5805] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:06 2022] DELETE /identity/v3/projects/5594140a9e034e088d5942cbd2b82298 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:06.988249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3753-d759-4483-bed1-57189e987392 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:06.988785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3753-d759-4483-bed1-57189e987392 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:06.989261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3753-d759-4483-bed1-57189e987392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.054615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a17d3753-d759-4483-bed1-57189e987392 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:07.056360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a17d3753-d759-4483-bed1-57189e987392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:07.204010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2891/5806] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:07.205686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:07.205971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:07.206242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.230721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:07.231990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:07.245602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2916/5807] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:07.250091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3753-d759-4483-bed1-57189e987392 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:07.266107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3753-d759-4483-bed1-57189e987392 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:07.298253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:07.299158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:07.301244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:07.302541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.304233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:07.307413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:07.314061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:07.362061 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2892/5808] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:07.364201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:07.377215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a9f63-c271-40e7-a7f3-481c7bcf9238 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:07.397522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:07.409392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:07.409392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:07.409392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.409392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:07.418194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c84f7-fec2-4e1c-bb02-426b75472df2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:07.618347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2917/5809] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:07 2022] POST /identity/v3/projects => generated 367 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:07.625515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:07.663085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f29eb-91c9-4a71-8876-a8cdf46016e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:07.816303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:07.817475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:07.817999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:07.818513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.819364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:07.821908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:07.929301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:07.932821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:07.932821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:07.959262 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2893/5810] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:07 2022] POST /identity/v3/users => generated 284 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:07.964269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:07.970622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:07.975250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:08.013793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cd67c-d046-4ac9-a47c-9a45731102a5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:08.037419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:08.038038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.039389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.040458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.043661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:08.051621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:08.090707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2894/5811] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:08.094891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:08.113979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2918/5812] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 30 01:43:08.117105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9d78-d816-4bb4-a24e-45049e1aff85 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:08.130151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:08.130373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:08.131587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:08.131801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.132227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.133976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.136008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:08.142786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:08.191818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2895/5813] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:08.192759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:08.201717 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:08.216843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45f67-58a1-4d92-bb40-3d0100281061 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:08.234512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:08.234512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.248751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.249066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] PATH_INFO: `/v3/projects/41edf2d0fb2a43499c5e21d4d5d1db92/users/13ecb1e18fc14d83ad04d4e533f7ea1b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.280614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41edf2d0fb2a43499c5e21d4d5d1db92, user_id=13ecb1e18fc14d83ad04d4e533f7ea1b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:08.283677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b437ff8-cc7d-4584-b7c5-587ff70ebb89 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:08.343207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47235067-014c-49f7-b280-576ad7fa9f56 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:08.387762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:08.387762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.387762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.387762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.388249 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2896/5814] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:08 2022] PUT /identity/v3/projects/41edf2d0fb2a43499c5e21d4d5d1db92/users/13ecb1e18fc14d83ad04d4e533f7ea1b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:08.395425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.395772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.396473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.396938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:08.399048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:08.420054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2919/5815] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:43:08.490375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] MFA Rules not processed for user `13ecb1e18fc14d83ad04d4e533f7ea1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:08.492053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:08.633659 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2897/5816] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:08.638015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:08.649191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495d8c-537c-4bbf-aaad-b98f65219389 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:08.755181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:08.755850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:08.756247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:08.756916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:08.757632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:08.760307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:08.886756 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2920/5817] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:08 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:08.891494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:08.916413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af222-fdbf-4e7b-9f55-2e2805c947d6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:09.124286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:09.127346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.127862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.128318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.129967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:09.135845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:09.167101 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:09.258268 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2898/5818] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:08 2022] POST /identity/v3/users => generated 289 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:09.262030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:09.287292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85bd4-bf8e-450f-94bc-e223a0b1130e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:09.305947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:09.306575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.307943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.309756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.311162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:09.316458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:09.330805 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2921/5819] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:09.339082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:09.365895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c550cd-759d-4f93-8db8-a8debe8aa642 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:09.384242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:09.385029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.385312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.385617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] PATH_INFO: `/v3/projects/b3077a80f18140e6af34907bfdd606c4/users/3f33b1eac66f4cee8a2ac41ecba0c2a5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.427317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3077a80f18140e6af34907bfdd606c4, user_id=3f33b1eac66f4cee8a2ac41ecba0c2a5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:09.430402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:09.530302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:09.532077 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2899/5820] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:09 2022] PUT /identity/v3/projects/b3077a80f18140e6af34907bfdd606c4/users/3f33b1eac66f4cee8a2ac41ecba0c2a5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:09.555333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746a635-f1f4-439a-93dd-8eaadb8b8433 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:09.743194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:09.743826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.744236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.744380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.745036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:09.751744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e8f07-8405-4cb5-90bd-6404f1e3b157 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:09.767644 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2922/5821] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:09.773010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:09.794737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949f51-2fb0-4170-843e-385a146a2bfc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:09.803941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:09.805222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.805222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.810178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] PATH_INFO: `/v3/projects/b3077a80f18140e6af34907bfdd606c4/users/3f33b1eac66f4cee8a2ac41ecba0c2a5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.810178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3077a80f18140e6af34907bfdd606c4, user_id=3f33b1eac66f4cee8a2ac41ecba0c2a5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:09.814350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:09.833718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2900/5822] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:09 2022] PUT /identity/v3/projects/b3077a80f18140e6af34907bfdd606c4/users/3f33b1eac66f4cee8a2ac41ecba0c2a5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:09.855421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46f14-0605-4025-8d61-369473685702 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:09.855721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46f14-0605-4025-8d61-369473685702 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:09.855991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46f14-0605-4025-8d61-369473685702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:09.917673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3cf46f14-0605-4025-8d61-369473685702 None None] MFA Rules not processed for user `3f33b1eac66f4cee8a2ac41ecba0c2a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:09.918908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cf46f14-0605-4025-8d61-369473685702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:10.073891 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:10.099127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2923/5823] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:10.103758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:10.122080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702db8-8149-4e24-ba68-586e60546576 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:10.135478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:10.136992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.137769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.143094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.143810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:10.149803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:10.165470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.171377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.171377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.213498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:10.213938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:10.283236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2901/5824] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:43:10 2022] POST /identity/v3/domains => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:10.288851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:10.354965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2924/5825] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:43:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:10.383851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:10.414525 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:10.430025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d47b8-7bd0-43ab-88ba-d97874991380 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:10.451539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:10.451539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.451539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.451885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.452910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:10.454982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:10.528809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf840-6de8-4fe5-a865-fd7207a93c3d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:10.611054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:10.611748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.612034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.612302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.647504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2902/5826] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:10 2022] POST /identity/v3/users => generated 347 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:10.656004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:10.677023 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:10.680398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d688970-3199-4bd6-95e0-23a64f10d3f5 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:10.686253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:10.687133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.687859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.688344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.689180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:10.692589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:10.797818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:10.801550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:10.813706 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2925/5827] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:43:10.916020 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2903/5828] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:10 2022] POST /identity/v3/users => generated 322 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:10.917198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:10.932485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fd0ab-3351-43a3-8dea-5d25cc9d6af8 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:10.945603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:10.946258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:10.946538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:10.946816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users/d8d2b2ad59534a488f932139572e1d49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:10.987628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:get_user(user_id=d8d2b2ad59534a488f932139572e1d49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.009502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.016605 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2926/5829] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:43:10 2022] GET /identity/v3/users/d8d2b2ad59534a488f932139572e1d49 => generated 347 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:11.018186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:11.039783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9127389-47da-45e7-b961-9c4deeec8849 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:11.076716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:11.077387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.077650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.077925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.078654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Adding query filter params (domain_id=c550b82a722f4201b68e4ecad9acee93) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:11.078959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.081118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.179806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2904/5830] 10.222.0.13 () {58 vars in 1207 bytes} [Sun Oct 30 01:43:11 2022] GET /identity/v3/users?domain_id=c550b82a722f4201b68e4ecad9acee93 => generated 484 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:11.182442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:11.202386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21464e5-7a9e-40bf-af74-8c27132ff0f6 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:11.243191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:11.244196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.244691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.245518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.247674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.252738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc098-b543-4d5a-b570-c06a84276c29 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.322065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2927/5831] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:11 2022] GET /identity/v3/users => generated 9145 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:11.327474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:11.344018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9657f89-d9c4-4b8a-bc5d-553437a80ad8 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:11.353837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:11.355544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.356045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.356707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.358226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Adding query filter params (name=tempest-test_user-2030318521) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:11.358863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.361677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.433678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.435412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.435869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.439593 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2905/5832] 10.222.0.13 () {58 vars in 1189 bytes} [Sun Oct 30 01:43:11 2022] GET /identity/v3/users?name=tempest-test_user-2030318521 => generated 475 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:11.440715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:11.453826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a72999-a884-42a8-9163-97265db461b1 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:11.459863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:11.462110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.462110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.462776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.463922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:11.464435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.467013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.467400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] MFA Rules not processed for user `759025c4133f4074ba59beb1a08c7a21`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:11.469407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:11.499070 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2906/5833] 10.222.0.13 () {58 vars in 1149 bytes} [Sun Oct 30 01:43:11 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:11.501214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:11.529745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350feb-3207-496c-bade-d3f228324cff tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:11.546329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:11.546989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:11.547394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:11.547546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users/21d1639f140d499cb53bcd5569b6ff3d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:11.565392 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2928/5834] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:11.588863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:delete_user(user_id=21d1639f140d499cb53bcd5569b6ff3d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:11.596700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:11.789156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d1639f140d499cb53bcd5569b6ff3d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:11.789156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d1639f140d499cb53bcd5569b6ff3d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:11.797537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d1639f140d499cb53bcd5569b6ff3d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:11.798067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d1639f140d499cb53bcd5569b6ff3d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:11.975869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9958b265-a324-4e7b-9368-dbf9ab1c3236 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d1639f140d499cb53bcd5569b6ff3d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.031264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2907/5835] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:11 2022] DELETE /identity/v3/users/21d1639f140d499cb53bcd5569b6ff3d => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:12.033507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:12.068736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0cd82-37bb-4178-bec3-f2464ba7863c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:12.182995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:12.183698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:12.185296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:12.185296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/users/d8d2b2ad59534a488f932139572e1d49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:12.185851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d8d2b2ad59534a488f932139572e1d49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:12.188072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:12.225242 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:12.381179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d2b2ad59534a488f932139572e1d49'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.438440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:12.438993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:12.438993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:12.502724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:12.506087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:12.545047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d2b2ad59534a488f932139572e1d49'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.546707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d2b2ad59534a488f932139572e1d49'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.581108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d2b2ad59534a488f932139572e1d49'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.617973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d2b2ad59534a488f932139572e1d49'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.640830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2929/5836] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:12 2022] DELETE /identity/v3/users/d8d2b2ad59534a488f932139572e1d49 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:12.645362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:12.655939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:12.667771 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:12.705937 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2908/5837] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:12.734339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:12.736228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:12.874050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591468da-0d47-49cb-836b-4ef50b6310c2 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:12.909427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:12.911328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:12.911626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:12.911908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/domains/c550b82a722f4201b68e4ecad9acee93` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:12.916221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c550b82a722f4201b68e4ecad9acee93)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:12.919890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:12.958133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768e8cb-0add-4888-ac28-15b64bf87461 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:12.982818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:12.984248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.118456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.122128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.130562 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2930/5838] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:12 2022] PATCH /identity/v3/domains/c550b82a722f4201b68e4ecad9acee93 => generated 276 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:13.130740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:13.134396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:13.135477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:13.138579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:13.138890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:13.139048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:13.143498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:13.365548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f94d2-b8f8-48c1-bb2f-f2db93593eb7 tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:13.418100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f33b1eac66f4cee8a2ac41ecba0c2a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3077a80f18140e6af34907bfdd606c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:13.418392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:13.418674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:13.418948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] PATH_INFO: `/v3/domains/c550b82a722f4201b68e4ecad9acee93` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:13.421025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:13.432490 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:13.432780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:13.450017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c550b82a722f4201b68e4ecad9acee93)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:13.463280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:13.473419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2909/5839] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:43:13.517295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.535088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.764576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.865312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.883155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.937944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] The token cache is being invalidate because project c550b82a722f4201b68e4ecad9acee93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:13.937944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.942570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.967294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.970168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:13.971297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c550b82a722f4201b68e4ecad9acee93', 'request_id': 'req-61aaf967-15fc-4412-a7b6-25b7f97c03bb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.000196 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2931/5840] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:43:13 2022] DELETE /identity/v3/domains/c550b82a722f4201b68e4ecad9acee93 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:14.004119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:14.005827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:14.083134 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:14.149858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2913b9-9316-40e6-8848-96a6b600f46e service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:14.276067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:14.276734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:14.277010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:14.277285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] PATH_INFO: `/v3/users/13ecb1e18fc14d83ad04d4e533f7ea1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:14.281043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ecb1e18fc14d83ad04d4e533f7ea1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:14.285876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:14.559337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ecb1e18fc14d83ad04d4e533f7ea1b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.561172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ecb1e18fc14d83ad04d4e533f7ea1b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.596756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:14.597730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ecb1e18fc14d83ad04d4e533f7ea1b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.598345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:14.601100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ecb1e18fc14d83ad04d4e533f7ea1b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.628170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaf967-15fc-4412-a7b6-25b7f97c03bb tempest-UsersV3TestJSON-654598908 tempest-UsersV3TestJSON-654598908-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:14.645779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:14.646439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:14.646720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:14.647013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] PATH_INFO: `/v3/users/2ea515c9dbf645828f6f67c9f6bbc541` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:14.650980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea515c9dbf645828f6f67c9f6bbc541)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:14.657900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:14.688579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c5682d3b-bde7-4814-a447-4a5c9e00b7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ecb1e18fc14d83ad04d4e533f7ea1b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:14.746929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2910/5841] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:14 2022] DELETE /identity/v3/users/13ecb1e18fc14d83ad04d4e533f7ea1b => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:14.759666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:14.760005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:14.762156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:14.818516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:14.820171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:14.932110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea515c9dbf645828f6f67c9f6bbc541'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:15.059411 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:15.062979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea515c9dbf645828f6f67c9f6bbc541'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:15.064472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea515c9dbf645828f6f67c9f6bbc541'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:15.081072 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2911/5842] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:15.096290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:15.098133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:15.101129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea515c9dbf645828f6f67c9f6bbc541'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:15.135316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea515c9dbf645828f6f67c9f6bbc541'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:15.152963 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2932/5843] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:14 2022] DELETE /identity/v3/users/2ea515c9dbf645828f6f67c9f6bbc541 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:15.286662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9d456-593f-46ee-825c-0ba545dacd6b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:15.458764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:15.459601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:15.459859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:15.460151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:15.622913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:15.622913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:15.670476 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:15.727252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:15.728735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be53a8-acd8-4f2b-8794-d0e7dff9cb23 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:15.777246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2912/5844] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:15.819025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8837c-f4a4-4a75-95b0-5f43ccebac73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:15.832369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:15.841681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:15.841681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:15.841681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] PATH_INFO: `/v3/projects/8512b08f05db4a469827368f47fb4c28` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:15.841681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8512b08f05db4a469827368f47fb4c28)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:15.841681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:16.065947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8512b08f05db4a469827368f47fb4c28', 'request_id': 'req-3000db8c-72df-43f5-b353-a3c975c32bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.177296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8512b08f05db4a469827368f47fb4c28', 'request_id': 'req-3000db8c-72df-43f5-b353-a3c975c32bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.185689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8512b08f05db4a469827368f47fb4c28', 'request_id': 'req-3000db8c-72df-43f5-b353-a3c975c32bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.209818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] The token cache is being invalidate because project 8512b08f05db4a469827368f47fb4c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:16.211906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.216283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3000db8c-72df-43f5-b353-a3c975c32bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.227189 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2933/5845] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:15 2022] DELETE /identity/v3/projects/8512b08f05db4a469827368f47fb4c28 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:16.232952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:16.233504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:16.234663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:16.296938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:16.311747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:16.526572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2913/5846] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:16.534463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:16.534906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:16.535018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:16.585326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:16.588285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:16.612393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:16.614891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:16.629982 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2934/5847] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:16.630881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:16.641521 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:16.657684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17caf321-e3d5-4486-99e8-79988f28f9ff None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:16.660908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cc155-659d-45a2-b6cb-af5bc527cce4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:16.673318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:16.678241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:16.678528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:16.678803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] PATH_INFO: `/v3/projects/41edf2d0fb2a43499c5e21d4d5d1db92` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:16.681653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:16.682185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:16.682490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:16.682714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:16.683365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:16.687224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41edf2d0fb2a43499c5e21d4d5d1db92)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:16.691965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:16.696476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:16.698240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:16.744754 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2935/5848] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:16.745744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:16.768788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f3f5-e5fc-4065-9140-4f74c10020be admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:16.783818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:16.784660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:16.785094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:16.785541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:16.786486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:16.789194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:16.937408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41edf2d0fb2a43499c5e21d4d5d1db92', 'request_id': 'req-47531fda-8361-4348-b2cd-f292a501752e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.945216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41edf2d0fb2a43499c5e21d4d5d1db92', 'request_id': 'req-47531fda-8361-4348-b2cd-f292a501752e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:16.992673 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2936/5849] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:16 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:16.993886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:17.058002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41edf2d0fb2a43499c5e21d4d5d1db92', 'request_id': 'req-47531fda-8361-4348-b2cd-f292a501752e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.078676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] The token cache is being invalidate because project 41edf2d0fb2a43499c5e21d4d5d1db92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:17.079225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.094561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.103423 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2914/5850] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:16 2022] DELETE /identity/v3/projects/41edf2d0fb2a43499c5e21d4d5d1db92 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:17.104652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:17.106154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:17.165673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98853fc3-290a-478f-a2d0-6bf93d08f7e4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:17.181644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:17.182298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.182649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.182943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.183648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:17.190249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:17.223108 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:17.267698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531fda-8361-4348-b2cd-f292a501752e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:17.295835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:17.295835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.295835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.295835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] PATH_INFO: `/v3/users/3f33b1eac66f4cee8a2ac41ecba0c2a5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.296385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f33b1eac66f4cee8a2ac41ecba0c2a5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:17.296385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:17.346138 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2937/5851] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:16 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:17.351532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:17.362217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:17.406076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99434e3-4711-432c-ac5a-33bf6a9741ec admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:17.419990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:17.420875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.421399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.421840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.422653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:17.424860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:17.437567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2938/5852] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:17.441392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:17.461103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88235ed-43bb-431c-96c3-ba09f966b559 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:17.485280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:17.491228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.491594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.491945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.494295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:17.497825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:17.521294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2939/5853] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:17.526472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:17.557818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1bb5b-63c9-4410-ae63-ecca5a677cc0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:17.572717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:17.573446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.573680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.573960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] PATH_INFO: `/v3/projects/90c2fcd7d4554e92a664a899423bfb31/users/8d9bdc3da2ef45ebaaf7536832c75df9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.576202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f33b1eac66f4cee8a2ac41ecba0c2a5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.577727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f33b1eac66f4cee8a2ac41ecba0c2a5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.601752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f33b1eac66f4cee8a2ac41ecba0c2a5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.604195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f33b1eac66f4cee8a2ac41ecba0c2a5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.610267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2fcd7d4554e92a664a899423bfb31, user_id=8d9bdc3da2ef45ebaaf7536832c75df9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:17.617116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb59e9-7252-4963-868c-eadbfb5ff143 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:17.694685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f33b1eac66f4cee8a2ac41ecba0c2a5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:17.729972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2940/5854] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:17 2022] PUT /identity/v3/projects/90c2fcd7d4554e92a664a899423bfb31/users/8d9bdc3da2ef45ebaaf7536832c75df9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:17.733804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:17.734085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:17.734348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:17.739236 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2915/5855] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:17 2022] DELETE /identity/v3/users/3f33b1eac66f4cee8a2ac41ecba0c2a5 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:17.848269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] MFA Rules not processed for user `8d9bdc3da2ef45ebaaf7536832c75df9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:17.849556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:18.033860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2941/5856] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:18.046325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:18.048294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:18.063526 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:18.213246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d94-6edf-42ee-afc7-6adb965c7529 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:18.229966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:18.230984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:18.232130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:18.233087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:18.259007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:18.260500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea54b2-80fa-428c-a147-3bb3f67c97fd service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:18.284337 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2916/5857] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:19.085856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:19.087622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:19.248767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f937ef2-2e7c-464b-b7a6-bc5f4636f365 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:19.276639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:19.277615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:19.279261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:19.279789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] PATH_INFO: `/v3/projects/b3077a80f18140e6af34907bfdd606c4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:19.281117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3077a80f18140e6af34907bfdd606c4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:19.284184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:19.661750 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:19.729266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3077a80f18140e6af34907bfdd606c4', 'request_id': 'req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:19.867087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3077a80f18140e6af34907bfdd606c4', 'request_id': 'req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:19.898880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3077a80f18140e6af34907bfdd606c4', 'request_id': 'req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:19.992478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] The token cache is being invalidate because project b3077a80f18140e6af34907bfdd606c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:19.992478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:19.996649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5ea24e8-1356-46fc-9d93-94d0ab7e8c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:20.003234 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2942/5858] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:19 2022] DELETE /identity/v3/projects/b3077a80f18140e6af34907bfdd606c4 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:20.009451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f330-864e-4e03-b096-45d671275329 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:20.018626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f330-864e-4e03-b096-45d671275329 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:20.021456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f330-864e-4e03-b096-45d671275329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:20.067533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0089f330-864e-4e03-b096-45d671275329 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:20.068747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0089f330-864e-4e03-b096-45d671275329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:20.217039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2917/5859] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:20.224233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:20.224810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:20.224810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:20.334087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:20.336126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:20.374842 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2943/5860] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:20.380545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089f330-864e-4e03-b096-45d671275329 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:20.396028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089f330-864e-4e03-b096-45d671275329 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:20.416287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:20.417070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:20.417309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:20.417615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:20.429099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:20.429099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:20.429099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:20.469621 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2918/5861] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:20.474293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:20.490975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5cf60-519c-4b92-be2c-8c01809ef78f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:20.498926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:20.500418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:20.501049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:20.501655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:20.503132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:20.506172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:20.647693 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2944/5862] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:20 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:20.652311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:20.672647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fca6-98d8-45f4-83c3-d5df649b0dba admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:20.841921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:20.842893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:20.843251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:20.843534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:20.846062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:20.848265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:20.993016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:20.995102 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2919/5863] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:20 2022] POST /identity/v3/users => generated 284 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:21.007614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cc767-3070-4e15-9aff-7eec0224fcdb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:21.050297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:21.052023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:21.052714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:21.053154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:21.054177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:21.060935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:21.097212 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2945/5864] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:21.100764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:21.138180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b58ce-0f81-494e-a986-bae1a66e0707 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:21.147217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:21.148112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:21.148552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:21.149190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:21.150219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:21.152003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735db1d-df51-4c45-a721-a000850982fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:21.164666 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2920/5865] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:21.168573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:21.200761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284838c-d382-4034-b420-9807a8b94826 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:21.215485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:21.216611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:21.217505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:21.218035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] PATH_INFO: `/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/deddcae2c9b840838253d402b126ba7a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:21.277689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566be415929a4e848d3d0217a42b2b5a, user_id=deddcae2c9b840838253d402b126ba7a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:21.305087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:21.436347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2946/5866] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:21 2022] PUT /identity/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/deddcae2c9b840838253d402b126ba7a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:21.437546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:21.437837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:21.438112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:21.550877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] MFA Rules not processed for user `deddcae2c9b840838253d402b126ba7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:21.560636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:21.580358 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:21.844985 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2921/5867] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:21.849609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:22.050343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412b602-64f5-4ac2-907f-cc2cc30a30a9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:22.077861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:22.078981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:22.079487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:22.080052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:22.080928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:22.083378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:22.190738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2947/5868] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:21 2022] POST /identity/v3/projects => generated 369 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:22.194507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:22.222160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa324b6-3941-4bae-9795-20096765cd91 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:22.408280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:22.409080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:22.409361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:22.411921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:22.412777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:22.418054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:22.515170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2922/5869] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:22 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:22.519830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:22.537226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83b824-0396-49b0-912c-2ee2a990093f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:22.550780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:22.557849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:22.564320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:22.564941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:22.566082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:22.568770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:22.623117 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2948/5870] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:22.626653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:22.641024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166eb9-8f85-4745-971f-b9428298d5d5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:22.666058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:22.667234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:22.668025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:22.668801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] PATH_INFO: `/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:22.736568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc1dc65ce9d47f0b336f910690b7b21, user_id=8531a3a0ec7d434ab8d9e5c2c68ae4c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:22.739407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:22.875178 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2923/5871] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:22 2022] PUT /identity/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:22.888195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:22.912082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc47bd-ce66-4b83-994e-d8e2faaf33ee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:23.045483 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:23.102930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:23.103466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:23.103742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:23.104009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:23.104730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:23.110440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223aa09-1d82-4295-8ea9-9e087471743c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:23.131390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2949/5872] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:23.135950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:23.151728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295abb2-fc15-451a-ac9b-af4f0844c497 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:23.168151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:23.169764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:23.170329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:23.170572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] PATH_INFO: `/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:23.174380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc1dc65ce9d47f0b336f910690b7b21, user_id=8531a3a0ec7d434ab8d9e5c2c68ae4c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:23.177116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:23.227490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2924/5873] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:23 2022] PUT /identity/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:23.243912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:23.244173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:23.244463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:23.296233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] MFA Rules not processed for user `8531a3a0ec7d434ab8d9e5c2c68ae4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:23.298743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:23.460584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2950/5874] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:23.465282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:23.581890 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:23.594087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7c48d-f535-4bb5-af5e-9490b6ea0318 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:23.606476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:23.607343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:23.607684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:23.608058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:23.608801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:23.613616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:23.853428 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2925/5875] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:23 2022] POST /identity/v3/projects => generated 369 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:23.854775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:23.870452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58750d92-b4bf-43fd-8b0c-bc795456b3fe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:24.101149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:24.101816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.102097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.102437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.103230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:24.107462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:24.249460 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2951/5876] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:23 2022] POST /identity/v3/users => generated 285 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:24.253252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:24.265535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b742-2136-4d35-8aac-1ad0efadc38f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:24.270785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:24.271671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.272155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.272791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.273663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:24.275716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:24.291264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2926/5877] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:24.294877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:24.318404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3485a0-7bca-4007-aafa-c98b0c06f1dc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:24.350833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:24.351455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.353551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.353551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.353551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:24.361765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec26099-3dab-45ba-af4e-6060da7f30b7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:24.418303 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2952/5878] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:24.422301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:24.452338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2347-3ca1-4482-b694-5026308c75fe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:24.482490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:24.484070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.484551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.491985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] PATH_INFO: `/v3/projects/87ed1543a5864122a84d2ab8dd1a25de/users/e2cecf013c31405a960cfc9f588622d0/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.567496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ed1543a5864122a84d2ab8dd1a25de, user_id=e2cecf013c31405a960cfc9f588622d0, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:24.575450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9ff09-a0b7-452f-8223-57f72db37f8c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:24.676339 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2927/5879] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:24 2022] PUT /identity/v3/projects/87ed1543a5864122a84d2ab8dd1a25de/users/e2cecf013c31405a960cfc9f588622d0/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:24.696172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.696544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.696753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.704034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:24.709180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:24.709180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:24.780390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:24.789129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:24.825416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] MFA Rules not processed for user `e2cecf013c31405a960cfc9f588622d0`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:24.830030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:24.978787 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:25.030948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2928/5880] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:25.102282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2953/5881] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:25.103606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:25.259464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6279180-ff66-4ce2-8032-551aab774d99 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:25.272595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:25.273473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:25.273757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:25.274033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:25.274720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:25.283179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:25.379095 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2929/5882] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:43:25 2022] POST /identity/v3/domains => generated 274 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:25.383547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:25.413543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9dda8-a1d0-4abb-93cb-21159f991f1c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:25.558052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:25.558664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:25.558945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:25.559819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:25.560492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:25.562122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:25.666378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2954/5883] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:43:25 2022] POST /identity/v3/roles => generated 239 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:25.667579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:25.679228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfc267-1e23-425f-b303-0bb8f6c2dd27 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:25.696112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:25.696799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:25.697086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:25.697382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/afb5f8c825dd430daa31c4635979c29a/users/e2cecf013c31405a960cfc9f588622d0/roles/aed29353c3fe4dc3a5ca096c801b41ad` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:25.730035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=afb5f8c825dd430daa31c4635979c29a, user_id=e2cecf013c31405a960cfc9f588622d0, role_id=aed29353c3fe4dc3a5ca096c801b41ad)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:25.733596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:25.845108 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2930/5884] 10.222.0.13 () {60 vars in 1480 bytes} [Sun Oct 30 01:43:25 2022] PUT /identity/v3/domains/afb5f8c825dd430daa31c4635979c29a/users/e2cecf013c31405a960cfc9f588622d0/roles/aed29353c3fe4dc3a5ca096c801b41ad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:25.846214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:25.861673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a6c1-55b8-4f03-9ec3-7bd5f2b68d79 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:26.064917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:26.096109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:26.098777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:26.099977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:26.104695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:26.107832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:26.258687 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2955/5885] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:43:25 2022] POST /identity/v3/domains => generated 276 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:26.262320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:26.283724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8c26-03c2-4fc0-980e-94bb26b715e4 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:26.351458 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:26.461468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:26.461468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:26.461468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:26.461863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:26.482097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:26.489896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:26.609007 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2931/5886] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:43:26 2022] POST /identity/v3/roles => generated 240 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:26.611540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:26.630841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5484-2252-41df-86c9-ba716f6f57c1 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:26.637092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:26.638355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:26.638623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:26.639003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:26.639665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:26.641676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:26.774270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:26.777835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2956/5887] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:43:26 2022] POST /identity/v3/groups => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:26.808415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7bc0d-0d3d-445c-bf9c-b53721952010 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:26.823330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:26.824410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:26.827955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:26.827955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/3e88a5293cea405c940e44f57f63eca2/users/e2cecf013c31405a960cfc9f588622d0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:26.842070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3e88a5293cea405c940e44f57f63eca2, user_id=e2cecf013c31405a960cfc9f588622d0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:26.844380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:26.952455 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2932/5888] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:43:26 2022] PUT /identity/v3/groups/3e88a5293cea405c940e44f57f63eca2/users/e2cecf013c31405a960cfc9f588622d0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:26.957368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:27.000872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e548a8-bf98-4134-81c1-b4247b965583 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:27.110014 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:27.261552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:27.261552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:27.261552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:27.262511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98/groups/3e88a5293cea405c940e44f57f63eca2/roles/2d31bd8423814fd0949f401fe1449518` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:27.262511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f9fe7e6bc98c42cc8ac0549e98016f98, group_id=3e88a5293cea405c940e44f57f63eca2, role_id=2d31bd8423814fd0949f401fe1449518)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:27.262511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:27.561085 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2957/5889] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:26 2022] PUT /identity/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98/groups/3e88a5293cea405c940e44f57f63eca2/roles/2d31bd8423814fd0949f401fe1449518 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:27.565242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:27.587144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1bf1-eefa-47cf-89c0-16a0957d598e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:27.759485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:27.760557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:27.760992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:27.761902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:27.763325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:27.765319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:27.853076 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2933/5890] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:43:27 2022] POST /identity/v3/domains => generated 277 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:27.856927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:27.872097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eed960-fded-46a3-af27-32adc19888eb tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:28.040537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:28.041247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:28.042391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:28.044887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:28.047296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:28.052484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:28.138549 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2958/5891] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:43:27 2022] POST /identity/v3/roles => generated 239 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:28.141021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:28.167868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2d9b1-eef9-4dcd-8293-4fd277d41531 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:28.185712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:28.186500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:28.186798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:28.187085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/62ae75f00757453b9d53adab182eaf92/users/e2cecf013c31405a960cfc9f588622d0/roles/f64bc814c116497682408c989360cb1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:28.225648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=62ae75f00757453b9d53adab182eaf92, user_id=e2cecf013c31405a960cfc9f588622d0, role_id=f64bc814c116497682408c989360cb1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:28.229383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:28.318286 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2934/5892] 10.222.0.13 () {60 vars in 1480 bytes} [Sun Oct 30 01:43:28 2022] PUT /identity/v3/domains/62ae75f00757453b9d53adab182eaf92/users/e2cecf013c31405a960cfc9f588622d0/roles/f64bc814c116497682408c989360cb1b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:28.324849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:28.340995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51ad32-24ec-4de0-a45a-667d80543a8f tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:28.507025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:28.507745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:28.507997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:28.508434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:28.509823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:28.511716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:28.639260 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2959/5893] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:43:28 2022] POST /identity/v3/domains => generated 276 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:28.639998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:28.659157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651dd7b-1e05-4221-9c19-ad095bb32c5e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:28.891143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:28.892025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:28.892264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:28.892624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:28.893249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:28.894982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:28.977041 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:28.991514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:29.007993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2935/5894] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:43:28 2022] POST /identity/v3/roles => generated 238 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:29.020909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e02f34-7f6b-463d-9c36-04a2c4efc3da tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:29.067556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:29.069686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:29.070725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:29.071090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:29.071680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:29.076083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:29.674053 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2960/5895] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:43:28 2022] POST /identity/v3/groups => generated 326 bytes in 680 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:29.675316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:29.688447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ee8c-ac23-4fd1-846a-30184ae46d9d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:29.692594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:29.693546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:29.694072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:29.694452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11/users/e2cecf013c31405a960cfc9f588622d0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:29.701406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=70e1a96ab35d407aa3c53f2e4a648a11, user_id=e2cecf013c31405a960cfc9f588622d0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:29.703463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:29.820744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2936/5896] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:43:29 2022] PUT /identity/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11/users/e2cecf013c31405a960cfc9f588622d0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:29.820858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:29.841777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bdfdf-d42f-4835-95f1-64ed3bef686b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:29.900184 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:29.957661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:29.958471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:29.958801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:29.959805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/6100acd9b8164f59b07803100593cd22/groups/70e1a96ab35d407aa3c53f2e4a648a11/roles/d355bb333cc64e3f85e26038903803b1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:29.962894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6100acd9b8164f59b07803100593cd22, group_id=70e1a96ab35d407aa3c53f2e4a648a11, role_id=d355bb333cc64e3f85e26038903803b1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:29.976439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:30.077247 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2961/5897] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:29 2022] PUT /identity/v3/domains/6100acd9b8164f59b07803100593cd22/groups/70e1a96ab35d407aa3c53f2e4a648a11/roles/d355bb333cc64e3f85e26038903803b1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:30.079555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:30.217433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:30.219596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:30.228602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2bf5-c9c3-4f50-9c5d-280796199aa6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:30.342905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0470c-68c3-4ba2-a383-1911881e3b98 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:30.347264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:30.348811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:30.348811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:30.348811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:30.357730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:30.363005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2cecf013c31405a960cfc9f588622d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87ed1543a5864122a84d2ab8dd1a25de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:30.363636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:30.363923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:30.364203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] PATH_INFO: `/v3/auth/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:30.365091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:30.366471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:30.383153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:30.388977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:30.401647 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2962/5898] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:43:30.436647 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:30.483257 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2937/5899] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:43:30 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:43:30.485898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:30.595037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd56b2-1a9f-463e-890d-e38f9a4eeda4 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:30.602632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:30.603665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:30.604179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:30.605219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/6100acd9b8164f59b07803100593cd22/groups/70e1a96ab35d407aa3c53f2e4a648a11/roles/d355bb333cc64e3f85e26038903803b1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:30.608258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6100acd9b8164f59b07803100593cd22, group_id=70e1a96ab35d407aa3c53f2e4a648a11, role_id=d355bb333cc64e3f85e26038903803b1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:30.613389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:30.639953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role d355bb333cc64e3f85e26038903803b1 was removed from group 70e1a96ab35d407aa3c53f2e4a648a11 on domain 6100acd9b8164f59b07803100593cd22. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:30.640577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:30.641569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:30.750859 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2963/5900] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:43:30 2022] DELETE /identity/v3/domains/6100acd9b8164f59b07803100593cd22/groups/70e1a96ab35d407aa3c53f2e4a648a11/roles/d355bb333cc64e3f85e26038903803b1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:30.753093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:30.755018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:30.775398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44237fdb-0832-4f7e-9763-da7b7fc25167 tempest-TokensV3TestJSON-1720463931 tempest-TokensV3TestJSON-1720463931-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:30.930723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:30.931545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:30.934922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:30.934922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11/users/e2cecf013c31405a960cfc9f588622d0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:30.937827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=70e1a96ab35d407aa3c53f2e4a648a11, user_id=e2cecf013c31405a960cfc9f588622d0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:30.940449 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:43:30.940449 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:43:30.940449 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:43:30.950200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:30.952464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:30.954135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:31.047741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:31.177430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2938/5901] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:43:30 2022] DELETE /identity/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11/users/e2cecf013c31405a960cfc9f588622d0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:31.178493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:31.211788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde01d98-81e6-4a7c-b256-b5f6122136dd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:31.249739 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:31.381834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:31.382331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:31.382643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:31.382877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:31.386780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:31.452569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae5549-d3c4-4d0d-aac1-467c5c19803e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:31.494865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:31.500000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:31.510111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:31.516487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:31.522417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:31.523295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=70e1a96ab35d407aa3c53f2e4a648a11)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:31.524201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:31.530822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:31.549543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2964/5902] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:31.731816 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2939/5903] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:43:31 2022] DELETE /identity/v3/groups/70e1a96ab35d407aa3c53f2e4a648a11 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:31.736052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:31.749834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f198fe-9f30-4bde-8256-6704f79e8a4d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:31.912935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:31.914005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:31.919304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:31.919304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles/d355bb333cc64e3f85e26038903803b1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:31.919304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d355bb333cc64e3f85e26038903803b1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:31.922014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:32.087421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role d355bb333cc64e3f85e26038903803b1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:32.087733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.091273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.093469 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2965/5904] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:31 2022] DELETE /identity/v3/roles/d355bb333cc64e3f85e26038903803b1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:32.097544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:32.099333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:32.120911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf60638-08c2-45a7-a1cc-e97ab3796437 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:32.159231 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:32.403587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:32.405179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:32.405736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:32.406946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/6100acd9b8164f59b07803100593cd22` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:32.410393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6100acd9b8164f59b07803100593cd22)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:32.414977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:32.477529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.479319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.610332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.611571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.620098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2940/5905] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:32 2022] PATCH /identity/v3/domains/6100acd9b8164f59b07803100593cd22 => generated 277 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:43:32.624837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:32.635054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1037-e7cd-4dea-973f-c67e571fbb3b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:32.700847 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:32.771914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:32.772663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:32.773310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:32.773671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/6100acd9b8164f59b07803100593cd22` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:32.801900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6100acd9b8164f59b07803100593cd22)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:32.803556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:32.898020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:32.935301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6100acd9b8164f59b07803100593cd22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.094095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.229028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.241944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.259795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project 6100acd9b8164f59b07803100593cd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:33.260227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.262817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.275907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.276653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.280007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6100acd9b8164f59b07803100593cd22', 'request_id': 'req-5caf5c54-7d25-4149-a608-5acbe40431ea'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.303382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2966/5906] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:43:32 2022] DELETE /identity/v3/domains/6100acd9b8164f59b07803100593cd22 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:33.304753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:33.306303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:33.323413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefb607-465b-4a51-bac0-2de9466caf93 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:33.439828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:33.440602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:33.440944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:33.441281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/62ae75f00757453b9d53adab182eaf92/users/e2cecf013c31405a960cfc9f588622d0/roles/f64bc814c116497682408c989360cb1b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:33.443760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=62ae75f00757453b9d53adab182eaf92, user_id=e2cecf013c31405a960cfc9f588622d0, role_id=f64bc814c116497682408c989360cb1b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:33.448113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:33.456484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role f64bc814c116497682408c989360cb1b was removed from user e2cecf013c31405a960cfc9f588622d0 on domain 62ae75f00757453b9d53adab182eaf92. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:33.456904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.457717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.605018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2941/5907] 10.222.0.13 () {58 vars in 1464 bytes} [Sun Oct 30 01:43:33 2022] DELETE /identity/v3/domains/62ae75f00757453b9d53adab182eaf92/users/e2cecf013c31405a960cfc9f588622d0/roles/f64bc814c116497682408c989360cb1b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:33.610577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:33.615488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:33.645629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5c54-7d25-4149-a608-5acbe40431ea tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:33.824005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:33.825293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:33.825953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:33.826631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles/f64bc814c116497682408c989360cb1b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:33.829893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f64bc814c116497682408c989360cb1b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:33.834223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:33.857559 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:33.994568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role f64bc814c116497682408c989360cb1b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:33.995246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:33.996064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.002109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2967/5908] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:33 2022] DELETE /identity/v3/roles/f64bc814c116497682408c989360cb1b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:34.003267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:34.004791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:34.032401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e4234-85bd-4736-817a-7907d15b61ec tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:34.192005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:34.192005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:34.192005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:34.196204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/62ae75f00757453b9d53adab182eaf92` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:34.196204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62ae75f00757453b9d53adab182eaf92)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:34.197168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:34.251657 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:34.266457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.267218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.427759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.428981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.434975 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2942/5909] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:34 2022] PATCH /identity/v3/domains/62ae75f00757453b9d53adab182eaf92 => generated 278 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:34.438832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:34.441296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:34.489700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181892-9a8e-4252-b70d-8c01d57a476a tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:34.622217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:34.622217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:34.622217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:34.622745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/62ae75f00757453b9d53adab182eaf92` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:34.697600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62ae75f00757453b9d53adab182eaf92)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:34.697600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:34.718392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:34.734912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62ae75f00757453b9d53adab182eaf92'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.443512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.561723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.571542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.632991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project 62ae75f00757453b9d53adab182eaf92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:35.633315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.643121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.681567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.684233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.685353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62ae75f00757453b9d53adab182eaf92', 'request_id': 'req-2c8382e5-ffd9-4b35-aac9-caeac7e99484'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.707903 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2968/5910] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:43:34 2022] DELETE /identity/v3/domains/62ae75f00757453b9d53adab182eaf92 => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:35.709437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:35.711016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:35.739416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3e8a-a594-4c39-8fe9-291070586c12 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:35.950652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:35.951680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:35.952140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:35.952600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98/groups/3e88a5293cea405c940e44f57f63eca2/roles/2d31bd8423814fd0949f401fe1449518` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:35.967165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f9fe7e6bc98c42cc8ac0549e98016f98, group_id=3e88a5293cea405c940e44f57f63eca2, role_id=2d31bd8423814fd0949f401fe1449518)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:35.970356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:35.983660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role 2d31bd8423814fd0949f401fe1449518 was removed from group 3e88a5293cea405c940e44f57f63eca2 on domain f9fe7e6bc98c42cc8ac0549e98016f98. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:35.987485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:35.989111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:36.379497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:36.380940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:36.523693 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2943/5911] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:43:35 2022] DELETE /identity/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98/groups/3e88a5293cea405c940e44f57f63eca2/roles/2d31bd8423814fd0949f401fe1449518 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:36.525294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:36.527497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:36.566711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8382e5-ffd9-4b35-aac9-caeac7e99484 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:36.669084 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:36.726398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8e13-b685-433f-812e-fb0dbd95c2a6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:36.737705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:36.738404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:36.738681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:36.738952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:36.742857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:36.743305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:36.744121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:36.744405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:36.744981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/3e88a5293cea405c940e44f57f63eca2/users/e2cecf013c31405a960cfc9f588622d0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:36.749102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3e88a5293cea405c940e44f57f63eca2, user_id=e2cecf013c31405a960cfc9f588622d0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:36.760197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:36.847998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:36.928307 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2944/5912] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:43:36 2022] DELETE /identity/v3/groups/3e88a5293cea405c940e44f57f63eca2/users/e2cecf013c31405a960cfc9f588622d0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:36.932193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:36.984073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:36.991977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:37.027302 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2969/5913] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:37.111353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2314eb-0936-4f2d-b77b-b19665635170 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:37.116466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:37.117114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:37.117430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:37.117713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/groups/3e88a5293cea405c940e44f57f63eca2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:37.118917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3e88a5293cea405c940e44f57f63eca2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:37.120842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:37.258957 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2945/5914] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:43:36 2022] DELETE /identity/v3/groups/3e88a5293cea405c940e44f57f63eca2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:37.263811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:37.281734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26c97e-3156-4103-b989-7d76a30ac3d3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:37.373665 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:37.447951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:37.448544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:37.448829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:37.449103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles/2d31bd8423814fd0949f401fe1449518` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:37.453665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2d31bd8423814fd0949f401fe1449518)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:37.455337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:37.618584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role 2d31bd8423814fd0949f401fe1449518 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:37.619271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.622721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb55da1-42b3-4263-84ee-da1f3b2ec6ef tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.630849 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2970/5915] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:37 2022] DELETE /identity/v3/roles/2d31bd8423814fd0949f401fe1449518 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:37.635113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:37.637931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:37.658505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbab90b-7105-4f60-9525-980f448ffed8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:37.778775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:37.780264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:37.780745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:37.781578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:37.784153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f9fe7e6bc98c42cc8ac0549e98016f98)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:37.786044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:37.813587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.814892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.818950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:37.819610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:37.820040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:37.862383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:37.864468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:37.952751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.958007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:37.969670 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2946/5916] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:37 2022] PATCH /identity/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98 => generated 277 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:37.984162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:37.984162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:38.021112 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2971/5917] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:43:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:38.033973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:38.035481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:38.185794 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:38.196557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209794a-c63b-425a-9303-ae0da64a761d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:38.209526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:38.210261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:38.210546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:38.210820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:38.239130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f9fe7e6bc98c42cc8ac0549e98016f98)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:38.245408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:38.269804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b1b52-d85b-4952-87d3-15acb2e91559 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:38.289897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:38.290509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:38.290786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:38.291044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:38.312612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.323519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.323918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:38.325759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:38.361372 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2972/5918] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:43:38.465495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.481788 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:38.489315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.595254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.620162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project f9fe7e6bc98c42cc8ac0549e98016f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:38.620426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.622878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.654185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.689747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.691128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f9fe7e6bc98c42cc8ac0549e98016f98', 'request_id': 'req-09273091-d8ec-4948-b08d-6f8ab85582bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.697955 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2947/5919] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:43:37 2022] DELETE /identity/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:38.702953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:38.725103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557abab-c606-4678-90ea-472bf30e5372 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:38.873746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:38.874697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:38.875241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:38.875753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/afb5f8c825dd430daa31c4635979c29a/users/e2cecf013c31405a960cfc9f588622d0/roles/aed29353c3fe4dc3a5ca096c801b41ad` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:38.883108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=afb5f8c825dd430daa31c4635979c29a, user_id=e2cecf013c31405a960cfc9f588622d0, role_id=aed29353c3fe4dc3a5ca096c801b41ad)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:38.889636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:38.905590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role aed29353c3fe4dc3a5ca096c801b41ad was removed from user e2cecf013c31405a960cfc9f588622d0 on domain afb5f8c825dd430daa31c4635979c29a. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:38.907059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.909085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:38.914186 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:39.053290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2973/5920] 10.222.0.13 () {58 vars in 1464 bytes} [Sun Oct 30 01:43:38 2022] DELETE /identity/v3/domains/afb5f8c825dd430daa31c4635979c29a/users/e2cecf013c31405a960cfc9f588622d0/roles/aed29353c3fe4dc3a5ca096c801b41ad => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:39.054398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:39.055833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:39.080245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09273091-d8ec-4948-b08d-6f8ab85582bd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:39.285930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:39.286581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:39.286872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:39.298565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles/aed29353c3fe4dc3a5ca096c801b41ad` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:39.298565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aed29353c3fe4dc3a5ca096c801b41ad)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:39.298565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:39.461619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role aed29353c3fe4dc3a5ca096c801b41ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:39.462065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.464388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.466686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2948/5921] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:39 2022] DELETE /identity/v3/roles/aed29353c3fe4dc3a5ca096c801b41ad => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:39.470958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:39.472606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:39.490841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded442c6-e527-453a-be45-f0afad092d50 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:39.629034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:39.629917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:39.630337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:39.630694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/afb5f8c825dd430daa31c4635979c29a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:39.632489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=afb5f8c825dd430daa31c4635979c29a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:39.633882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:39.663772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.664612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.825880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.827333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:39.834264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2974/5922] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:39 2022] PATCH /identity/v3/domains/afb5f8c825dd430daa31c4635979c29a => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:39.838410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:39.840492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:39.869067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fc925-da87-4a3f-9549-ee976ef9430d tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:39.943169 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:40.084882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:40.085582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:40.085829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:40.086103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/afb5f8c825dd430daa31c4635979c29a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:40.114056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=afb5f8c825dd430daa31c4635979c29a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:40.128134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:40.194692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.200377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.387858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.403450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.472477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.497004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project afb5f8c825dd430daa31c4635979c29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:40.497512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.504367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.526334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.535767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.537698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'afb5f8c825dd430daa31c4635979c29a', 'request_id': 'req-ccd429da-a4c8-4924-8725-24d6bb5f2a70'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:40.556235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2949/5923] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:43:39 2022] DELETE /identity/v3/domains/afb5f8c825dd430daa31c4635979c29a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:40.566916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:40.568436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:40.594398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db47e3-795f-4134-afed-33320e4ffd4b tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:40.708736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:40.709544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:40.709827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:40.711818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:40.711818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:40.713534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:40.726615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2975/5924] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:40.731124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:40.732612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:40.758659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd429da-a4c8-4924-8725-24d6bb5f2a70 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:40.767898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:40.768604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:40.768894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:40.769179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:40.779113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=566be415929a4e848d3d0217a42b2b5a, user_id=8531a3a0ec7d434ab8d9e5c2c68ae4c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:40.782003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:40.904418 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2950/5925] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:40 2022] PUT /identity/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:40.910469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:40.932785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e435060-e68f-4cdc-b793-1187a4e3e9e8 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:41.083409 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:41.091450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:41.092453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:41.092899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:41.093688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:41.094441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:41.096159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:41.206752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2976/5926] 10.222.0.13 () {58 vars in 1146 bytes} [Sun Oct 30 01:43:40 2022] GET /identity/v3/auth/projects => generated 826 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:41.210432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:41.233683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f30cf-0457-4356-9091-9c0300434abd tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:41.253709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:41.254713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:41.256661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:41.257566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:41.267117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=566be415929a4e848d3d0217a42b2b5a, user_id=8531a3a0ec7d434ab8d9e5c2c68ae4c2, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:41.273283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:41.293321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role 2be61dd3a1dd4c158a4acc57cb37fb15 was removed from user 8531a3a0ec7d434ab8d9e5c2c68ae4c2 on project 566be415929a4e848d3d0217a42b2b5a. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:41.293921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:41.300870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:41.410746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2951/5927] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:43:41 2022] DELETE /identity/v3/projects/566be415929a4e848d3d0217a42b2b5a/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:41.411765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:41.414010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:41.474956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9361f-8797-446c-b875-b649072edf80 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:41.620408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:41.622850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:41.623139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:41.623411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:41.624205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:41.626169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:41.781868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2977/5928] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:41 2022] POST /identity/v3/users => generated 321 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:41.785843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:41.805004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3352dc-76e5-4d1c-a875-b4ba25c2bf56 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:41.822787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:41.823549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:41.823903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:41.824284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:41.825055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:41.835449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:41.910038 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:42.026680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2952/5929] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:41 2022] POST /identity/v3/projects => generated 363 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:42.031105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:42.052648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793f6a8-8751-495e-a085-4b3bc1bb7024 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:42.195250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:42.195970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:42.196317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:42.196657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:42.197366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:42.200890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:42.348224 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2978/5930] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:42 2022] POST /identity/v3/projects => generated 362 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:42.351974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:42.398667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf97a03-538b-4604-b815-7e21af70f436 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:42.569566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:42.572440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:42.573639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:42.574546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:42.579023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:42.581176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:42.688233 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2953/5931] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:43:42 2022] POST /identity/v3/roles => generated 239 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:42.689630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:42.709181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9a104-da1a-4782-af00-577a15888254 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:42.746327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:42.747049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:42.747416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:42.747756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/59ea0065006040cfa4fffbf2261d0fde/users/a86aecc99d6347ab8513c85137a7f1ab/roles/4783de97c3544eb7882108f7fb00ebfc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:42.784261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=59ea0065006040cfa4fffbf2261d0fde, user_id=a86aecc99d6347ab8513c85137a7f1ab, role_id=4783de97c3544eb7882108f7fb00ebfc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:42.787078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f8f0-48d1-4c18-b469-46947d8a8789 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:42.969296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2979/5932] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:42 2022] PUT /identity/v3/projects/59ea0065006040cfa4fffbf2261d0fde/users/a86aecc99d6347ab8513c85137a7f1ab/roles/4783de97c3544eb7882108f7fb00ebfc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:42.973161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:42.998987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239c445-95e4-41dc-aad6-b0ca519ff91e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:43.094363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:43.095868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:43.098161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:43.098708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/4e2e7f8cdef44b55b63011eee75afe23/users/a86aecc99d6347ab8513c85137a7f1ab/roles/4783de97c3544eb7882108f7fb00ebfc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:43.103124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4e2e7f8cdef44b55b63011eee75afe23, user_id=a86aecc99d6347ab8513c85137a7f1ab, role_id=4783de97c3544eb7882108f7fb00ebfc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:43.107009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8be14-77e4-442a-9208-f90bd2ad6875 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:43.211521 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2954/5933] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:42 2022] PUT /identity/v3/projects/4e2e7f8cdef44b55b63011eee75afe23/users/a86aecc99d6347ab8513c85137a7f1ab/roles/4783de97c3544eb7882108f7fb00ebfc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:43.215932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:43.216411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:43.216511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:43.236763 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:43.247085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] MFA Rules not processed for user `a86aecc99d6347ab8513c85137a7f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:43.252743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:43.252743 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2980/5934] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:43 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:43:43.257546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65cfa-630d-4241-9d3f-0fb66c5c0485 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:43.257890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65cfa-630d-4241-9d3f-0fb66c5c0485 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:43.258190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65cfa-630d-4241-9d3f-0fb66c5c0485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:43.279694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cca65cfa-630d-4241-9d3f-0fb66c5c0485 None None] MFA Rules not processed for user `a86aecc99d6347ab8513c85137a7f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:43.283863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cca65cfa-630d-4241-9d3f-0fb66c5c0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:43.454021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:43.464462 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2955/5935] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:43 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 30 01:43:43.613055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd791f-793d-4d45-85f7-e3c9bfd2d0d5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:43.618705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:43.619842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:43.620416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:43.620954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:43.650425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:43.653974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:43.767129 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2981/5936] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 30 01:43:43 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:43.772251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:43.783512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:43.783512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:43.828966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] MFA Rules not processed for user `a86aecc99d6347ab8513c85137a7f1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:43.828966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:43.900560 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:44.079752 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2956/5937] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:43 2022] POST /identity/v3/auth/tokens => generated 3223 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 30 01:43:44.080620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:44.098362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513781f-58bb-4de3-8f7e-7e488f78a059 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:44.110225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:44.110867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:44.111143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:44.117795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/roles/4783de97c3544eb7882108f7fb00ebfc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:44.117795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4783de97c3544eb7882108f7fb00ebfc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:44.132920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:44.415290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invalidating the token cache because role 4783de97c3544eb7882108f7fb00ebfc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:44.415938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:44.418045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:44.423323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2982/5938] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:44 2022] DELETE /identity/v3/roles/4783de97c3544eb7882108f7fb00ebfc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:44.425647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:44.470527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030909-8d70-4bf4-853c-4aa91302a3c3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:44.650259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:44.651428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:44.653657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:44.654053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/4e2e7f8cdef44b55b63011eee75afe23` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:44.656932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e2e7f8cdef44b55b63011eee75afe23)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:44.664208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:44.896833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2e7f8cdef44b55b63011eee75afe23', 'request_id': 'req-c1aac54f-da7b-4359-9806-3034a2a506b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:44.909099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2e7f8cdef44b55b63011eee75afe23', 'request_id': 'req-c1aac54f-da7b-4359-9806-3034a2a506b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:44.990177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2e7f8cdef44b55b63011eee75afe23', 'request_id': 'req-c1aac54f-da7b-4359-9806-3034a2a506b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.013525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project 4e2e7f8cdef44b55b63011eee75afe23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:45.013976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.014752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.017388 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2957/5939] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:44 2022] DELETE /identity/v3/projects/4e2e7f8cdef44b55b63011eee75afe23 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:45.022295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:45.024215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:45.048752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d2821-4f9f-4994-a274-cb2df6bf1fbe tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:45.178123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:45.180961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:45.181565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:45.182338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/4e2e7f8cdef44b55b63011eee75afe23` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:45.231518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e2e7f8cdef44b55b63011eee75afe23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:45.233434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Could not find project: 4e2e7f8cdef44b55b63011eee75afe23.: keystone.exception.ProjectNotFound: Could not find project: 4e2e7f8cdef44b55b63011eee75afe23. Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 30 01:43:45.269290 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4e2e7f8cdef44b55b63011eee75afe23. Oct 30 01:43:45.270271 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:45.274762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:45.277201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:45.282602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2983/5940] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:45 2022] DELETE /identity/v3/projects/4e2e7f8cdef44b55b63011eee75afe23 => generated 113 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:43:45.304572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac54f-da7b-4359-9806-3034a2a506b9 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:45.366477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:45.368078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:45.370554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:45.375783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/projects/59ea0065006040cfa4fffbf2261d0fde` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:45.384702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59ea0065006040cfa4fffbf2261d0fde)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:45.414144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:45.753007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ea0065006040cfa4fffbf2261d0fde', 'request_id': 'req-cadd7e28-f198-4701-a653-aea2baf50f10'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.755855 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:45.764568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ea0065006040cfa4fffbf2261d0fde', 'request_id': 'req-cadd7e28-f198-4701-a653-aea2baf50f10'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.972859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ea0065006040cfa4fffbf2261d0fde', 'request_id': 'req-cadd7e28-f198-4701-a653-aea2baf50f10'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.993470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] The token cache is being invalidate because project 59ea0065006040cfa4fffbf2261d0fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:45.994685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.995555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:45.998776 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2958/5941] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:45 2022] DELETE /identity/v3/projects/59ea0065006040cfa4fffbf2261d0fde => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:46.003882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:46.011873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:46.052186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cfbd1-d03e-4924-91d3-080bbf50d4fc tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:46.154049 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:46.213699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:46.230868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:46.231509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:46.233240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/users/a86aecc99d6347ab8513c85137a7f1ab` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:46.239094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a86aecc99d6347ab8513c85137a7f1ab)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:46.242518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:46.459603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86aecc99d6347ab8513c85137a7f1ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:46.584627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86aecc99d6347ab8513c85137a7f1ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:46.585627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86aecc99d6347ab8513c85137a7f1ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:46.609884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86aecc99d6347ab8513c85137a7f1ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:46.623044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86aecc99d6347ab8513c85137a7f1ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:46.652804 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2984/5942] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:46 2022] DELETE /identity/v3/users/a86aecc99d6347ab8513c85137a7f1ab => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:46.658791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:46.703500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7e28-f198-4701-a653-aea2baf50f10 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:46.810221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:46.812174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:46.812623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:46.813199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/6100acd9b8164f59b07803100593cd22` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:46.848549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Could not find domain: 6100acd9b8164f59b07803100593cd22.: keystone.exception.DomainNotFound: Could not find domain: 6100acd9b8164f59b07803100593cd22. Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6100acd9b8164f59b07803100593cd22. Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:43:46.859750 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:43:46.861249 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6100acd9b8164f59b07803100593cd22. Oct 30 01:43:46.862493 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:46.869856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2959/5943] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:46 2022] PATCH /identity/v3/domains/6100acd9b8164f59b07803100593cd22 => generated 112 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:43:46.874034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:46.876389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:46.908757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d461e6-2e5e-4c95-97da-fa4d33e7c775 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:46.924161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:46.925013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:46.925541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:46.926296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/62ae75f00757453b9d53adab182eaf92` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:46.948093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Could not find domain: 62ae75f00757453b9d53adab182eaf92.: keystone.exception.DomainNotFound: Could not find domain: 62ae75f00757453b9d53adab182eaf92. Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 62ae75f00757453b9d53adab182eaf92. Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:43:46.956003 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:43:46.957282 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 62ae75f00757453b9d53adab182eaf92. Oct 30 01:43:46.958434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:46.962099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2985/5944] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:46 2022] PATCH /identity/v3/domains/62ae75f00757453b9d53adab182eaf92 => generated 112 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:43:46.966272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:46.982220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d442b17-471b-47b6-8750-b4a908bee4d6 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:47.007659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:47.008311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:47.010851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:47.021196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:47.029912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Could not find domain: f9fe7e6bc98c42cc8ac0549e98016f98.: keystone.exception.DomainNotFound: Could not find domain: f9fe7e6bc98c42cc8ac0549e98016f98. Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f9fe7e6bc98c42cc8ac0549e98016f98. Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:43:47.044206 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:43:47.045462 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f9fe7e6bc98c42cc8ac0549e98016f98. Oct 30 01:43:47.046865 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:43:47.052481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2960/5945] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:46 2022] PATCH /identity/v3/domains/f9fe7e6bc98c42cc8ac0549e98016f98 => generated 112 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:43:47.061437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:47.073517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf736fa-2c2c-4514-93f3-42af970432f7 tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:47.079730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8531a3a0ec7d434ab8d9e5c2c68ae4c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cc1dc65ce9d47f0b336f910690b7b21', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:47.081064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:47.081199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:47.081555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] PATH_INFO: `/v3/domains/afb5f8c825dd430daa31c4635979c29a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:47.097211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-408da9c3-b3a2-426a-b3c1-2b4c5db4df2e tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Could not find domain: afb5f8c825dd430daa31c4635979c29a.: keystone.exception.DomainNotFound: Could not find domain: afb5f8c825dd430daa31c4635979c29a. Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: afb5f8c825dd430daa31c4635979c29a. Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:43:47.102649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:43:47.147662 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: afb5f8c825dd430daa31c4635979c29a. Oct 30 01:43:47.149881 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:43:47.151201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2986/5946] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:43:47 2022] PATCH /identity/v3/domains/afb5f8c825dd430daa31c4635979c29a => generated 112 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:43:47.151284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:47.152673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:47.252624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef89ff2-331e-4d05-be76-31976e4dcfde tempest-TokensV3TestJSON-1044407656 tempest-TokensV3TestJSON-1044407656-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:47.267269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:47.268133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:47.268420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:47.269460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] PATH_INFO: `/v3/users/deddcae2c9b840838253d402b126ba7a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:47.275281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=deddcae2c9b840838253d402b126ba7a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:47.277545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:47.640282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deddcae2c9b840838253d402b126ba7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:47.641047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deddcae2c9b840838253d402b126ba7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:47.656022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deddcae2c9b840838253d402b126ba7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:47.656965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deddcae2c9b840838253d402b126ba7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:47.757309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deddcae2c9b840838253d402b126ba7a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:47.765530 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:47.813196 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2961/5947] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:47 2022] DELETE /identity/v3/users/deddcae2c9b840838253d402b126ba7a => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:47.817884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:47.818503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:47.818981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:47.853930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:47.856085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:47.892347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:47.893911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:48.045933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2987/5948] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:48.062874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ff0d-48a1-4357-a152-15f4f09df45c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:48.069188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:48.070077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:48.070463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:48.070856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] PATH_INFO: `/v3/users/a4fa314eafaa4c5aabd7f18e62cc34f4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:48.072385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:48.074522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:48.081488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fa314eafaa4c5aabd7f18e62cc34f4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:48.086663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:48.189531 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:48.233549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41027b-9c3c-45d7-a7d3-f18e3cfe15ae None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:48.238453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:48.239342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:48.239811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:48.240266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:48.258902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:48.258902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e39eed-48c3-4a0c-ab38-09cc9cf39f2b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:48.287609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2988/5949] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:43:48.407247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fa314eafaa4c5aabd7f18e62cc34f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:48.408092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fa314eafaa4c5aabd7f18e62cc34f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:48.421935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fa314eafaa4c5aabd7f18e62cc34f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:48.422847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fa314eafaa4c5aabd7f18e62cc34f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:48.529729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fa314eafaa4c5aabd7f18e62cc34f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:48.577866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:48.578403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:48.584468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:48.584798 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2962/5950] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:47 2022] DELETE /identity/v3/users/a4fa314eafaa4c5aabd7f18e62cc34f4 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:48.622518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:48.624990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:48.721560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2989/5951] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:48.736707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:48.738758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:48.829005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25db0f3-029a-4dae-9e03-83d5ae4960fc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:48.834293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:48.835319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:48.835810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:48.836376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:48.865270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:48.868143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:48.880073 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2963/5952] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:43:48.885653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:48.887534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:48.908916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d52c-e493-4721-ba39-71822e99c5c4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:48.914449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:48.918776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:48.918776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:48.918776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] PATH_INFO: `/v3/projects/566be415929a4e848d3d0217a42b2b5a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:48.918776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] RBAC: Authorizing `identity:delete_project(project_id=566be415929a4e848d3d0217a42b2b5a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:48.919877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:49.072590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:49.074173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:49.102073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e749551-9990-40cd-bd68-678cdad4ea92 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:49.155471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566be415929a4e848d3d0217a42b2b5a', 'request_id': 'req-deb72da9-12b2-4574-861b-69d63f5e595c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.250888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566be415929a4e848d3d0217a42b2b5a', 'request_id': 'req-deb72da9-12b2-4574-861b-69d63f5e595c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.280281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566be415929a4e848d3d0217a42b2b5a', 'request_id': 'req-deb72da9-12b2-4574-861b-69d63f5e595c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.338207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] The token cache is being invalidate because project 566be415929a4e848d3d0217a42b2b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:49.338207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.339022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.344353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:49.345121 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2990/5953] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:48 2022] DELETE /identity/v3/projects/566be415929a4e848d3d0217a42b2b5a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:49.347831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:49.348091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:49.348416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] PATH_INFO: `/v3/users/02d9c8a493ab4fc1bdac4ab6494bec15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:49.349987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d9c8a493ab4fc1bdac4ab6494bec15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:49.350287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:49.351948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:49.353144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:49.380447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb72da9-12b2-4574-861b-69d63f5e595c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:49.389480 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:49.391515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:49.392425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:49.392855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:49.393664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] PATH_INFO: `/v3/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:49.396058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8531a3a0ec7d434ab8d9e5c2c68ae4c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:49.398940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:49.686750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d9c8a493ab4fc1bdac4ab6494bec15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.687699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d9c8a493ab4fc1bdac4ab6494bec15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.697499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8531a3a0ec7d434ab8d9e5c2c68ae4c2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.703838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d9c8a493ab4fc1bdac4ab6494bec15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.704574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d9c8a493ab4fc1bdac4ab6494bec15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.794929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8531a3a0ec7d434ab8d9e5c2c68ae4c2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.795566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8531a3a0ec7d434ab8d9e5c2c68ae4c2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.819920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8531a3a0ec7d434ab8d9e5c2c68ae4c2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.831932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8531a3a0ec7d434ab8d9e5c2c68ae4c2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.842746 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2991/5954] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:49 2022] DELETE /identity/v3/users/8531a3a0ec7d434ab8d9e5c2c68ae4c2 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:49.944817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d9c8a493ab4fc1bdac4ab6494bec15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:49.955833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:49.957585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:49.973795 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2964/5955] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:49 2022] DELETE /identity/v3/users/02d9c8a493ab4fc1bdac4ab6494bec15 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:50.007213 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:50.103176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ac87-a223-4389-a7b1-e65a15b75f57 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:50.183780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:50.184464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:50.184708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:50.184974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] PATH_INFO: `/v3/projects/8309f6a0053247cc853a99a4b42b62ce` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:50.186573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8309f6a0053247cc853a99a4b42b62ce)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:50.188517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:50.351388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8309f6a0053247cc853a99a4b42b62ce', 'request_id': 'req-ddddf822-bc6b-44e2-a037-8bf4af240f81'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.371246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:50.376242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:50.407139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7922b6-54e6-4ff6-9a94-7496e30933f0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:50.427721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8309f6a0053247cc853a99a4b42b62ce', 'request_id': 'req-ddddf822-bc6b-44e2-a037-8bf4af240f81'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.438009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8309f6a0053247cc853a99a4b42b62ce', 'request_id': 'req-ddddf822-bc6b-44e2-a037-8bf4af240f81'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.467106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] The token cache is being invalidate because project 8309f6a0053247cc853a99a4b42b62ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:50.467106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.467106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.467106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2992/5956] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:49 2022] DELETE /identity/v3/projects/8309f6a0053247cc853a99a4b42b62ce => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:43:50.477833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:50.484632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:50.514767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:50.521213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:50.521213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:50.521213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] PATH_INFO: `/v3/projects/01acf8e8ee774c008833d5aff937b676` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:50.521213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01acf8e8ee774c008833d5aff937b676)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:50.521213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:50.579760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddddf822-bc6b-44e2-a037-8bf4af240f81 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:50.585311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:50.586361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:50.586873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:50.587219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] PATH_INFO: `/v3/users/fb007eb66fcb4e02ba1526b925baac22` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:50.590955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb007eb66fcb4e02ba1526b925baac22)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:50.599420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:50.650723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01acf8e8ee774c008833d5aff937b676', 'request_id': 'req-3e230161-6da6-4b7e-b507-e50318450291'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.664232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01acf8e8ee774c008833d5aff937b676', 'request_id': 'req-3e230161-6da6-4b7e-b507-e50318450291'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.765464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01acf8e8ee774c008833d5aff937b676', 'request_id': 'req-3e230161-6da6-4b7e-b507-e50318450291'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.779142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] The token cache is being invalidate because project 01acf8e8ee774c008833d5aff937b676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:50.779685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.780593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.782943 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2965/5957] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:50 2022] DELETE /identity/v3/projects/01acf8e8ee774c008833d5aff937b676 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:50.784051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:50.785898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:50.908820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb007eb66fcb4e02ba1526b925baac22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:50.923944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e230161-6da6-4b7e-b507-e50318450291 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:50.939509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:50.940349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:50.940700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:50.941255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] PATH_INFO: `/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:50.944483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc1dc65ce9d47f0b336f910690b7b21)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:50.946703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:51.019121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb007eb66fcb4e02ba1526b925baac22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.019348 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:51.024938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb007eb66fcb4e02ba1526b925baac22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.035645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb007eb66fcb4e02ba1526b925baac22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.044087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb007eb66fcb4e02ba1526b925baac22'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.051094 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2993/5958] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:50 2022] DELETE /identity/v3/users/fb007eb66fcb4e02ba1526b925baac22 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:51.054299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:51.056732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:51.138097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc1dc65ce9d47f0b336f910690b7b21', 'request_id': 'req-64c1a77d-0418-43fa-9236-2943eca4891f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.154619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc1dc65ce9d47f0b336f910690b7b21', 'request_id': 'req-64c1a77d-0418-43fa-9236-2943eca4891f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.160213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f680b30-3305-498c-9884-ba275f1b8749 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:51.260641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:51.262156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:51.262502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:51.262847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] PATH_INFO: `/v3/users/01e5e100d57a4513b10a601644e242c9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:51.264140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e5e100d57a4513b10a601644e242c9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:51.266311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:51.321226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc1dc65ce9d47f0b336f910690b7b21', 'request_id': 'req-64c1a77d-0418-43fa-9236-2943eca4891f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.402826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] The token cache is being invalidate because project 8cc1dc65ce9d47f0b336f910690b7b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:51.407934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.407934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.417549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2966/5959] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:50 2022] DELETE /identity/v3/projects/8cc1dc65ce9d47f0b336f910690b7b21 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:51.418381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:51.423605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:51.574688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e5e100d57a4513b10a601644e242c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.606840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1a77d-0418-43fa-9236-2943eca4891f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:51.611778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:51.612413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:51.612694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:51.612974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:51.614852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:51.688586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e5e100d57a4513b10a601644e242c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.689225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e5e100d57a4513b10a601644e242c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.709274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e5e100d57a4513b10a601644e242c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.730260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e5e100d57a4513b10a601644e242c9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:51.741711 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2994/5960] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:51 2022] DELETE /identity/v3/users/01e5e100d57a4513b10a601644e242c9 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:51.756923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:51.765781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:51.803571 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:51.815545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:51.819043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:51.866746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2967/5961] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:51.932036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d174bfc-a13c-46af-b7bc-238efd934448 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:51.950159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:51.951287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:51.951287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:51.953740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] PATH_INFO: `/v3/users/e2cecf013c31405a960cfc9f588622d0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:51.953740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cecf013c31405a960cfc9f588622d0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:51.955540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.124841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.127251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.162704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840a1-5f71-4611-8776-a3bbbde7004a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.174424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.175096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.175610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.177108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] PATH_INFO: `/v3/projects/051d52f039304d79ad6e3456704399e3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.181275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051d52f039304d79ad6e3456704399e3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.186242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.228886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.356878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.357765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.384794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.392846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051d52f039304d79ad6e3456704399e3', 'request_id': 'req-776c2635-8d29-427d-9868-7c59e5291835'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.398454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cecf013c31405a960cfc9f588622d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.405423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051d52f039304d79ad6e3456704399e3', 'request_id': 'req-776c2635-8d29-427d-9868-7c59e5291835'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.412868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2995/5962] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:51 2022] DELETE /identity/v3/users/e2cecf013c31405a960cfc9f588622d0 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:52.413681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.415023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.487146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051d52f039304d79ad6e3456704399e3', 'request_id': 'req-776c2635-8d29-427d-9868-7c59e5291835'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.499151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481721d5-9f5e-4daa-af07-924bfe60bf3b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.504709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.505834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.505834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.506135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] PATH_INFO: `/v3/projects/1a3c7147acf242179270d967518641f1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.507367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3c7147acf242179270d967518641f1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.509002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] The token cache is being invalidate because project 051d52f039304d79ad6e3456704399e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:52.509678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.510327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.512108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-776c2635-8d29-427d-9868-7c59e5291835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.519406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2968/5963] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:52 2022] DELETE /identity/v3/projects/051d52f039304d79ad6e3456704399e3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:52.524742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49288-c1e2-4920-85e7-6cccf0a0234f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.525101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49288-c1e2-4920-85e7-6cccf0a0234f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.525472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d49288-c1e2-4920-85e7-6cccf0a0234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.549221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-66d49288-c1e2-4920-85e7-6cccf0a0234f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:52.550600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-66d49288-c1e2-4920-85e7-6cccf0a0234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.559614 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2969/5964] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:52.567218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.567534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.567832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.594467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:52.594467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.598970 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2970/5965] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:52.603149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.636603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788f923-f544-4a78-a053-2f60f0cd3e58 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.636603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.636603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.636603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.637044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.637044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:52.637044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.637044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.649409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2971/5966] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:52.654339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.665576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624948a4-8a82-4d8d-8890-60badd49531f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.674763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.674763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.674763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.674763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.675208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.676063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.716456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3c7147acf242179270d967518641f1', 'request_id': 'req-d5767fc5-11fc-438a-8910-6ff45706bf8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.806059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2972/5967] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:52.807042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.824507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3c7147acf242179270d967518641f1', 'request_id': 'req-d5767fc5-11fc-438a-8910-6ff45706bf8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.832107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3c7147acf242179270d967518641f1', 'request_id': 'req-d5767fc5-11fc-438a-8910-6ff45706bf8b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.844398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] The token cache is being invalidate because project 1a3c7147acf242179270d967518641f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:52.844689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.845377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d5767fc5-11fc-438a-8910-6ff45706bf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:52.846881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2996/5968] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:52 2022] DELETE /identity/v3/projects/1a3c7147acf242179270d967518641f1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:52.851568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8016f-05b8-42e3-86f5-4785b81d5bf6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.851920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8016f-05b8-42e3-86f5-4785b81d5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.852263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8016f-05b8-42e3-86f5-4785b81d5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.872978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bec68-56fc-488d-97d3-fbe7a7cead8c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.873173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c7e8016f-05b8-42e3-86f5-4785b81d5bf6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:52.874275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7e8016f-05b8-42e3-86f5-4785b81d5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.877767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.878374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.878649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.878944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.879561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.889883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.890015 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2997/5969] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:52.891497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.891826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.892097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.912547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:52.913821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.927044 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2998/5970] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:52.928216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.938675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922d00-d144-4f20-9d1a-78f4b50b10c2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.941121 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:52.943939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.944697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.945028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.945303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.945983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:52.948083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.948083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.965832 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 2999/5971] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:52.965832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:52.966736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:52.980572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bf1ca-6359-4f37-b90c-19cdb6137232 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:52.986556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:52.987238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:52.987521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:52.987823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] PATH_INFO: `/v3/projects/87ed1543a5864122a84d2ab8dd1a25de` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:52.988940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ed1543a5864122a84d2ab8dd1a25de)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:52.990851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:52.999846 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2973/5972] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:52 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:53.001829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.023841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b60ed-e19c-4b70-8d6e-7580518079d2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.030565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.031175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.036097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.036097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.036097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.037546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.124593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ed1543a5864122a84d2ab8dd1a25de', 'request_id': 'req-f2e8d208-bc18-4a31-82e1-0c3d169459da'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:53.178590 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2974/5973] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:53.180535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.183596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.240056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ed1543a5864122a84d2ab8dd1a25de', 'request_id': 'req-f2e8d208-bc18-4a31-82e1-0c3d169459da'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:53.249088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ed1543a5864122a84d2ab8dd1a25de', 'request_id': 'req-f2e8d208-bc18-4a31-82e1-0c3d169459da'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:53.269638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] The token cache is being invalidate because project 87ed1543a5864122a84d2ab8dd1a25de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:53.273647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:53.283675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:53.292360 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3000/5974] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:52 2022] DELETE /identity/v3/projects/87ed1543a5864122a84d2ab8dd1a25de => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:53.293505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.297686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.352482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcf3ef-7be8-4dc3-90c3-361348f59bf8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.357895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.358593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.359203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.359538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.360354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.362280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09c8fc-b3cd-4df4-8690-174437e559b6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.377026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2975/5975] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:53.377026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d47e8a-187f-48de-820c-48aab080061b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.377026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d47e8a-187f-48de-820c-48aab080061b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.377026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d47e8a-187f-48de-820c-48aab080061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.404226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-07d47e8a-187f-48de-820c-48aab080061b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:53.406820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07d47e8a-187f-48de-820c-48aab080061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.425298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8d208-bc18-4a31-82e1-0c3d169459da admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.431238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.431238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.431645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.431985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.432716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.435623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.437630 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2976/5976] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:53.438546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d47e8a-187f-48de-820c-48aab080061b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.445883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07d47e8a-187f-48de-820c-48aab080061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.462015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d47e8a-187f-48de-820c-48aab080061b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.470880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.471737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.472181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.472775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.473606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.476159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf4179-7746-4891-aafd-4d3b6fdbe0f5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.489679 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2977/5977] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:53.491098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.491379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.491650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.517825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:53.519112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.534837 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2978/5978] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:53.534837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.545509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61832b-c6ec-4d3b-ae0e-2376f14ce693 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.560839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.560839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.560839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.560839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] PATH_INFO: `/v3/projects/14cbe8d6abd8479d9d2fdd46d4c81b73/users/671c58c15d1f4ecb9df1f18565bd91e4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.578739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3001/5979] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:53.580051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.587819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cbe8d6abd8479d9d2fdd46d4c81b73, user_id=671c58c15d1f4ecb9df1f18565bd91e4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.591680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.611908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694c7e-27d2-48e8-a445-1fc12311daef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.620896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.621828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.622301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.622573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.623410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:53.623710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.626377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.643199 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3002/5980] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:43:53.644329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.656458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f54e-b078-4ad4-b37a-2b3b22916b64 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.662044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.662659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.662937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.663204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.664002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.665629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.678418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3003/5981] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:53.679470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.692020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd838e-ee10-4f72-ad8a-a713eda05725 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.696801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.697472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.697750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.698038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.699234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.706627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.711148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2979/5982] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:53 2022] PUT /identity/v3/projects/14cbe8d6abd8479d9d2fdd46d4c81b73/users/671c58c15d1f4ecb9df1f18565bd91e4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:53.711148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.711337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.777187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f42a6-5a3e-4589-ac97-c16cf0172506 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.783214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.783842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.784143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.784411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] PATH_INFO: `/v3/users/8d9bdc3da2ef45ebaaf7536832c75df9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.785590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9bdc3da2ef45ebaaf7536832c75df9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.787618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.802922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3004/5983] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:53.803701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.805502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.868782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b87b2-ca7a-4af5-add6-9ffbb0b7e65a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.873200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.873939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.874279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.874621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.879841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:53.888721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.890267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:53.901132 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3005/5984] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:53.902312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:53.971068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca42d-590f-4570-bce2-e7651432633b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:53.976645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:53.977252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:53.977558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:53.977827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:53.978533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:53.980813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313fc3c-39f4-47ce-853f-af80ed66d241 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.000104 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3006/5985] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:54.000104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.000104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.000104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.035825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] MFA Rules not processed for user `671c58c15d1f4ecb9df1f18565bd91e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:54.037778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.044133 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:54.119330 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3007/5986] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:54.120558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.124502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9bdc3da2ef45ebaaf7536832c75df9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:54.125248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9bdc3da2ef45ebaaf7536832c75df9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:54.133275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279e299-9ef8-41f2-a2ce-ef770b982668 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.134133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9bdc3da2ef45ebaaf7536832c75df9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:54.134819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9bdc3da2ef45ebaaf7536832c75df9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:54.139324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.139961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.140244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.140521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.141158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.143397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.224311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9bdc3da2ef45ebaaf7536832c75df9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:54.250632 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2980/5987] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:53 2022] DELETE /identity/v3/users/8d9bdc3da2ef45ebaaf7536832c75df9 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:54.250632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.250632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.264723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3008/5988] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:54 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:54.264723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.266497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.280888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c1274-7b11-491d-be30-fe83ca955e69 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.334972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae76f29-361c-4010-857a-00d21c7997a2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.340020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.340698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.340962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.341264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] PATH_INFO: `/v3/projects/15a1dab1c45d4be9946ec98786f36b5f/users/23ccf9b5810f4c1a8d95e70e15624a43/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.363141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1dab1c45d4be9946ec98786f36b5f, user_id=23ccf9b5810f4c1a8d95e70e15624a43, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.365951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f2725-1c5f-4981-b32f-31d84010f909 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.368276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.369516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.370413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.377218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.377218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.377218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.467753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2981/5989] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:54 2022] PUT /identity/v3/projects/15a1dab1c45d4be9946ec98786f36b5f/users/23ccf9b5810f4c1a8d95e70e15624a43/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:54.467753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9319ae-331a-4395-80cb-4362914374bc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.467753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9319ae-331a-4395-80cb-4362914374bc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.467753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9319ae-331a-4395-80cb-4362914374bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.486678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4d9319ae-331a-4395-80cb-4362914374bc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:54.487806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4d9319ae-331a-4395-80cb-4362914374bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.525886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3009/5990] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:54 2022] POST /identity/v3/projects => generated 369 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:54.527380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.530971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.577364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2982/5991] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:54.578986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.579440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.589775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.609446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:54.610735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.619407 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2983/5992] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:54.620285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.630347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7d916-1821-4197-aa47-16382a25b44e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.633781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177f7e-97e0-4235-8f73-f07878423334 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.639517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.640146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.640423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.640691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.641477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.643989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.646024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.647193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.647709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.648249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.649238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.651302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.666412 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3010/5993] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:54.667949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.670004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.742988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f059-7d89-42a9-9659-c7201b80d1cb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.746692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.747451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.747737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.748009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.758131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.759694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.772656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3011/5994] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:54.773764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.775424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:54.776624 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2984/5995] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:54 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:54.778053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.789227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c6e30-218f-46e6-9b60-bda39291ed5a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.791499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b99e49-27fd-4729-aa81-1653fc322931 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.794785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.796012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.796153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.796416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.796782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.796912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.797168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.797513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.797630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.799219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.814671 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2985/5996] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:54.816340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.820301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.829768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bf56c-2920-4bca-869d-effe0bd735aa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.834699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.840110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.840910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.844646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.844646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.844646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.845275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.851143 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3012/5997] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:54.852063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.863138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e78a5-a536-4433-a13d-191379af827e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.868478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.869471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.869618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.869965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] PATH_INFO: `/v3/projects/b163fa044f5f4bbd82a67300acfa24d8/users/138f713e0b684f9cbc9189976791014c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.885657 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2986/5998] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:54.889941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:54.909136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b163fa044f5f4bbd82a67300acfa24d8, user_id=138f713e0b684f9cbc9189976791014c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.911436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98529f-53a5-4992-bdb8-256f3081cb24 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:54.914536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af390e02-6ecc-415e-b3f5-fb7c9e3b95e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:54.919024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:54.920041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:54.920322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:54.920668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] PATH_INFO: `/v3/projects/46759aa3185b43e2b39845bad974b096/users/48bd1be972d84f6b9381cd04db892691/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:54.942529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46759aa3185b43e2b39845bad974b096, user_id=48bd1be972d84f6b9381cd04db892691, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:54.943073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.038247 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3013/5999] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:54 2022] PUT /identity/v3/projects/b163fa044f5f4bbd82a67300acfa24d8/users/138f713e0b684f9cbc9189976791014c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:55.050666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.050954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.051231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.067027 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2987/6000] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:54 2022] PUT /identity/v3/projects/46759aa3185b43e2b39845bad974b096/users/48bd1be972d84f6b9381cd04db892691/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:55.068137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.115652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] MFA Rules not processed for user `138f713e0b684f9cbc9189976791014c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:55.116918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.218383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd9147-b0fb-4f9c-81bc-2747325e3ac0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.235443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.236249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.237231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.237660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.238443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.241468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.257010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2988/6001] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:55.263955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.273448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742274ae-1a93-4c64-964d-93ebb1e8f7c4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.279186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.280424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.280787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.281130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] PATH_INFO: `/v3/projects/46759aa3185b43e2b39845bad974b096/users/48bd1be972d84f6b9381cd04db892691/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.283231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46759aa3185b43e2b39845bad974b096, user_id=48bd1be972d84f6b9381cd04db892691, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.286245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3014/6002] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:55.291234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c6e8-6641-438f-a5d1-d81424449476 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.291370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.299601 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2989/6003] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:55 2022] PUT /identity/v3/projects/46759aa3185b43e2b39845bad974b096/users/48bd1be972d84f6b9381cd04db892691/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:55.311140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.311425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.311702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.317747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5a4d-16d3-4f95-bc49-5c98546f1292 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.350450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] MFA Rules not processed for user `48bd1be972d84f6b9381cd04db892691`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:55.351703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.388882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.390388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.390775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.391072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.391882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.393988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.395488 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:55.439654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2990/6004] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:55.452174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.453850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.533462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4514a-efe5-4add-912d-9a05b1e7b427 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.537515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.538256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.538559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.538855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.550689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.553165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.560697 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3015/6005] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:55 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:55.560697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.561327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.564114 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2991/6006] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:43:55.565000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.576824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e0a8-674c-4595-850f-b7d90d810ef8 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.646865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.647512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.647791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.648064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.648698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.649885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5d255-e701-4ddf-b4e2-3af0e260d024 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.650805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.655252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.655878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.656161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.656427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] PATH_INFO: `/v3/projects/90c2fcd7d4554e92a664a899423bfb31` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.657643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c2fcd7d4554e92a664a899423bfb31)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:55.659581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:55.773685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2992/6007] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:55 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:43:55.773685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.773685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.828211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c2fcd7d4554e92a664a899423bfb31', 'request_id': 'req-697faf51-ac1c-4583-9690-f758003eafce'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:55.867318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d57d-3212-42ba-bbf3-821b40d33e3a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:55.913790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c2fcd7d4554e92a664a899423bfb31', 'request_id': 'req-697faf51-ac1c-4583-9690-f758003eafce'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:55.921529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:55.922522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:55.922976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:55.923464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:55.924870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c2fcd7d4554e92a664a899423bfb31', 'request_id': 'req-697faf51-ac1c-4583-9690-f758003eafce'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:55.925760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.940461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] The token cache is being invalidate because project 90c2fcd7d4554e92a664a899423bfb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:55.940930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:55.941694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:55.943877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3016/6008] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:55 2022] DELETE /identity/v3/projects/90c2fcd7d4554e92a664a899423bfb31 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:55.944793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:55.948904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:55.998837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.001158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b873-9f9d-4ce0-83cc-d22f9b8ec9bd service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.014134 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2993/6009] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:56.015624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d836-d8c3-44b5-adb5-3d6426cf87b4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.015987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d836-d8c3-44b5-adb5-3d6426cf87b4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.016444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744d836-d8c3-44b5-adb5-3d6426cf87b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.035507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697faf51-ac1c-4583-9690-f758003eafce admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.041122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.042024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.042483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.042955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9744d836-d8c3-44b5-adb5-3d6426cf87b4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:56.043088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.044210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.044346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9744d836-d8c3-44b5-adb5-3d6426cf87b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.046399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.054495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2994/6010] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:56.058945 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3017/6011] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:56.063433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.063569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.063717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.063995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.077672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393ec9-706a-4fcb-ba4c-d7c6306ceb06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.083684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.087471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.087471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.087471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.087471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.090980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:56.094875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.097075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.110720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3018/6012] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:56.114889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.116089 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2995/6013] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:56.122592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.125952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24aaf3-3c3f-4031-97ca-7dfbde99059f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.130996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.131987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.132273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.132556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] PATH_INFO: `/v3/projects/86e75df46c3e43a9b3827c34e8b526a4/users/26ebea6e1d0a4a65b708d459de9b0470/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.143108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ef5f3-2dc2-4134-a87e-85df2f61c33b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.153251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.154161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.155548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.155939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.156540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e75df46c3e43a9b3827c34e8b526a4, user_id=26ebea6e1d0a4a65b708d459de9b0470, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.157312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:43:56.158011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.160106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.163691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e806bb4-75e3-4838-80b5-8253e0e1054c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.179169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2996/6014] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:43:56.183130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.200502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50843856-2565-47f4-93e2-5cb27b9b3e88 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.206265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.206917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.207202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.208919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.208919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.212394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.292263 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:56.299992 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3019/6015] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:56 2022] PUT /identity/v3/projects/86e75df46c3e43a9b3827c34e8b526a4/users/26ebea6e1d0a4a65b708d459de9b0470/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:56.311301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.311696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.312630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.346935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] MFA Rules not processed for user `26ebea6e1d0a4a65b708d459de9b0470`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:56.348399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.372185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2997/6016] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:56.375838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.457599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3020/6017] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:43:56.464434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.464636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.500777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427a498-175b-4d09-bde1-cbfbb75b4b7a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.505918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.506730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.507007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.507277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.507902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.509835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.570804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936162f-91cf-4e60-9778-05084a69e6b7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.644474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '138f713e0b684f9cbc9189976791014c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b163fa044f5f4bbd82a67300acfa24d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.645198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.645448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.645713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] PATH_INFO: `/v3/users/138f713e0b684f9cbc9189976791014c/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.646910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] RBAC: Authorizing `identity:list_user_projects(user_id=138f713e0b684f9cbc9189976791014c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.648765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.665392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2998/6018] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:43:56.666423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.697662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee2b0a-45c9-46ab-be7a-8c5c1822aff9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.703604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.704259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.704539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.704811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.707334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.708176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaf357-342d-4f29-a04a-fd445ed1a22d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.710355 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3021/6019] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/users/138f713e0b684f9cbc9189976791014c/projects => generated 515 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:43:56.711384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.713579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.724011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 2999/6020] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:56.725800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.726320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.726793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.759880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] MFA Rules not processed for user `138f713e0b684f9cbc9189976791014c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:56.761178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.768972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3000/6021] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:56.769788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.779964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0741a-eddc-495d-b907-57feca21c23f tempest-IdentityV3ProjectsTest-417366384 tempest-IdentityV3ProjectsTest-417366384-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.782424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fe393-a8f9-46a9-8a25-dc091a896b96 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.784768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.786007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.786361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.786715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.787797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.788465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.788839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.789044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.789225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.789968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.791622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ebf97-b81c-4f14-ac13-7a045965741e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.817592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3001/6022] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:43:56.821491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.821849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.822494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.848451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] MFA Rules not processed for user `138f713e0b684f9cbc9189976791014c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:56.849811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:56.906344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.907805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:56.930685 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3022/6023] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:56.931398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.940973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.models.token_model [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] User 138f713e0b684f9cbc9189976791014c has no access to project 86e75df46c3e43a9b3827c34e8b526a4 {{(pid=82036) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 30 01:43:56.944403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546c40-2bfd-4d93-b580-15f04d63a12e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:56.949771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:56.950431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:56.950711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:56.950984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] PATH_INFO: `/v3/projects/c1735a8d4dc541c7993bcf8a4f34dda8/users/f7e0dceb70ee44978260397d3c196dc2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:56.957412 n-d-master-1 devstack@keystone.service[82036]: WARNING keystone.server.flask.application [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.13: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 30 01:43:56.967129 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3002/6024] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:56 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 149 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 30 01:43:56.972018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:56.972181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1735a8d4dc541c7993bcf8a4f34dda8, user_id=f7e0dceb70ee44978260397d3c196dc2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:56.974905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea774f-5588-4f6f-9422-61a45a2de014 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:57.025377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c0192-0e45-4370-920b-13bf561809f9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:57.032796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:57.033985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:57.034474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:57.035114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] PATH_INFO: `/v3/users/138f713e0b684f9cbc9189976791014c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:57.038924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138f713e0b684f9cbc9189976791014c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:57.049500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:57.073543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3023/6025] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:43:56 2022] PUT /identity/v3/projects/c1735a8d4dc541c7993bcf8a4f34dda8/users/f7e0dceb70ee44978260397d3c196dc2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:57.084885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:57.085182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:57.085483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:57.140762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] MFA Rules not processed for user `f7e0dceb70ee44978260397d3c196dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:57.142770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:57.236001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3024/6026] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:57.250723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:57.252715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:57.299800 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:57.303013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138f713e0b684f9cbc9189976791014c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:57.303947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138f713e0b684f9cbc9189976791014c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:57.327383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138f713e0b684f9cbc9189976791014c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:57.329878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138f713e0b684f9cbc9189976791014c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:57.405163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3f70e-2d54-4ef8-907b-4bdd67701466 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:57.417159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:57.418354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:57.418687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:57.419024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:57.422079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:57.449720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:57.455181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8369512-e5c6-4514-a846-5868c12052aa service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:57.465457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138f713e0b684f9cbc9189976791014c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:57.481933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3025/6027] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:57.509366 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3003/6028] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:56 2022] DELETE /identity/v3/users/138f713e0b684f9cbc9189976791014c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:57.514747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:57.515374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:57.515752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:57.542776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:43:57.544292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:57.678024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3026/6029] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:43:57.746434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:57.759011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:57.996764 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:58.003651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b092-1f6e-48d2-92c6-c09ed2113715 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:58.007254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:58.008602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:58.009295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:58.010193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:58.045675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:58.047140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:58.082432 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3004/6030] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:43:58.653900 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:43:59.446210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:59.449934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:43:59.481202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c6796-920f-4a1c-851b-97a56aba4863 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:59.501213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:59.502126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:59.504863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:59.505835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] PATH_INFO: `/v3/projects/b163fa044f5f4bbd82a67300acfa24d8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:59.514397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b163fa044f5f4bbd82a67300acfa24d8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:59.521087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:43:59.654787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b163fa044f5f4bbd82a67300acfa24d8', 'request_id': 'req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:59.778625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b163fa044f5f4bbd82a67300acfa24d8', 'request_id': 'req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:59.782228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b163fa044f5f4bbd82a67300acfa24d8', 'request_id': 'req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:59.799850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] The token cache is being invalidate because project b163fa044f5f4bbd82a67300acfa24d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:43:59.800232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:59.801141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-52117ce5-ab82-407d-ad93-be5a5a6b8ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:43:59.803296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3027/6031] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:43:59 2022] DELETE /identity/v3/projects/b163fa044f5f4bbd82a67300acfa24d8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:43:59.807276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:43:59.828252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4d019-d9bd-4381-a190-240d1f48e644 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:43:59.906514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:43:59.909614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:43:59.910365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:43:59.910854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] PATH_INFO: `/v3/users/26ebea6e1d0a4a65b708d459de9b0470` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:43:59.912400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ebea6e1d0a4a65b708d459de9b0470)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:43:59.928115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:00.164511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ebea6e1d0a4a65b708d459de9b0470'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:00.165734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ebea6e1d0a4a65b708d459de9b0470'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:00.174155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ebea6e1d0a4a65b708d459de9b0470'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:00.174932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ebea6e1d0a4a65b708d459de9b0470'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:00.252577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ebea6e1d0a4a65b708d459de9b0470'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:00.275124 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3005/6032] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:43:59 2022] DELETE /identity/v3/users/26ebea6e1d0a4a65b708d459de9b0470 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:00.509747 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:00.778238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821075-c2fe-4f05-809a-5416acdccab9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:00.778529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821075-c2fe-4f05-809a-5416acdccab9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:00.778975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821075-c2fe-4f05-809a-5416acdccab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:00.835394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-59821075-c2fe-4f05-809a-5416acdccab9 None None] MFA Rules not processed for user `f7e0dceb70ee44978260397d3c196dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:00.838869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59821075-c2fe-4f05-809a-5416acdccab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:00.985570 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3028/6033] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:01.039331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:01.040873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:01.247476 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:01.280107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e73ba4-1d9b-410e-82bb-76ea293c7479 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:01.293375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:01.296245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:01.296541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:01.296818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] PATH_INFO: `/v3/projects/86e75df46c3e43a9b3827c34e8b526a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:01.298095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e75df46c3e43a9b3827c34e8b526a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:01.302559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:01.518973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e75df46c3e43a9b3827c34e8b526a4', 'request_id': 'req-d68c0e00-c209-4237-a2c2-a74e0adec19f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:01.546492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e75df46c3e43a9b3827c34e8b526a4', 'request_id': 'req-d68c0e00-c209-4237-a2c2-a74e0adec19f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:01.660264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e75df46c3e43a9b3827c34e8b526a4', 'request_id': 'req-d68c0e00-c209-4237-a2c2-a74e0adec19f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:01.678890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] The token cache is being invalidate because project 86e75df46c3e43a9b3827c34e8b526a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:01.679334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:01.683901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d68c0e00-c209-4237-a2c2-a74e0adec19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:01.688261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3006/6034] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:01 2022] DELETE /identity/v3/projects/86e75df46c3e43a9b3827c34e8b526a4 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:01.695467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:01.696278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:01.696727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:01.758477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:01.759730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:01.927292 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3029/6035] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:01.940898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:01.941140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:01.941402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.009760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:02.011238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:02.050940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3007/6036] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:02.055789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.075039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3be72-8311-4bf0-b433-38098d02027a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.100264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.100264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.100264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.100264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.100785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:02.105926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.107802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.173290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3030/6037] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:02.177908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.190608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32dc2-24e0-4ce2-9b19-5f8e9503e0f6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.206978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.207867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.208300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.208894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.209717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.211806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.326032 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3008/6038] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:02 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:02.326527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.341155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbc5c2-a3bd-4e7c-9d62-8522036885a4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.509056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.509056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.509056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.509056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.509531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.511504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.552807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.555188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:02.574379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc23721-f5cb-46e3-898c-8bc7c4c9d2fc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.582261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.583155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.583589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.584025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] PATH_INFO: `/v3/users/671c58c15d1f4ecb9df1f18565bd91e4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.585456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671c58c15d1f4ecb9df1f18565bd91e4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.601040 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3031/6039] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:02 2022] POST /identity/v3/users => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:02.602627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.606879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.622437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40402474-f116-49ed-a54b-c216b6781c0a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.630092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.630947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.631634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.632062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.632870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.634736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.652617 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3032/6040] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:02.654081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:02.667944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a6908-84c4-47e9-9845-6b93308d3ac3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:02.674186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:02.676565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:02.678109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:02.678109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] PATH_INFO: `/v3/projects/1f9a6754274343a8b8f8d59574b50b62/users/d2b4426e0dba4e6183ed872fc5747a3e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:02.708292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9a6754274343a8b8f8d59574b50b62, user_id=d2b4426e0dba4e6183ed872fc5747a3e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:02.717580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:02.841970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3033/6041] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:02 2022] PUT /identity/v3/projects/1f9a6754274343a8b8f8d59574b50b62/users/d2b4426e0dba4e6183ed872fc5747a3e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:02.855252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.001075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671c58c15d1f4ecb9df1f18565bd91e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:03.015382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671c58c15d1f4ecb9df1f18565bd91e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:03.021959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebbb71-45da-47bd-be1c-6dd96b22d275 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.029625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.031841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.031841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.031841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.032109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.033954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.051295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3034/6042] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:03.057455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.058639 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:03.064077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671c58c15d1f4ecb9df1f18565bd91e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:03.064827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671c58c15d1f4ecb9df1f18565bd91e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:03.097610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71252d-8a4a-406f-9ba0-024e5ab12fe1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.117893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.119321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.119916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.120884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] PATH_INFO: `/v3/projects/1f9a6754274343a8b8f8d59574b50b62/users/d2b4426e0dba4e6183ed872fc5747a3e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.123283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9a6754274343a8b8f8d59574b50b62, user_id=d2b4426e0dba4e6183ed872fc5747a3e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.126523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2b2f5-29bf-447f-bb0b-de698423ae9a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.150999 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3035/6043] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:03 2022] PUT /identity/v3/projects/1f9a6754274343a8b8f8d59574b50b62/users/d2b4426e0dba4e6183ed872fc5747a3e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:03.163875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.164208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.164504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.195884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6c237ba9-5a14-4b92-9891-5232bfa54198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671c58c15d1f4ecb9df1f18565bd91e4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:03.199757 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:03.219408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] MFA Rules not processed for user `d2b4426e0dba4e6183ed872fc5747a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:03.220720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:03.245576 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3009/6044] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:02 2022] DELETE /identity/v3/users/671c58c15d1f4ecb9df1f18565bd91e4 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:03.249437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.250078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.250570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.303092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:03.304488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:03.333191 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3036/6045] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:03.338151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.340402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:03.397732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3010/6046] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:03.405635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.408426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:03.460852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9988e-ab3f-4a0e-9e5a-c1e3940fa8cf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.475947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.476571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.478991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.478991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.478991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.485149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.513811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fec4d-1e2c-4178-9f24-2311b4abcbf5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.519796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.520892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.521366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.521814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.537610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.540004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.560266 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3011/6047] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:03.600940 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3037/6048] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:03 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:03.605781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.620777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31359a-4a99-48dc-adc1-a1b490044ade service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.702761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.703510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.703865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.704204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.704915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.707198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.820915 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3012/6049] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:03 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:03.821253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.832877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65875b-544d-4aa0-92fc-843343674cd2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.838599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.840040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.840619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.841153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.842049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.843861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.857994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3038/6050] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:03.862893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.880470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f126-0119-484d-9f5d-2cd804c95c06 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.896200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.896834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.897170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.897506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.898160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.899997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:03.928859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3013/6051] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:03.933187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:03.950139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ee3f9-cbf3-409c-afd9-6908a6b187fe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:03.955583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:03.957967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:03.958517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:03.958892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] PATH_INFO: `/v3/projects/14eb3c41d6f84a35b9eb959198f88347/users/f14b3feab85440b39eba64c963a7c502/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:03.982234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eb3c41d6f84a35b9eb959198f88347, user_id=f14b3feab85440b39eba64c963a7c502, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:03.987215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944bbc2e-d216-4b5d-85a8-530df735e9c0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:04.128623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:04.132318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:04.158804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63043f89-1c28-44e2-950e-5734c4406475 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:04.161653 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3039/6052] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:03 2022] PUT /identity/v3/projects/14eb3c41d6f84a35b9eb959198f88347/users/f14b3feab85440b39eba64c963a7c502/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:04.167894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:04.168460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:04.168733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:04.224840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] MFA Rules not processed for user `f14b3feab85440b39eba64c963a7c502`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:04.227301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:04.286762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:04.287647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:04.287969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:04.288343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] PATH_INFO: `/v3/projects/14cbe8d6abd8479d9d2fdd46d4c81b73` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:04.289885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cbe8d6abd8479d9d2fdd46d4c81b73)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:04.292041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:04.327700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3040/6053] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:04.340437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:04.342301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:04.469493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cbe8d6abd8479d9d2fdd46d4c81b73', 'request_id': 'req-9182f229-6312-40c1-a083-a6fcc8731df3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:04.491608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cbe8d6abd8479d9d2fdd46d4c81b73', 'request_id': 'req-9182f229-6312-40c1-a083-a6fcc8731df3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:04.505126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21606f99-e006-45b8-9f1d-4fc6a2fb52e9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:04.567014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cbe8d6abd8479d9d2fdd46d4c81b73', 'request_id': 'req-9182f229-6312-40c1-a083-a6fcc8731df3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:04.582986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] The token cache is being invalidate because project 14cbe8d6abd8479d9d2fdd46d4c81b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:04.583378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:04.584979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:04.588232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3014/6054] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:04 2022] DELETE /identity/v3/projects/14cbe8d6abd8479d9d2fdd46d4c81b73 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:04.596688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:04.625427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:04.656346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:04.664962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:04.666629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:04.666629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:04.668304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:04.774193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182f229-6312-40c1-a083-a6fcc8731df3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:04.794065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:04.794725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:04.795007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:04.795284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] PATH_INFO: `/v3/users/48bd1be972d84f6b9381cd04db892691` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:04.800915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bd1be972d84f6b9381cd04db892691)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:04.801176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:04.803236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474565-0aee-446a-83c5-4750c42df9f1 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:04.805053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:04.834429 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3041/6055] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:04.842014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:04.842495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:04.843005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:04.922625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] MFA Rules not processed for user `23ccf9b5810f4c1a8d95e70e15624a43`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:04.924048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:05.013559 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3042/6056] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:05.021039 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:05.027507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:05.030449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:05.048864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bd1be972d84f6b9381cd04db892691'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:05.049828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bd1be972d84f6b9381cd04db892691'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:05.063366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bd1be972d84f6b9381cd04db892691'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:05.064104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bd1be972d84f6b9381cd04db892691'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:05.131859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10414525-cde9-40ef-9ca6-3a9eb6a3e70c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:05.137964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:05.138585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:05.138862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:05.139137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:05.141139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:05.147469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bd1be972d84f6b9381cd04db892691'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:05.154261 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:05.161551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:05.164349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c25a2b-1263-46ef-b211-0dcb17393f79 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:05.178664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3015/6057] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:04 2022] DELETE /identity/v3/users/48bd1be972d84f6b9381cd04db892691 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:05.185024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3043/6058] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:06.211230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:06.212708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:06.351966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54130e9b-5ff9-4fa6-8272-8e752d7124f3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:06.358740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:06.360099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:06.360099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:06.360494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] PATH_INFO: `/v3/projects/46759aa3185b43e2b39845bad974b096` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:06.361471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46759aa3185b43e2b39845bad974b096)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:06.363735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:06.487842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46759aa3185b43e2b39845bad974b096', 'request_id': 'req-938ff593-85cc-4be1-8db9-3eac4d811c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:06.496480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46759aa3185b43e2b39845bad974b096', 'request_id': 'req-938ff593-85cc-4be1-8db9-3eac4d811c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:06.636111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46759aa3185b43e2b39845bad974b096', 'request_id': 'req-938ff593-85cc-4be1-8db9-3eac4d811c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:06.652477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] The token cache is being invalidate because project 46759aa3185b43e2b39845bad974b096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:06.653046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:06.655236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-938ff593-85cc-4be1-8db9-3eac4d811c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:06.658235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3016/6059] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:06 2022] DELETE /identity/v3/projects/46759aa3185b43e2b39845bad974b096 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:06.663685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:06.667752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:06.667752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:06.700718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:06.702348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:06.778193 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3044/6060] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:06.781703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:06.781994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:06.782422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:06.811202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:06.812924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:06.825932 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3017/6061] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:06.826969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:06.839175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c593a-b36b-4b9e-afa4-a4c7dc6f7f03 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:06.844484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:06.845666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:06.846359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:06.846867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:06.847769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:06.848292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:06.851015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:06.881257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3045/6062] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:06.887188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:06.907510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c94b4-a63e-40fd-b645-efb25efa47c1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:06.914094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:06.914701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:06.917451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:06.917451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:06.917451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:06.918950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.094076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:07.095457 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3018/6063] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:06 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:07.105928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61b39e-f6ed-4860-a57f-8eaffc3cc04e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:07.242744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:07.243728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.244278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.245003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.245939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:07.248213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.353643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:07.364392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:07.379550 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3046/6064] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:07 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:07.380873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:07.408860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ad87-17ad-479b-92c1-c9265a54c7ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:07.409067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532446-46e9-40ac-a902-5a2c78b38e87 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:07.419719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:07.420664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.421129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.422606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] PATH_INFO: `/v3/users/d2b4426e0dba4e6183ed872fc5747a3e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.424848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b4426e0dba4e6183ed872fc5747a3e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:07.430674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.434136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:07.434972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.435371 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:07.436037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.436323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.437002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:07.438643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.480168 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3047/6065] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:07.488924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:07.504692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea57aa-4d7b-459e-83a1-d78a66235b32 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:07.516787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:07.517890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.518382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.518952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.519873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:07.522001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.539258 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3048/6066] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:07.544220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:07.565931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8911b-e622-4158-b412-854a85b06f30 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:07.573580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:07.574775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.575501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.575885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] PATH_INFO: `/v3/projects/1ff3722eb4604effa72c37a32f063a18/users/095add70e711473c8f94866eea87ad71/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.596859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff3722eb4604effa72c37a32f063a18, user_id=095add70e711473c8f94866eea87ad71, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:07.599908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ced0-177c-48d8-a2ce-42d0c8360ae1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:07.691767 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:07.717036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b4426e0dba4e6183ed872fc5747a3e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:07.717036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b4426e0dba4e6183ed872fc5747a3e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:07.719083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b4426e0dba4e6183ed872fc5747a3e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:07.721263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b4426e0dba4e6183ed872fc5747a3e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:07.730261 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3049/6067] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:07 2022] PUT /identity/v3/projects/1ff3722eb4604effa72c37a32f063a18/users/095add70e711473c8f94866eea87ad71/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:07.730261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bcd9-483c-4b99-a7f7-c8be3fbf0d5e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.730261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bcd9-483c-4b99-a7f7-c8be3fbf0d5e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.730261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bcd9-483c-4b99-a7f7-c8be3fbf0d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.765833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8607bcd9-483c-4b99-a7f7-c8be3fbf0d5e None None] MFA Rules not processed for user `23ccf9b5810f4c1a8d95e70e15624a43`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:07.767644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8607bcd9-483c-4b99-a7f7-c8be3fbf0d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:07.815874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-749c37c7-e622-46ae-8c51-a7b1decae427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b4426e0dba4e6183ed872fc5747a3e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:07.853052 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3019/6068] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:07 2022] DELETE /identity/v3/users/d2b4426e0dba4e6183ed872fc5747a3e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:07.854996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.855740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.856326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.874555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3050/6069] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:07.880263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:07.880888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:07.881389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:07.947427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:07.949234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:07.964755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] MFA Rules not processed for user `095add70e711473c8f94866eea87ad71`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:07.967914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:08.084639 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3051/6070] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:08.094993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.096812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:08.114299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3020/6071] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:08.123653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.126139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:08.159973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4a3d-6506-4720-ab2c-fd8d0c071dde None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.172674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.173484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.173890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.174266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.175013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.179760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.241962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b7c7-6116-4fd6-abcc-15e35daa6f00 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.248893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.249646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.250002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.250341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.262704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.264588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.280593 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3052/6072] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:08.351243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3021/6073] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:08 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:08.354964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.368297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534696d-88ce-40a2-b0a1-3a84cad3bae6 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.454045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.455787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.456191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.456633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.457818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.459732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.592810 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3053/6074] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:08 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:08.594075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.605806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0580132-1ad9-469c-9f1e-2076c2ef04a7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.626162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.627055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.627501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.627935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.628952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.630843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.661579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3022/6075] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:08.663205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.681242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0da87-218e-4fc8-ae29-90b884c00845 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.692017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.692677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.692963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.693236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] PATH_INFO: `/v3/projects/aecd553894454fe6901ba94dcb6fef34/users/863b32d6e9344f9fa93a3d296302176c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.729282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecd553894454fe6901ba94dcb6fef34, user_id=863b32d6e9344f9fa93a3d296302176c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.733186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.844504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.846842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:08.866681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8c63f-9a86-4be8-b60e-705ab9aa48d8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.879528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.880571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.881082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.881622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] PATH_INFO: `/v3/projects/1f9a6754274343a8b8f8d59574b50b62` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.883877 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3054/6076] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:08 2022] PUT /identity/v3/projects/aecd553894454fe6901ba94dcb6fef34/users/863b32d6e9344f9fa93a3d296302176c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:08.884804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:08.888222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9a6754274343a8b8f8d59574b50b62)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.891375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:08.979722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea975b-8f85-4fb9-bac7-46562fd576bb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:08.987897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:08.988822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:08.989453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:08.995745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:08.995745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:08.995745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:09.008465 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3055/6077] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:09.013974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:09.028341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5983284-6140-4c07-ac81-380775e75397 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:09.062719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9a6754274343a8b8f8d59574b50b62', 'request_id': 'req-be4c12af-8f48-4504-83ff-924db444bae3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.075654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9a6754274343a8b8f8d59574b50b62', 'request_id': 'req-be4c12af-8f48-4504-83ff-924db444bae3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.121031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:09.122000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:09.123581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:09.124039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] PATH_INFO: `/v3/projects/aecd553894454fe6901ba94dcb6fef34/users/863b32d6e9344f9fa93a3d296302176c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:09.126789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecd553894454fe6901ba94dcb6fef34, user_id=863b32d6e9344f9fa93a3d296302176c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:09.131713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5c225-5416-45e4-b832-1280fada778c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:09.159704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3056/6078] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:09 2022] PUT /identity/v3/projects/aecd553894454fe6901ba94dcb6fef34/users/863b32d6e9344f9fa93a3d296302176c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:09.162004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9a6754274343a8b8f8d59574b50b62', 'request_id': 'req-be4c12af-8f48-4504-83ff-924db444bae3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.170303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:09.172213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:09.173300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:09.180374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] The token cache is being invalidate because project 1f9a6754274343a8b8f8d59574b50b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:09.180888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.187817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.189831 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3023/6079] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:08 2022] DELETE /identity/v3/projects/1f9a6754274343a8b8f8d59574b50b62 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:09.193857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:09.195927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:09.247568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c12af-8f48-4504-83ff-924db444bae3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:09.282678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] MFA Rules not processed for user `863b32d6e9344f9fa93a3d296302176c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:09.284091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:09.293925 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:09.326824 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:09.397481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:09.421067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:09.421465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:09.421734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] PATH_INFO: `/v3/users/f14b3feab85440b39eba64c963a7c502` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:09.425984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b3feab85440b39eba64c963a7c502)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:09.427857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:09.525982 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3057/6080] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:09.534270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:09.543407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:09.634066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c37b53-848b-46e6-aa92-c9cceb02e57a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:09.638302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:09.638936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:09.639277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:09.639565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:09.652662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:09.659153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:09.680854 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3058/6081] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:09.792398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b3feab85440b39eba64c963a7c502'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.792398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b3feab85440b39eba64c963a7c502'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.794205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b3feab85440b39eba64c963a7c502'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.795542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b3feab85440b39eba64c963a7c502'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:09.970527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:09.972570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:09.987106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3eca4c92-a700-4d5e-884d-9b15b6350c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b3feab85440b39eba64c963a7c502'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.000169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1bec-aebd-4d81-a12c-993d1d459e6f service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:10.010810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:10.015672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:10.015672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:10.015672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] PATH_INFO: `/v3/users/095add70e711473c8f94866eea87ad71` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:10.015672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=095add70e711473c8f94866eea87ad71)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:10.017601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:10.024885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3024/6082] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:09 2022] DELETE /identity/v3/users/f14b3feab85440b39eba64c963a7c502 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:10.350511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095add70e711473c8f94866eea87ad71'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.429041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095add70e711473c8f94866eea87ad71'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.429686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095add70e711473c8f94866eea87ad71'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.448553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095add70e711473c8f94866eea87ad71'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.460274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095add70e711473c8f94866eea87ad71'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:10.484962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3059/6083] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:09 2022] DELETE /identity/v3/users/095add70e711473c8f94866eea87ad71 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:10.489646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:10.489938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:10.490213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:10.523726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:10.525208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:10.568801 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:10.628921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3025/6084] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:10.642916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:10.644372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:10.740506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeedf6-45a0-4b31-8ac3-a34ad52be0db admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:10.744563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:10.751042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:10.751042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:10.751042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:10.756574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:10.758441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085127dc-49ae-4abe-84a5-991f2c93c3a1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:10.771374 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3060/6085] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:10.871967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:10.873620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:10.940045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57cfaa-b937-4a1f-9494-c46162aa3d02 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:10.954929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:10.954929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:10.954929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:10.954929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] PATH_INFO: `/v3/projects/14eb3c41d6f84a35b9eb959198f88347` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:10.955378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eb3c41d6f84a35b9eb959198f88347)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:10.955378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.040010 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:11.114922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eb3c41d6f84a35b9eb959198f88347', 'request_id': 'req-83105a8d-e983-49ed-8389-a88e1422b28d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.121774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eb3c41d6f84a35b9eb959198f88347', 'request_id': 'req-83105a8d-e983-49ed-8389-a88e1422b28d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.226073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eb3c41d6f84a35b9eb959198f88347', 'request_id': 'req-83105a8d-e983-49ed-8389-a88e1422b28d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.239543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] The token cache is being invalidate because project 14eb3c41d6f84a35b9eb959198f88347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:11.240450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.241110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.242909 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3026/6086] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:10 2022] DELETE /identity/v3/projects/14eb3c41d6f84a35b9eb959198f88347 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:11.248402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618112-afd7-4d61-baf9-9bab73896806 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.248926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618112-afd7-4d61-baf9-9bab73896806 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.248926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b618112-afd7-4d61-baf9-9bab73896806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.271730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b618112-afd7-4d61-baf9-9bab73896806 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:11.273154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b618112-afd7-4d61-baf9-9bab73896806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:11.297328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.297328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:11.392272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3061/6087] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:11.394185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.394470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.394741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.420719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:11.427583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:11.438101 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3062/6088] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:11.443355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.465979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad117f7-f27a-4bdb-b11f-4c2dda9d5f69 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.467219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83105a8d-e983-49ed-8389-a88e1422b28d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.478016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.484903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.484903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.484903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.485480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.485480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.485480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.485480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] PATH_INFO: `/v3/projects/1ff3722eb4604effa72c37a32f063a18` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.485780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:11.486171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.487743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.489739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff3722eb4604effa72c37a32f063a18)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.491795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.505805 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3063/6089] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:11.512342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.523548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ebecc-c1a2-4dd1-9e0d-ee7b7a20f74d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.530619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.531853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.532212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.532571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.533433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.536747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.630622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff3722eb4604effa72c37a32f063a18', 'request_id': 'req-64ce0707-4ad5-4ccb-90e5-d24a28be450d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.638271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff3722eb4604effa72c37a32f063a18', 'request_id': 'req-64ce0707-4ad5-4ccb-90e5-d24a28be450d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.642734 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:11.655082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3064/6090] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:11 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:11.656210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.749267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab5ef-4f6d-466c-83dd-f7014b8ff8ac admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.754625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff3722eb4604effa72c37a32f063a18', 'request_id': 'req-64ce0707-4ad5-4ccb-90e5-d24a28be450d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.754824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.758189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.758189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.758189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.758189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.758702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.774763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] The token cache is being invalidate because project 1ff3722eb4604effa72c37a32f063a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:11.775204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.776843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:11.779687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3027/6091] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:11 2022] DELETE /identity/v3/projects/1ff3722eb4604effa72c37a32f063a18 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:11.783790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.786465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:11.856602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce0707-4ad5-4ccb-90e5-d24a28be450d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.861744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.862428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.862836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.863106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] PATH_INFO: `/v3/users/863b32d6e9344f9fa93a3d296302176c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.864248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=863b32d6e9344f9fa93a3d296302176c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.867118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.908887 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3065/6092] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:11 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:11.908887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.908887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:11.918166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac71ac-2fb5-4de1-bd77-32b01cb2b897 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.922895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.923520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.923792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.924060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.926750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.928364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:11.939384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3066/6093] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:11.943344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:11.953788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85ee08-b79a-466d-9ad9-cf7aa47c4288 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:11.958527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:11.959251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:11.959536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:11.964292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] PATH_INFO: `/v3/projects/75539b68d09c40e18252d499457d7609/users/3456f160d6e345f1a5b18f54635c1e53/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:11.975295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75539b68d09c40e18252d499457d7609, user_id=3456f160d6e345f1a5b18f54635c1e53, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:11.978032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.074470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3067/6094] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:11 2022] PUT /identity/v3/projects/75539b68d09c40e18252d499457d7609/users/3456f160d6e345f1a5b18f54635c1e53/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:12.078452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.141432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863b32d6e9344f9fa93a3d296302176c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:12.143292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863b32d6e9344f9fa93a3d296302176c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:12.165623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863b32d6e9344f9fa93a3d296302176c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:12.165748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8b39e-915e-44e2-8190-9545eb4925f6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.165851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863b32d6e9344f9fa93a3d296302176c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:12.165940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:12.165940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.165940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.165940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.166331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:12.166331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.177281 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3068/6095] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:12.180645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.182963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:12.195655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb52f-bebd-4ff4-932d-c63dc83e414e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.201267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:12.201933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.202214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.202484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] PATH_INFO: `/v3/projects/75539b68d09c40e18252d499457d7609/users/3456f160d6e345f1a5b18f54635c1e53/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.204396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75539b68d09c40e18252d499457d7609, user_id=3456f160d6e345f1a5b18f54635c1e53, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:12.207068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad225-9946-4436-bc3a-8faced6bb0f0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.217735 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3069/6096] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:12 2022] PUT /identity/v3/projects/75539b68d09c40e18252d499457d7609/users/3456f160d6e345f1a5b18f54635c1e53/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:12.228444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.229530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.229530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.249815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863b32d6e9344f9fa93a3d296302176c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:12.258955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] MFA Rules not processed for user `3456f160d6e345f1a5b18f54635c1e53`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:12.260179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:12.281508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3028/6097] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:11 2022] DELETE /identity/v3/users/863b32d6e9344f9fa93a3d296302176c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:12.380598 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3070/6098] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:12.384465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.476613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d863441-727c-4f16-badf-bf928c6df01c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.482171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:12.482798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.483132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.483701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.484340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:12.486408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.641402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3029/6099] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:12 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:12.642631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.721593 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:12.768614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ea2be-9b88-4c12-ae9d-2384cbd00246 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.812996 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:12.839869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:12.840485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.841154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.841485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.842095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:12.844053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.910571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.913167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:12.929509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de298fd5-2d81-49f4-b875-3a132f583ef5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.940417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:12.940417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:12.940417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:12.940417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] PATH_INFO: `/v3/projects/aecd553894454fe6901ba94dcb6fef34` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:12.942658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecd553894454fe6901ba94dcb6fef34)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:12.944928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:12.978960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3071/6100] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:12 2022] POST /identity/v3/users => generated 290 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:12.983572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:12.994380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512de8c-d21a-4ff0-94bb-2f0c902be651 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:12.999656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.008479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.008479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.008479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.008479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.008479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.013868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3072/6101] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:13.017711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.027980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6b1c6-ccd6-4dd4-a6bc-5b039f9456f6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.032708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.033360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.033607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.033895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.034527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.036087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.049574 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3073/6102] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:13.053806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.064556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40742c-d889-4a3a-b149-e929ffc6c159 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.071224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.072006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.072329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.072621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] PATH_INFO: `/v3/projects/03a7b536749042ea8337367de763a5a4/users/0185d93f50e744058b648c42f348bf50/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.090941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a7b536749042ea8337367de763a5a4, user_id=0185d93f50e744058b648c42f348bf50, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.093697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ffc1d-1280-4c1a-83d2-7e8e3fb6fd83 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.248710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3074/6103] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:13 2022] PUT /identity/v3/projects/03a7b536749042ea8337367de763a5a4/users/0185d93f50e744058b648c42f348bf50/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:13.249083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecd553894454fe6901ba94dcb6fef34', 'request_id': 'req-092fcd12-a757-48b4-adeb-fe8a4669f416'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:13.251879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.257237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.257237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.257913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecd553894454fe6901ba94dcb6fef34', 'request_id': 'req-092fcd12-a757-48b4-adeb-fe8a4669f416'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:13.289754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] MFA Rules not processed for user `0185d93f50e744058b648c42f348bf50`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:13.293542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:13.366244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecd553894454fe6901ba94dcb6fef34', 'request_id': 'req-092fcd12-a757-48b4-adeb-fe8a4669f416'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:13.381557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3075/6104] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:13.393308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.395677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] The token cache is being invalidate because project aecd553894454fe6901ba94dcb6fef34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:13.396228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:13.396983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:13.397124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-092fcd12-a757-48b4-adeb-fe8a4669f416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:13.398989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3030/6105] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:12 2022] DELETE /identity/v3/projects/aecd553894454fe6901ba94dcb6fef34 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:13.404613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a99a2-e191-4ec0-8fed-9a39ed80649e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.405141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a99a2-e191-4ec0-8fed-9a39ed80649e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.405541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a99a2-e191-4ec0-8fed-9a39ed80649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.428090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ab1a99a2-e191-4ec0-8fed-9a39ed80649e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:13.429550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ab1a99a2-e191-4ec0-8fed-9a39ed80649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:13.480975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa0bb0-8cc7-4a57-8a4e-dbe6fb526a62 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.486809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.487492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.488178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.488178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.490418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:13.505347 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3031/6106] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:13.513784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.514069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.514351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.539517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:13.544766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:13.553939 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3032/6107] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:13.558241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.567663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdbb7d-5091-497b-963a-87e8e01fa5eb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.572493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.573648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.573926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.574198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.574849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:13.575062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.575169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.576621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.576744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.589495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3076/6108] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:13.590525 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3033/6109] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:13.594373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.606291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6d4b-0808-4dd5-a61f-06c539d53b85 service glance] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.611910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.612523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.612804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.613081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.613813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.615885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.710780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3077/6110] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:13 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:13.714861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.725581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b3a27-7388-4a4b-a283-aab90f7e5a19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.790459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.791064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.791345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.791618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.792255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.794246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:13.944828 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3034/6111] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:13 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:13.949884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:13.961387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a788-d17b-4b6f-989e-335bdec9474e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:13.967786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:13.968878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:13.968878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:13.969089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:13.969609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:13.982597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.001074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3078/6112] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:14.008506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.023768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e559e8-7577-43e4-a953-cb39347c165d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.028803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.029750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.030591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.031049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.031848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.033869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67cc908-6035-4333-a7c3-4e88b10dd1d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.053367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.055042 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3035/6113] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:14.065163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ad1dc-a431-4ee4-bc60-9bdede612efe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.070276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.072004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.072521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.072973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] PATH_INFO: `/v3/projects/c0031308497043568b87d8f0f810b30b/users/fc36622d87a74ff3a39307149cde8bfd/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.089700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0031308497043568b87d8f0f810b30b, user_id=fc36622d87a74ff3a39307149cde8bfd, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.092701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.173389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3079/6114] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:14 2022] PUT /identity/v3/projects/c0031308497043568b87d8f0f810b30b/users/fc36622d87a74ff3a39307149cde8bfd/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:14.184397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.185544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.185989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.233551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] MFA Rules not processed for user `fc36622d87a74ff3a39307149cde8bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:14.234932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:14.343854 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3036/6115] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:14.348031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.447557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa77b1a-2f76-42f6-b211-a60dc3becc67 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.460307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.460927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.461202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.461492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.462141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.464564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.572621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3080/6116] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:14 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:14.576422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.587939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad7431-3678-4eb0-875e-ab944326c6e7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.669452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.670278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.674888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.674888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.675864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.679277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.715680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.717727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:14.745025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65293-6fba-4be0-87ca-cb90b4da24ab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.754361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.755024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.755354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.755637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] PATH_INFO: `/v3/users/3456f160d6e345f1a5b18f54635c1e53` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.757382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3456f160d6e345f1a5b18f54635c1e53)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.759562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.833979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3037/6117] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:14 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:14.837654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.851639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1381f-1550-408d-895d-afc8472b762d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.860978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.871559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.871559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.871559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.871559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.871559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:14.877444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3038/6118] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:14.881609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:14.921437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f932a-e7c9-4585-815a-b672ae736e74 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:14.941120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:14.941120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:14.941120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:14.941120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] PATH_INFO: `/v3/projects/84fe0f3288a747f0ad173db414868fec/users/8f9b2f5f8257486398c841ac6bd4eebe/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:14.974635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fe0f3288a747f0ad173db414868fec, user_id=8f9b2f5f8257486398c841ac6bd4eebe, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:14.978317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:15.009726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3456f160d6e345f1a5b18f54635c1e53'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:15.099181 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3039/6119] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:14 2022] PUT /identity/v3/projects/84fe0f3288a747f0ad173db414868fec/users/8f9b2f5f8257486398c841ac6bd4eebe/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:15.103168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:15.121509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3456f160d6e345f1a5b18f54635c1e53'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:15.122156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3456f160d6e345f1a5b18f54635c1e53'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:15.147667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3456f160d6e345f1a5b18f54635c1e53'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:15.156366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-919bb2ae-5156-4fc6-9119-4b3cf4c9b61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3456f160d6e345f1a5b18f54635c1e53'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:15.169023 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3081/6120] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:14 2022] DELETE /identity/v3/users/3456f160d6e345f1a5b18f54635c1e53 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:15.174777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.175160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.175506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.191097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74874-a4a8-4b0d-8959-f8982fff8afc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:15.206243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:15.206997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.250601 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:15.354482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:15.355261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.357161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.357571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.358608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:15.360366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:15.363860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3082/6121] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:15.372156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:15.376197 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3040/6122] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:15.377197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:15.377613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.379039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.393167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2512e4-9f31-4973-a973-afa9380697f1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:15.399797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:15.401291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.404231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.404904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] PATH_INFO: `/v3/projects/84fe0f3288a747f0ad173db414868fec/users/8f9b2f5f8257486398c841ac6bd4eebe/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.410565 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:15.412940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fe0f3288a747f0ad173db414868fec, user_id=8f9b2f5f8257486398c841ac6bd4eebe, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:15.420074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ff012-d664-45a8-bb7a-96b91253878b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:15.486527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3041/6123] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:15 2022] PUT /identity/v3/projects/84fe0f3288a747f0ad173db414868fec/users/8f9b2f5f8257486398c841ac6bd4eebe/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:15.488504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.488829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.489108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.508384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0beed3-65d9-421c-ab06-c2142ddce1c0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:15.567388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] MFA Rules not processed for user `8f9b2f5f8257486398c841ac6bd4eebe`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:15.568739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.639480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:15.640248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.642247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.642647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.746594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3042/6124] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:15.747867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:15.749475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.805966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:15.805966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:15.832668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3083/6125] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:15.873329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9683b4-6526-41c5-8a87-70731c32e15e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:15.888528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:15.899032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:15.899325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:15.899606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:15.903567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:15.998329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:16.001641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:16.036692 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3043/6126] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:16.554695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:16.556184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:16.566180 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:16.586665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8a7ca-9aca-428d-bda2-01463878c382 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:16.613896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:16.614726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:16.615066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:16.615409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] PATH_INFO: `/v3/projects/75539b68d09c40e18252d499457d7609` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:16.618067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75539b68d09c40e18252d499457d7609)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:16.626052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:16.919167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75539b68d09c40e18252d499457d7609', 'request_id': 'req-54c85fdf-3630-49b5-8297-0b126824d8b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.064025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75539b68d09c40e18252d499457d7609', 'request_id': 'req-54c85fdf-3630-49b5-8297-0b126824d8b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.074297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75539b68d09c40e18252d499457d7609', 'request_id': 'req-54c85fdf-3630-49b5-8297-0b126824d8b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.088051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] The token cache is being invalidate because project 75539b68d09c40e18252d499457d7609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:17.088469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.089432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.092237 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3084/6127] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:16 2022] DELETE /identity/v3/projects/75539b68d09c40e18252d499457d7609 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:17.097216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:17.112612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16e10-0b96-4a47-88db-e1055ab6e50c service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:17.180354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:17.180989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:17.181268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:17.182693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] PATH_INFO: `/v3/users/0185d93f50e744058b648c42f348bf50` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:17.183442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0185d93f50e744058b648c42f348bf50)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:17.185383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:17.310159 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:17.383714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0185d93f50e744058b648c42f348bf50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.385072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0185d93f50e744058b648c42f348bf50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.407427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0185d93f50e744058b648c42f348bf50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.407720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0185d93f50e744058b648c42f348bf50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.492141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7dcde40d-2588-4422-9d38-cfed921a5052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0185d93f50e744058b648c42f348bf50'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:17.534958 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3044/6128] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:17 2022] DELETE /identity/v3/users/0185d93f50e744058b648c42f348bf50 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:18.247377 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:18.550058 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:18.846680 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:19.045682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:19.052601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:19.117768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c85fdf-3630-49b5-8297-0b126824d8b4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:19.320554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:19.322042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:19.323192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:19.323676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] PATH_INFO: `/v3/projects/03a7b536749042ea8337367de763a5a4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:19.325654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a7b536749042ea8337367de763a5a4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:19.328046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:19.498382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a7b536749042ea8337367de763a5a4', 'request_id': 'req-9f709c66-ec5c-47a6-be26-444060a5555c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:19.503415 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:19.560135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a7b536749042ea8337367de763a5a4', 'request_id': 'req-9f709c66-ec5c-47a6-be26-444060a5555c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:19.580301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a7b536749042ea8337367de763a5a4', 'request_id': 'req-9f709c66-ec5c-47a6-be26-444060a5555c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:19.603023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] The token cache is being invalidate because project 03a7b536749042ea8337367de763a5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:19.604575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:19.607648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f709c66-ec5c-47a6-be26-444060a5555c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:19.618002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3085/6129] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:19 2022] DELETE /identity/v3/projects/03a7b536749042ea8337367de763a5a4 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:19.620497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:19.621469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:19.622206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:19.680836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:19.686408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:19.824796 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:19.853589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3045/6130] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:19.860066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:19.860350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:19.860620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:19.916490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:19.917757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:19.926919 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3086/6131] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:19.931419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:19.957249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17427e-98e8-439f-8c30-0d3286e09a49 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:19.977227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:19.980126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:19.980411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:19.980535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:19.986179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:19.987018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:19.995351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.018755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3046/6132] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:20.022907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.033584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fce0f2-4ef8-461a-b791-793314424464 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.038882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.040222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.040600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.041827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.042621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.044950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.149604 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3087/6133] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:20 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:20.153690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.166898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc5243-dfe0-40b8-99f1-3a2ef16985ca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.207561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.212289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:20.220402 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:20.342984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e02b6-9e18-45bd-9e72-7919146de8e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.355764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.356338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.357141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.358821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.359588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.364814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.365955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.366425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.372529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.372677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.373024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:20.470541 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3047/6134] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:20 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:20.471632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.473112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.474612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.496463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2023c-6330-42c4-90ec-a6c3bc963411 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.504981 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3088/6135] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:20.511676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.514201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.514726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.515235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.516116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.518165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.545481 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3048/6136] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:20.549182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.570361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae102-b608-4907-a93e-06b21876fdb3 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.585913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.586582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.586961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.591336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.592041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.593706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de6610-f457-4a4d-81c7-a6ee10278203 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.651818 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3089/6137] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:20.658591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:20.699240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755d5a-5a06-4a2c-a695-abe5990c2d47 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:20.715003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:20.716001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.716556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.717013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] PATH_INFO: `/v3/projects/3553c4d17a1c4b2899c53f6ee12f67b6/users/284f9fd2bdaf4038bf08e77f16e71c08/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.735997 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:20.749673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3553c4d17a1c4b2899c53f6ee12f67b6, user_id=284f9fd2bdaf4038bf08e77f16e71c08, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:20.753770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:20.863465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3049/6138] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:20 2022] PUT /identity/v3/projects/3553c4d17a1c4b2899c53f6ee12f67b6/users/284f9fd2bdaf4038bf08e77f16e71c08/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:20.865873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6a1-286c-4e9a-82e8-3162d12bc0c6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:20.866338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6a1-286c-4e9a-82e8-3162d12bc0c6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:20.867045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3e6a1-286c-4e9a-82e8-3162d12bc0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:20.941455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-39c3e6a1-286c-4e9a-82e8-3162d12bc0c6 None None] MFA Rules not processed for user `284f9fd2bdaf4038bf08e77f16e71c08`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:20.943274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-39c3e6a1-286c-4e9a-82e8-3162d12bc0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:21.102575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3090/6139] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:21.112116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:21.116584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:21.256418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698f58b-93db-4866-a1c5-f00e91d02884 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:21.261859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:21.262595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:21.263038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:21.263319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:21.275085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:21.280927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:21.298142 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3050/6140] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:21.657563 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:21.824153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:21.824632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:21.824775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:21.871041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:21.872274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:22.021979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3091/6141] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:22.047260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:22.048901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:22.171984 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:22.199247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41694-9644-4a47-9b37-f6634adc0cb7 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:22.205462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:22.210187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:22.210187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:22.210187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:22.219332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:22.221905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2482-3501-43e1-a981-adcd5a6d7b0e service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:22.240279 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3051/6142] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:22.507407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:22.509116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:22.617830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a5ea8-19c9-4614-9318-a24135d91ca1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:22.625790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:22.626673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:22.627224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:22.627684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] PATH_INFO: `/v3/users/c71189cb33a24ae88231dcb08512597b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:22.629163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71189cb33a24ae88231dcb08512597b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:22.631500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:23.006140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71189cb33a24ae88231dcb08512597b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:23.139966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71189cb33a24ae88231dcb08512597b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:23.146197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71189cb33a24ae88231dcb08512597b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:23.202222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71189cb33a24ae88231dcb08512597b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:23.216689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01e78cc3-dbb8-432e-8810-c1ffa6522ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71189cb33a24ae88231dcb08512597b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:23.226398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3092/6143] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:22 2022] DELETE /identity/v3/users/c71189cb33a24ae88231dcb08512597b => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:23.228065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:23.228576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:23.228677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:23.287584 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:23.306311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:23.307939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:23.343358 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:23.452959 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3052/6144] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:23.457988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:23.458273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:23.458549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:23.493320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:23.495382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:23.518170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:23.524965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:23.695742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c703f-45cf-4709-a18b-d1afdfdf03de None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:23.703606 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3093/6145] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:23.704809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:23.705512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:23.705797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:23.706080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:23.719093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:23.720567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:23.722392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:23.724882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:23.732870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3053/6146] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:23.819930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778064f-934b-40d5-8ca2-a5172c49026a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:23.829028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:23.830107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:23.830549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:23.831092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:23.844366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:23.846439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e25e6-6dd2-40ec-b25b-17d8f04eeaf7 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:23.874563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3094/6147] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:23.970105 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:24.143589 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:24.359993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:24.362901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:24.396881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778de74-388c-4e09-bd61-7f1633d7cbdb service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:24.410083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:24.410728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:24.411006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:24.414778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] PATH_INFO: `/v3/projects/40b880a16cd64342a92c80b215d94d7a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:24.416131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b880a16cd64342a92c80b215d94d7a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:24.418153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:24.533692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b880a16cd64342a92c80b215d94d7a', 'request_id': 'req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:24.539578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b880a16cd64342a92c80b215d94d7a', 'request_id': 'req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:24.544322 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:24.605048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b880a16cd64342a92c80b215d94d7a', 'request_id': 'req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:24.621998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] The token cache is being invalidate because project 40b880a16cd64342a92c80b215d94d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:24.622369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:24.623129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:24.625477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3054/6148] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:24 2022] DELETE /identity/v3/projects/40b880a16cd64342a92c80b215d94d7a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:24.708670 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:24.977950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3064d2-c50c-4ae4-b835-836028668ae0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:24.978226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3064d2-c50c-4ae4-b835-836028668ae0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:24.978861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3064d2-c50c-4ae4-b835-836028668ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:25.028754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8e3064d2-c50c-4ae4-b835-836028668ae0 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:25.034257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e3064d2-c50c-4ae4-b835-836028668ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:25.207152 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:25.248131 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3095/6149] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:25.262278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:25.263868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:25.264013 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:25.415575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5d70-e603-4168-a5ea-33bf6b364e2f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:25.430837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:25.432281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:25.432829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:25.433268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:25.454276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:25.456806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:25.477351 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3055/6150] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:25.498132 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:25.934323 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:26.258410 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:26.616936 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:26.669223 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:26.751890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347dcb-a940-4742-a9a4-4f411f16d7c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:26.752316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347dcb-a940-4742-a9a4-4f411f16d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:26.752656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347dcb-a940-4742-a9a4-4f411f16d7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:26.819775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21347dcb-a940-4742-a9a4-4f411f16d7c0 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:26.821281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21347dcb-a940-4742-a9a4-4f411f16d7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:26.839319 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3096/6151] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:26.852219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:26.879346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd66a4-a7a8-4cb6-93d6-6d4b2e0a62a5 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:26.884851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:26.885483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:26.885764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:26.886037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:26.894729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:26.896425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafe03a-0fae-4be6-ae55-02e44278320a service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:26.909744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3056/6152] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:44:27.167838 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:27.686764 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:28.003429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:28.004163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:28.004163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:28.041541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:28.041541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:28.062110 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3097/6153] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:28.069557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a782eec-74ed-4077-8cde-1746bbeba50a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:28.070073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a782eec-74ed-4077-8cde-1746bbeba50a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:28.070161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a782eec-74ed-4077-8cde-1746bbeba50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:28.079403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:28.095280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8a782eec-74ed-4077-8cde-1746bbeba50a None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:28.096648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa646f7-a45f-4d84-9bb8-110ac398812c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:28.096791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8a782eec-74ed-4077-8cde-1746bbeba50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:28.102632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:28.103267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:28.103909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:28.104187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:28.114044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:28.116927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:28.128852 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3098/6154] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:28.159320 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3057/6155] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:29.197693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:29.199434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:29.224664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:29.225560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:29.225988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:29.269718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:29.271319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:29.281595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3058/6156] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:29.296571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:29.297042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fb2f7-71a1-460b-874f-293d5dfaab3e service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:29.301128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:29.301905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:29.302192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:29.302466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:29.304412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:29.314179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9879d-ecec-4332-9a3d-5cf3d692e871 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:29.321135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:29.323205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:29.323868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:29.324496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:29.336567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:29.339165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe34945-6151-473c-bef3-22e5c34720e6 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:29.389114 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3059/6157] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:29.392993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:29.393531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:29.394669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:29.428195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:29.429456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:29.442119 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3060/6158] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:29.447616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:29.449542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a95855-8d48-497b-93ca-f8fa84294e64 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:29.464693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:29.464846 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3099/6159] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:29.472182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5a2cc-2104-4be2-a63a-ad2af4e15077 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:29.477627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:29.478377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:29.478719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:29.479062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:29.497230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:29.499124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:29.538849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3061/6160] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:44:30.848190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded57d-91d9-44c4-a2b7-31078921372d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:30.848705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded57d-91d9-44c4-a2b7-31078921372d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:30.848822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded57d-91d9-44c4-a2b7-31078921372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:30.870456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0cded57d-91d9-44c4-a2b7-31078921372d None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:30.872620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0cded57d-91d9-44c4-a2b7-31078921372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:30.900409 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3100/6161] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:30.914637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:30.929707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4c45f-b578-4686-922c-4d4125c08067 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:30.937119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:30.937948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:30.938258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:30.938539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:30.948663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:30.950280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:30.958953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3062/6162] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:44:31.180811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:31.181090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:31.181936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:31.205020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:31.207487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:31.214518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3101/6163] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:31.233546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:31.263097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dde4b-43f9-4629-88b0-61326adb0181 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:31.269278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:31.270152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:31.270772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:31.271268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:31.281122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:31.283270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c36760-f981-450f-8d4b-16c55e57be99 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:31.294229 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3063/6164] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:31.882705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:31.885180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:31.920163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa984d4-d824-4499-95d5-01649ad8db6f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:31.931918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:31.932668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:31.933231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:31.933648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] PATH_INFO: `/v3/users/fc36622d87a74ff3a39307149cde8bfd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:31.964876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc36622d87a74ff3a39307149cde8bfd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:31.964876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:31.970967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:31.971501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:31.971790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.003278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:32.004684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:32.036339 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3064/6165] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:32.036339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:32.053658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34dec0-ae1d-4363-b517-30b558272950 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:32.065725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:32.067461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.067976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.078984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.097965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:32.099919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837db49-c7d7-47d8-8e31-e1e4860c0871 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:32.129882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3065/6166] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:32.141528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.147443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.147902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.189000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:32.190603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:32.214732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3066/6167] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:44:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:32.222247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc36622d87a74ff3a39307149cde8bfd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:32.229788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:32.273228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474538e2-03bf-4b65-ac6e-94bd639366ca None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:32.289529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:32.290360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.291364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.291666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.304528 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:32.310771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:32.313735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4cb97-3430-43b2-ab28-82318f549eae service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:32.331562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc36622d87a74ff3a39307149cde8bfd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:32.332469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc36622d87a74ff3a39307149cde8bfd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:32.333459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3067/6168] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:32.349240 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:32.356154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc36622d87a74ff3a39307149cde8bfd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:32.373219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc36622d87a74ff3a39307149cde8bfd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:32.386335 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3102/6169] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:31 2022] DELETE /identity/v3/users/fc36622d87a74ff3a39307149cde8bfd => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:32.402226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4343-50dd-4c72-b7c0-42ead3485301 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.402515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4343-50dd-4c72-b7c0-42ead3485301 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.402986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4343-50dd-4c72-b7c0-42ead3485301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.434389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6c2b4343-50dd-4c72-b7c0-42ead3485301 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:32.435982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6c2b4343-50dd-4c72-b7c0-42ead3485301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:32.605899 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3068/6170] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:32.636490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:32.638170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:32.769998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efb463-911e-46f8-9570-9affeadf4b0e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:32.774988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:32.775897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.776550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.776728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.831379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:32.836059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:32.870597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3aa1-1225-43ac-ab16-3d993883d148 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:32.871732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3aa1-1225-43ac-ab16-3d993883d148 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:32.872022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf3aa1-1225-43ac-ab16-3d993883d148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:32.886562 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3103/6171] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:32.927450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-53cf3aa1-1225-43ac-ab16-3d993883d148 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:32.931369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53cf3aa1-1225-43ac-ab16-3d993883d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:33.085186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3069/6172] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:33.098509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:33.100659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:33.366193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542920e-5074-42c7-9b97-6d1459cb5ad9 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:33.386163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be685-e7ed-48b7-a977-fd8323dff998 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:33.386974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be685-e7ed-48b7-a977-fd8323dff998 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:33.387430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0be685-e7ed-48b7-a977-fd8323dff998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:33.388197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:33.388912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:33.389270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:33.389690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:33.401126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:33.405561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:33.412470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bc0be685-e7ed-48b7-a977-fd8323dff998 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:33.414311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc0be685-e7ed-48b7-a977-fd8323dff998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:33.415753 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3104/6173] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:33.432381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3070/6174] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:33.486024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:33.512221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a2804-755e-4b37-b2ee-9ee213874374 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:33.529427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:33.530336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:33.530801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:33.531224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:33.545653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:33.547502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:33.557797 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3105/6175] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:33.892613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:33.892913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:33.893394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:33.924528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:33.929839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:33.942989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:33.945902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:33.961479 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3071/6176] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:33.963491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:33.972552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d044aa-e9d9-4ed5-b55c-d45f7b16fc18 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:33.980657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:33.981828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:33.982310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:33.983051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] PATH_INFO: `/v3/projects/c0031308497043568b87d8f0f810b30b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:33.984647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0031308497043568b87d8f0f810b30b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:33.987889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:33.993809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a71c1-f94a-4a1b-9640-c9967b2f3fbb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:34.011419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:34.011939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:34.012430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:34.012931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:34.045053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:34.052565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:34.064332 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3072/6177] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:34.194937 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:34.212008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0031308497043568b87d8f0f810b30b', 'request_id': 'req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.302708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0031308497043568b87d8f0f810b30b', 'request_id': 'req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.314007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0031308497043568b87d8f0f810b30b', 'request_id': 'req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.332509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] The token cache is being invalidate because project c0031308497043568b87d8f0f810b30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:34.337184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.338438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ca3ac7e9-ac44-48a8-9ac3-cae3103494ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.340829 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3106/6178] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:33 2022] DELETE /identity/v3/projects/c0031308497043568b87d8f0f810b30b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:34.344850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:34.362328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae27eb-877b-41cb-b515-ff05917cbce9 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:34.610543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:34.610978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:34.619233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:34.619616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] PATH_INFO: `/v3/users/8f9b2f5f8257486398c841ac6bd4eebe` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:34.623187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9b2f5f8257486398c841ac6bd4eebe)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:34.634829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:34.674354 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:34.684300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:34.684590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:34.684893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:34.772004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:34.772004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:34.890984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9b2f5f8257486398c841ac6bd4eebe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.891703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9b2f5f8257486398c841ac6bd4eebe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.925676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3107/6179] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:34.937264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9b2f5f8257486398c841ac6bd4eebe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.939190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9b2f5f8257486398c841ac6bd4eebe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:34.950012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:34.953203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:35.036849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f96f37cd-893c-46a2-8702-64d9a296470c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9b2f5f8257486398c841ac6bd4eebe'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:35.068798 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3073/6180] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:34 2022] DELETE /identity/v3/users/8f9b2f5f8257486398c841ac6bd4eebe => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:35.119745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a279e6-990b-4564-9c5b-b25e25f1305a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:35.266163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:35.267039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:35.268051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:35.269161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:35.271965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:35.312182 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:35.408031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:35.410524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:35.429931 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3108/6181] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:35.977051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db074-6458-453b-8b69-726306096402 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:35.977601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db074-6458-453b-8b69-726306096402 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:35.977687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943db074-6458-453b-8b69-726306096402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:35.989436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:35.989848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.014424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-943db074-6458-453b-8b69-726306096402 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:36.015740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-943db074-6458-453b-8b69-726306096402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.036092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3074/6182] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:44:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:36.048591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db074-6458-453b-8b69-726306096402 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:36.050224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-943db074-6458-453b-8b69-726306096402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.079451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943db074-6458-453b-8b69-726306096402 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:36.093737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:36.094385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.094672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.094950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.118198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:36.121254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:36.125380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b8b6a-2d7f-4506-849b-039dbe55ad35 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:36.132457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:36.133300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.133844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.148812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.148812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.149726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3075/6183] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:44:36.149726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:36.153947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.160558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:36.173511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:36.188880 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3109/6184] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:36.258194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cb08b-4717-48a4-a4cc-ab01de7f65ec service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:36.294309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:36.295109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.298360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.298360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] PATH_INFO: `/v3/projects/84fe0f3288a747f0ad173db414868fec` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.309325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fe0f3288a747f0ad173db414868fec)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:36.314386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:36.479792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fe0f3288a747f0ad173db414868fec', 'request_id': 'req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:36.487231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fe0f3288a747f0ad173db414868fec', 'request_id': 'req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:36.505963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:36.508602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.627018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fe0f3288a747f0ad173db414868fec', 'request_id': 'req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:36.651347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db471dbf-f872-469d-9eb1-c49595da0c81 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:36.670154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] The token cache is being invalidate because project 84fe0f3288a747f0ad173db414868fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:36.670154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:36.670154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:36.671099 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3076/6185] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:36 2022] DELETE /identity/v3/projects/84fe0f3288a747f0ad173db414868fec => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:36.685082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:36.687419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.721627 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:36.786580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:36.788982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.789272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.789617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.803744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.839534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:36.842004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaee11-439e-488f-b64c-2bd3ab512e5d service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:36.865871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3110/6186] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:36.869978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.870204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.870482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.906285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee2ae-0668-4c83-bdbb-d78e95f2e7a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:36.911511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:36.912159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:36.912483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:36.912987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] PATH_INFO: `/v3/users/284f9fd2bdaf4038bf08e77f16e71c08` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:36.916895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=284f9fd2bdaf4038bf08e77f16e71c08)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:36.918554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:36.942826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:36.944071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.966390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3111/6187] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:36.967255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:36.975028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:36.997686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925bf1-2fd2-4673-bd64-7b576f1ee617 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:37.005296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:37.006041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:37.006317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:37.006587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] PATH_INFO: `/v3/users/93d18cf1316742dab78a102a257608ae` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:37.007789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d18cf1316742dab78a102a257608ae)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:37.010149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:37.248595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284f9fd2bdaf4038bf08e77f16e71c08'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.252052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284f9fd2bdaf4038bf08e77f16e71c08'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.269644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284f9fd2bdaf4038bf08e77f16e71c08'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.278188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284f9fd2bdaf4038bf08e77f16e71c08'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.281424 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:37.306746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d18cf1316742dab78a102a257608ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.394511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a6d5a3a1-fe37-4fcb-9330-e790665600bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284f9fd2bdaf4038bf08e77f16e71c08'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.466940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3077/6188] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:36 2022] DELETE /identity/v3/users/284f9fd2bdaf4038bf08e77f16e71c08 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:37.469274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:37.470278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:37.474530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:37.511289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d18cf1316742dab78a102a257608ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.511920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d18cf1316742dab78a102a257608ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.531434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:37.537596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:37.544434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d18cf1316742dab78a102a257608ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.570553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7f1fb845-a664-48fb-8ba0-7415f86d562f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d18cf1316742dab78a102a257608ae'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:37.621980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3112/6189] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:36 2022] DELETE /identity/v3/users/93d18cf1316742dab78a102a257608ae => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:37.629286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:37.629286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:37.629286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:37.686963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:37.688609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:37.706157 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3078/6190] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:37.710380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:37.730237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad224ebd-0177-4375-9639-e96c251c379f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:37.856623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3113/6191] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:37.861176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:37.864498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:37.864498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:37.864498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:37.864498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:37.864498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:37.865047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:37.880367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3079/6192] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:37.887073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:37.887505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:37.888653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:37.903977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe476-5a19-4732-af60-7164be711bd8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:37.911148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:37.912778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:37.912778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:37.912778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:37.913451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:37.917735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.033030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756121-5c75-4706-b82f-db7baa4118f7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.040957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.045796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.046373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.046855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.063409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3080/6193] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:37 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:38.064418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.076072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.078923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.096323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3114/6194] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:38.215153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607646-75e6-4f02-9afa-65887f821fce admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.220535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.222017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:38.245268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.246489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.248256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.248952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.251132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.254920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.259867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92859cf9-4702-4504-9460-8ddb70e98acd service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.273460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.274778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.275248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.275534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] PATH_INFO: `/v3/projects/d206d5c4ea654a2194a77d71d27972e8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.279055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d206d5c4ea654a2194a77d71d27972e8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.281243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.285489 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:38.382948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3081/6195] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:38 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:38.386789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.420380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118096b7-14d7-4641-af07-898723ffed2d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.432308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.433066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.433932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.437244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.437244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.438133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.457512 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:38.467992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3082/6196] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:38.468484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.489124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd206d5c4ea654a2194a77d71d27972e8', 'request_id': 'req-b060b131-dead-48e4-b297-77056b3e0518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:38.492205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe3c3-0160-4678-a637-1b5688e5121b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.577478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd206d5c4ea654a2194a77d71d27972e8', 'request_id': 'req-b060b131-dead-48e4-b297-77056b3e0518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:38.588081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd206d5c4ea654a2194a77d71d27972e8', 'request_id': 'req-b060b131-dead-48e4-b297-77056b3e0518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:38.605932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.607329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.609197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.609389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.611227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.611617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.612859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] The token cache is being invalidate because project d206d5c4ea654a2194a77d71d27972e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:38.613367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:38.614185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b060b131-dead-48e4-b297-77056b3e0518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:38.632533 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3115/6197] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:38 2022] DELETE /identity/v3/projects/d206d5c4ea654a2194a77d71d27972e8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:38.635359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1012c-47f9-4647-914e-891a83bcf78b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.640004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1012c-47f9-4647-914e-891a83bcf78b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.640004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1012c-47f9-4647-914e-891a83bcf78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.651394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3083/6198] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:38.652423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.656422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:38.669434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-45b1012c-47f9-4647-914e-891a83bcf78b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:38.671353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-45b1012c-47f9-4647-914e-891a83bcf78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:38.676345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b19eb-45df-4d6e-98d2-a1eb2d492750 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.686470 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3116/6199] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:38.690362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.691054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.691375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.691757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] PATH_INFO: `/v3/projects/27ee9bbb83e44fa3b4012522cd36ee07/users/6f3336a4dad2418daff5038eaec334dc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.694229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.695026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.695837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.736517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ee9bbb83e44fa3b4012522cd36ee07, user_id=6f3336a4dad2418daff5038eaec334dc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.739363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506f72a-7d39-4f5c-a3a1-e06e85e53c46 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.746720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:38.751574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:38.768654 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3117/6200] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:38.772845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.794304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b76b7f-2b49-422a-8452-87f1206689b1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.809061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:38.810091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.810555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.811005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.811835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:38.812324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:38.814843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:38.844631 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3118/6201] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:38.848565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:38.854838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3084/6202] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:38 2022] PUT /identity/v3/projects/27ee9bbb83e44fa3b4012522cd36ee07/users/6f3336a4dad2418daff5038eaec334dc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:38.865437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:38.865803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:38.866149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:38.868081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938d68d-f888-40ab-b96c-2fe63935dd7f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:38.937105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] MFA Rules not processed for user `6f3336a4dad2418daff5038eaec334dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:38.937105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.010646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.015950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.016328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.018782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.018782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.022135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.074224 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3085/6203] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:39.075225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.078672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.094927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc966b-4715-44d1-8098-cc8b292df8f1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.100775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.101595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.101882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.102160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] PATH_INFO: `/v3/projects/3553c4d17a1c4b2899c53f6ee12f67b6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.103384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3553c4d17a1c4b2899c53f6ee12f67b6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.105490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.148520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3119/6204] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:38 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:39.149506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.233574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b19997-e0cc-491e-98eb-6ba9d8f8c19b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.242225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.243269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.244994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.245465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.246813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.249440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.284664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3553c4d17a1c4b2899c53f6ee12f67b6', 'request_id': 'req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:39.292057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3553c4d17a1c4b2899c53f6ee12f67b6', 'request_id': 'req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:39.388709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3553c4d17a1c4b2899c53f6ee12f67b6', 'request_id': 'req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:39.390830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3120/6205] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:39.396792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.413000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] The token cache is being invalidate because project 3553c4d17a1c4b2899c53f6ee12f67b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:39.413543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:39.414396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:39.416991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3086/6206] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:39 2022] DELETE /identity/v3/projects/3553c4d17a1c4b2899c53f6ee12f67b6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:39.417977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.421805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.511324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ddf69-5ffe-45ae-ac31-1a5bb3078a34 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.545351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd8e5-9d05-4e52-bc61-541e0b380555 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.557089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.558117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.558401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.558812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.560865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.564287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3c1c3-9d99-4fee-bfd6-ddc6059cd882 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.594145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.594763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.595034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.595306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.596045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.597993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.669406 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3121/6207] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:39.669406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.669406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.670464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.717182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:39.721538 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:39.724268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.738101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3087/6208] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/users => generated 299 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:39.738101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.741909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.743276 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3122/6209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:39.744327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.765594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33b129-10a9-4b46-9425-9419583ed26e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.775470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.777042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.777547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.777986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.778753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.780624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9ee8-71ed-4bbd-aa24-faf124019cdc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.781506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e62cd-1d42-4f81-b46e-698456d60bdd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.797055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.802649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.802887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.803222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.804296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.807394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.824751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3123/6210] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:39.829142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.829462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.829867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.838763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3088/6211] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:39.839069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.854938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:39.855390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52741-1c59-4ec9-8bf2-f2aa828110a9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.856273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:39.862388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.863380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.863862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.864340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] PATH_INFO: `/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e/users/2a8a0d4f8b4c4235a578c3736ca3f78b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.866921 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3124/6212] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:39.867826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.887888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfa68e-118c-4883-8198-9f249394fcfa None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.889524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4226ac49ff4a85b44ac284d6427b8e, user_id=2a8a0d4f8b4c4235a578c3736ca3f78b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.892804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.901007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.901914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.902354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.902916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.903904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.906023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.918321 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:39.922895 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3125/6213] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:39.922895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.935414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ce0e0-b184-496d-9cb2-c19db9526bc0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.940469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:39.941080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:39.941387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:39.941663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:39.942313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:39.942752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:39.944368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:39.956801 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3126/6214] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:39.957651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:39.968282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08b14d-5797-4733-8736-54770d391eb3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:39.979922 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3089/6215] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:39 2022] PUT /identity/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e/users/2a8a0d4f8b4c4235a578c3736ca3f78b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:39.980768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.053799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.054774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.055061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.055341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] PATH_INFO: `/v3/projects/311cde01e89442f1ab3aa930070b7343/users/dcb021152c684983b31e5db439518921/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.076533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311cde01e89442f1ab3aa930070b7343, user_id=dcb021152c684983b31e5db439518921, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.079864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70526b49-3ba1-4a09-86d9-29ac291bbed6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.080414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.085885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.086878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.087898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.088358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.089151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.091089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614b855-62a0-4abd-94e1-b71ff0b70153 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.163841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3127/6216] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:39 2022] PUT /identity/v3/projects/311cde01e89442f1ab3aa930070b7343/users/dcb021152c684983b31e5db439518921/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:40.169712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.190461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3090/6217] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:39 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:40.195013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.195307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.195580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.217783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:40.218842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:40.247159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8110d5-6d9e-4e7a-a2f7-78d735208a80 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.293594 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3091/6218] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:40.294157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.312093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e280-de42-4ac6-b5ac-d107540a2c1d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.318942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.319640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.319922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.320216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.320913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.323504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.328053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.333856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.333856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.333856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.333856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.333856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.343057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3128/6219] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:40.344123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.345868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:40.404931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb81d1-e128-4255-aa51-2fd363327902 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.412613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.412613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.412613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.412613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.421158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.422654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.438426 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3129/6220] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:40.443779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.444407 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3092/6221] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:40 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:40.453848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.455695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b605-5cc4-4a55-a311-e2bd4a94317b service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.463061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.463860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.464212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.464554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] PATH_INFO: `/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e/users/2a8a0d4f8b4c4235a578c3736ca3f78b/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.468206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4226ac49ff4a85b44ac284d6427b8e, user_id=2a8a0d4f8b4c4235a578c3736ca3f78b, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.478476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.486152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77906bc8-236a-4c0e-858e-e5f2b366724d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.500611 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3130/6222] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:40 2022] PUT /identity/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e/users/2a8a0d4f8b4c4235a578c3736ca3f78b/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:40.500611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.505926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:40.629509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ac7fd-57b3-482d-9ad0-b6680831cff2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.636807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.637577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.638208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.638575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] PATH_INFO: `/v3/users/f7e0dceb70ee44978260397d3c196dc2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.640044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e0dceb70ee44978260397d3c196dc2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.642447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.647336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.647960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.648246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.648527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.653531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.655354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efbc0d-e3a4-4324-b973-b840b19733c6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.676460 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3093/6223] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:40.677969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.678263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.678564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.726445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] MFA Rules not processed for user `2a8a0d4f8b4c4235a578c3736ca3f78b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:40.727735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:40.825194 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3094/6224] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:40.829970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.841888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba6975-fb26-40c8-afff-ff97f5e2661f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.855137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.862319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.864168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.864503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.865092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:40.867211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:40.877488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e0dceb70ee44978260397d3c196dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:40.893752 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3095/6225] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:40.893752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:40.893752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:40.968729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57552848-36ad-4728-a894-133a4e2681c8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:40.972627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e0dceb70ee44978260397d3c196dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:40.973251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e0dceb70ee44978260397d3c196dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:40.981589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:40.982232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:40.982764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:40.983039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:40.986902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.006183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e0dceb70ee44978260397d3c196dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.033662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:41.035425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e0dceb70ee44978260397d3c196dc2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.036810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9f224-246c-422b-9d8a-5be7b4b20320 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:41.051718 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:41.053038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3131/6226] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:40 2022] DELETE /identity/v3/users/f7e0dceb70ee44978260397d3c196dc2 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:41.057129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:41.059981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.067085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3096/6227] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:41.068453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.068734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.069018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.195406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:41.197870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.296594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4a633-261b-4b8a-a39e-5f3298734d66 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:41.303571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:41.304248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.304534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.304811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] PATH_INFO: `/v3/projects/f9a73686866f4f32aa64f8941c7fdea7/users/dd93b694337541ef85b62946ea5099ee/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.326681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a73686866f4f32aa64f8941c7fdea7, user_id=dd93b694337541ef85b62946ea5099ee, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:41.329433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:41.335548 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3097/6228] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:41.336417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:41.338762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.356470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aee68-66e0-4848-a4b3-44a0494e36b2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:41.361964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:41.362823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.363195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.363590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] PATH_INFO: `/v3/users/6f3336a4dad2418daff5038eaec334dc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.364963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3336a4dad2418daff5038eaec334dc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:41.367163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:41.410315 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3132/6229] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:41 2022] PUT /identity/v3/projects/f9a73686866f4f32aa64f8941c7fdea7/users/dd93b694337541ef85b62946ea5099ee/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:41.411228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:41.412936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.500940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3507cb-f68f-4640-a9d8-ad2e204bb65d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:41.505466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:41.506319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.506719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.507107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.534460 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:41.610627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:41.612083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ca197-68f8-4f9f-8bbd-3438dca82936 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:41.619033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3336a4dad2418daff5038eaec334dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.620294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3336a4dad2418daff5038eaec334dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.634554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3336a4dad2418daff5038eaec334dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.634922 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3133/6230] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:41.635466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3336a4dad2418daff5038eaec334dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.636233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.636517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.638683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.704862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] MFA Rules not processed for user `dd93b694337541ef85b62946ea5099ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:41.707548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.741284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b6211a3c-2968-4838-ac0e-e2720facce36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3336a4dad2418daff5038eaec334dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:41.775948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3098/6231] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:41 2022] DELETE /identity/v3/users/6f3336a4dad2418daff5038eaec334dc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:41.779982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:41.780514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:41.780895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:41.807086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:41.808889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.844949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3134/6232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:41.860417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:41.862496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.918890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3099/6233] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:41.929728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:41.931376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:41.961826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6d6a-6b1c-484c-9269-04ed94713615 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.006743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bd6d5-675a-4efa-92b3-c9bb21e2fbc4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.011836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.012491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.012783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.013680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.015366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.015991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.016275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.016550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.024064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.026149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.037068 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3100/6234] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:42.043325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:42.045491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.068428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64060-cb82-455a-af59-6bea13278536 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.081708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.082488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.082841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.083388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] PATH_INFO: `/v3/projects/c1735a8d4dc541c7993bcf8a4f34dda8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.086159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1735a8d4dc541c7993bcf8a4f34dda8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.089944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.136841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.139318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.156449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3135/6235] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:42.158383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:42.159854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.178789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d706d8-7d10-493e-8f1a-a3addcf94516 service glance] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.185873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.186637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.187305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.187448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] PATH_INFO: `/v3/users/23ccf9b5810f4c1a8d95e70e15624a43` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.188991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ccf9b5810f4c1a8d95e70e15624a43)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.192583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.274605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'request_id': 'req-b8ddb806-5799-4b8a-b186-b442610e0c39'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.290291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'request_id': 'req-b8ddb806-5799-4b8a-b186-b442610e0c39'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.382894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1735a8d4dc541c7993bcf8a4f34dda8', 'request_id': 'req-b8ddb806-5799-4b8a-b186-b442610e0c39'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.400957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] The token cache is being invalidate because project c1735a8d4dc541c7993bcf8a4f34dda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:42.401310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.402275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.408728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3101/6236] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:42 2022] DELETE /identity/v3/projects/c1735a8d4dc541c7993bcf8a4f34dda8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:42.411108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:42.412842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.450131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ccf9b5810f4c1a8d95e70e15624a43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.495414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb806-5799-4b8a-b186-b442610e0c39 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.501029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.501700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.501986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.502262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] PATH_INFO: `/v3/users/dd93b694337541ef85b62946ea5099ee` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.503429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd93b694337541ef85b62946ea5099ee)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.505398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.560029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ccf9b5810f4c1a8d95e70e15624a43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.560651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ccf9b5810f4c1a8d95e70e15624a43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.578877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ccf9b5810f4c1a8d95e70e15624a43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.586818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-185326ca-3442-4257-848c-70fae9ec6d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ccf9b5810f4c1a8d95e70e15624a43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.590201 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:42.595281 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3136/6237] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:42 2022] DELETE /identity/v3/users/23ccf9b5810f4c1a8d95e70e15624a43 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:42.596496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f61e2-4721-4c45-83a4-7c810f9dfef5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.596787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f61e2-4721-4c45-83a4-7c810f9dfef5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.597090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f61e2-4721-4c45-83a4-7c810f9dfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.621652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b30f61e2-4721-4c45-83a4-7c810f9dfef5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:42.623369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b30f61e2-4721-4c45-83a4-7c810f9dfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.693609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3137/6238] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:42.695433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.695792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.696252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.715542 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:42.733965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:42.735205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.738089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd93b694337541ef85b62946ea5099ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.739024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd93b694337541ef85b62946ea5099ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.748240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd93b694337541ef85b62946ea5099ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.749070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd93b694337541ef85b62946ea5099ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.752445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3138/6239] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:42.753144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:42.754587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.766676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f0ff1-3adb-45a7-a68c-870de45ad2d6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.771413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.772087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.772374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.772661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] PATH_INFO: `/v3/projects/27ee9bbb83e44fa3b4012522cd36ee07` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.773828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ee9bbb83e44fa3b4012522cd36ee07)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.775761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.862458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd93b694337541ef85b62946ea5099ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.882277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ee9bbb83e44fa3b4012522cd36ee07', 'request_id': 'req-8f3bfd63-277e-46b9-90f4-13e573b96bc6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.888788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3102/6240] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:42 2022] DELETE /identity/v3/users/dd93b694337541ef85b62946ea5099ee => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:42.896769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:42.896769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:42.965493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ee9bbb83e44fa3b4012522cd36ee07', 'request_id': 'req-8f3bfd63-277e-46b9-90f4-13e573b96bc6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.972760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ee9bbb83e44fa3b4012522cd36ee07', 'request_id': 'req-8f3bfd63-277e-46b9-90f4-13e573b96bc6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.978675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b39c-8646-449a-9536-d82fb8c8cba9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:42.984934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:42.985711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.986195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.986337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] The token cache is being invalidate because project 27ee9bbb83e44fa3b4012522cd36ee07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:42.986521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.986646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:42.987266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8f3bfd63-277e-46b9-90f4-13e573b96bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:42.987438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:42.987834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:42.991755 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3139/6241] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:42 2022] DELETE /identity/v3/projects/27ee9bbb83e44fa3b4012522cd36ee07 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:42.991916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:42.992031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:42.992031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:42.992031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.005551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3103/6242] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:43.005551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.009169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.012392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:43.013635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.027786 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3140/6243] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:43.027970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438afcf-1238-4f9d-8899-751e6eac60bb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.028097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.028097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.030661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.031303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.031587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.031864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] PATH_INFO: `/v3/projects/15a1dab1c45d4be9946ec98786f36b5f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.033019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a1dab1c45d4be9946ec98786f36b5f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.035447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.041447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776113-3351-49d5-9815-8481d80f8f33 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.062847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.063498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.063843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.065308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] PATH_INFO: `/v3/users/2a8a0d4f8b4c4235a578c3736ca3f78b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.068365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8a0d4f8b4c4235a578c3736ca3f78b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.071634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.180698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a1dab1c45d4be9946ec98786f36b5f', 'request_id': 'req-e4c15965-cd0b-489e-a387-539f6d4a00bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.186878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a1dab1c45d4be9946ec98786f36b5f', 'request_id': 'req-e4c15965-cd0b-489e-a387-539f6d4a00bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.280132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a1dab1c45d4be9946ec98786f36b5f', 'request_id': 'req-e4c15965-cd0b-489e-a387-539f6d4a00bc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.297460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8a0d4f8b4c4235a578c3736ca3f78b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.298174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] The token cache is being invalidate because project 15a1dab1c45d4be9946ec98786f36b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:43.298581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.299364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.301582 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3104/6244] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:43 2022] DELETE /identity/v3/projects/15a1dab1c45d4be9946ec98786f36b5f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:43.302552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.304570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.370848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15965-cd0b-489e-a387-539f6d4a00bc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.376193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.376941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.377225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.379673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.379673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.380340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3121f0-dd7d-4031-90e7-5f808f1b22c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.399474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8a0d4f8b4c4235a578c3736ca3f78b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.400740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8a0d4f8b4c4235a578c3736ca3f78b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.413902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8a0d4f8b4c4235a578c3736ca3f78b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.420847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8a0d4f8b4c4235a578c3736ca3f78b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:43.427183 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3141/6245] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:43 2022] DELETE /identity/v3/users/2a8a0d4f8b4c4235a578c3736ca3f78b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:43.427989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.429442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.497274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f158-7a98-49e3-a61a-a8a10efc115b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.500966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.501754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.502105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.502446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.504292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.505180 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3105/6246] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:43.507392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1c11-c2ef-4f0a-8d77-538951823b75 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.508261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1c11-c2ef-4f0a-8d77-538951823b75 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.508556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d1c11-c2ef-4f0a-8d77-538951823b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.557911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c54d1c11-c2ef-4f0a-8d77-538951823b75 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:43.562915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c54d1c11-c2ef-4f0a-8d77-538951823b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.598605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.601518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.622618 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3142/6247] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:43.623698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.625210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.640539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c8f1-8e4b-4ea5-bdc3-f09d4a87fdbf service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.660579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3106/6248] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:43.668151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.668447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.668721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.714580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:43.714580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:43.721499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.723004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.723579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.724068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.724919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.727402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.736081 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3107/6249] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:43.740357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.751510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcab48-ba3b-47b7-b019-f2a7731db3bb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.763989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.764522 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:43.765310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.766041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.766553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.767858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:43.768383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.771904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.790930 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3108/6250] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:43.798312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.814001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c6728-a5a9-4013-b4ca-2eed61ad7051 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.831173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3143/6251] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:43.831793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.832537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.832908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.833245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.834084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.835275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.843158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.854235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afe83-ff4d-4e03-9841-12590319dada admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.871503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.872414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.872866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.873182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.874079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.886760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.906764 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3144/6252] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:43.911328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.927051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c401f84-2008-4220-ac76-53f8238f962a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:43.932364 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:43.936542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:43.940749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:43.940749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:43.940749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:43.940749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:43.942203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:43.955660 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3145/6253] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:43.969487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:43.996421 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3109/6254] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:44.000182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.003971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2aef7-6fd0-477f-9a6b-a52b6aaa2f8a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.110439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.111313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.116945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b07ed3-a27c-4c56-9b46-1a6d5028ea19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.128005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.130807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.130807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.131267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.133881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.134166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] PATH_INFO: `/v3/projects/b40ddceed16d4ddba4106f867affbeb0/users/b7ce9d9b570a40f09c12e13847dfcd7d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.134407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.136573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.175899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40ddceed16d4ddba4106f867affbeb0, user_id=b7ce9d9b570a40f09c12e13847dfcd7d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.184159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.271690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3110/6255] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:43 2022] POST /identity/v3/users => generated 282 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:44.271690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.272025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.288798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d97a5-8544-42d1-8848-529921eb5299 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.296064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.296748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.297071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.297393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] PATH_INFO: `/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.298478 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3146/6256] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:43 2022] PUT /identity/v3/projects/b40ddceed16d4ddba4106f867affbeb0/users/b7ce9d9b570a40f09c12e13847dfcd7d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:44.298914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4226ac49ff4a85b44ac284d6427b8e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.299573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.301439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.433815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9208ab9-149f-44fc-8c70-1216ec8e2400 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.448247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4226ac49ff4a85b44ac284d6427b8e', 'request_id': 'req-2b4744e3-5e93-4a9b-afbe-d735995b25dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.465621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4226ac49ff4a85b44ac284d6427b8e', 'request_id': 'req-2b4744e3-5e93-4a9b-afbe-d735995b25dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.514962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.516298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.516589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.516914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.519994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.538063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4226ac49ff4a85b44ac284d6427b8e', 'request_id': 'req-2b4744e3-5e93-4a9b-afbe-d735995b25dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.538600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.538600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.552005 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3147/6257] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:44.552891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.557822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] The token cache is being invalidate because project fd4226ac49ff4a85b44ac284d6427b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:44.558116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.560083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b4744e3-5e93-4a9b-afbe-d735995b25dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.566717 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3111/6258] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:44 2022] DELETE /identity/v3/projects/fd4226ac49ff4a85b44ac284d6427b8e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:44.568629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae60ce-0244-4d03-bbbc-75bee66d0c56 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.568921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae60ce-0244-4d03-bbbc-75bee66d0c56 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.569202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae60ce-0244-4d03-bbbc-75bee66d0c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.624620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5dae60ce-0244-4d03-bbbc-75bee66d0c56 None None] MFA Rules not processed for user `b7ce9d9b570a40f09c12e13847dfcd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:44.626692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5dae60ce-0244-4d03-bbbc-75bee66d0c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.627613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55686a-0961-4667-9a03-b04e3b2578fe service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.632346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.633924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.633924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.633924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.634426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.636529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.652061 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3148/6259] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:44.653167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.656461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.674679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68161809-c751-4f47-b1d0-4a243865c090 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.680176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.682280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.682280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.682280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] PATH_INFO: `/v3/projects/f9a73686866f4f32aa64f8941c7fdea7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.683025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a73686866f4f32aa64f8941c7fdea7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.684904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.718829 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3112/6260] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:44.720153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.720533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.720919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.742334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:44.743594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.752113 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3113/6261] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:44.752877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.754124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.766759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5b0ae-fc2c-4f44-8e88-65c9ac6fc189 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.771804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.772412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.772693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.772966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.773645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.776382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.787224 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3114/6262] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:44.787975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:44.789742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:44.823061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a73686866f4f32aa64f8941c7fdea7', 'request_id': 'req-949e12b2-977a-416e-9c23-93c916e9247b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.855156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce42b1-d82c-4ed7-9f9d-359a3bd428bc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:44.908314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:44.909024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.909304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.909636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:44.931518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a73686866f4f32aa64f8941c7fdea7', 'request_id': 'req-949e12b2-977a-416e-9c23-93c916e9247b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.944887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a73686866f4f32aa64f8941c7fdea7', 'request_id': 'req-949e12b2-977a-416e-9c23-93c916e9247b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.971267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] The token cache is being invalidate because project f9a73686866f4f32aa64f8941c7fdea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:44.971995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.973758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e12b2-977a-416e-9c23-93c916e9247b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:44.975315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:44.976793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:44.978803 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3149/6263] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:44 2022] DELETE /identity/v3/projects/f9a73686866f4f32aa64f8941c7fdea7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:44.982732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907526-0755-46c8-a230-6269cb39fefc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:44.982732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907526-0755-46c8-a230-6269cb39fefc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:44.982732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86907526-0755-46c8-a230-6269cb39fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.012650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-86907526-0755-46c8-a230-6269cb39fefc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:45.015215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86907526-0755-46c8-a230-6269cb39fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:45.015517 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3115/6264] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:45.017281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.120991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb516ab-52c6-44f2-9616-8487f07bf699 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.131623 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:45.134405 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3150/6265] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:45.136163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.136509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.136834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.141279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.142189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.143907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.143907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081/users/0e82bdb5a67f4d05bd624c1bb23753a8/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.160970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:45.162321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fd00b0e9164b20a6255be322056081, user_id=0e82bdb5a67f4d05bd624c1bb23753a8, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.162747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:45.170228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.178981 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3151/6266] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:45.180116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.195776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1655-da81-44fd-b3a5-16cb639e6478 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.201520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.202461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.202839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.203207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.204102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:45.204498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.206232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc1185-aea1-464e-9454-802b2c31c7bc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.224591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3152/6267] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:45.224591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579066c-903c-4593-96de-3f8f43d95178 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.224591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579066c-903c-4593-96de-3f8f43d95178 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.224591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579066c-903c-4593-96de-3f8f43d95178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.269590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f579066c-903c-4593-96de-3f8f43d95178 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:45.272899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f579066c-903c-4593-96de-3f8f43d95178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:45.276181 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3116/6268] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:45 2022] PUT /identity/v3/projects/31fd00b0e9164b20a6255be322056081/users/0e82bdb5a67f4d05bd624c1bb23753a8/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:45.277315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.390815 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3153/6269] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:45.392371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.392819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.393312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.405433 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:45.429922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] MFA Rules not processed for user `0e82bdb5a67f4d05bd624c1bb23753a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:45.431741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:45.461674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8958b-e55a-4b87-931c-f6350a914347 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.466915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.473043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.473043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.473043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.473043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.473043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.520725 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3154/6270] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:45.521802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.551890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0aa0e3-7d0f-4448-8ee1-9fc5c0b35fed None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.562809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.570370 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3117/6271] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/projects => generated 383 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:45.570370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.570969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.570969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.570969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.570969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:45.571353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.573406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.574388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:45.594789 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3155/6272] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:45.595909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.618944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2b79d-9c0b-4e8e-b275-f420b085c8fe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.708042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81db2-d346-4a34-9f7a-1718a76a3d4a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.717846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.718843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.719296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.719770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.759626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.760255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.760531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.761240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.761541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.765023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb57436-5553-4993-862a-8a33409696bc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.850418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.852016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.862758 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3118/6273] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:45.863410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.874773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a95ab-e1c7-4698-8445-60e04034095f service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.883069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.883838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.884191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.885115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.885960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.888756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.904166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3156/6274] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:45.905858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abb26-7797-4d27-b2ac-317e7db63805 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.906489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abb26-7797-4d27-b2ac-317e7db63805 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.906949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896abb26-7797-4d27-b2ac-317e7db63805 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.909027 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3157/6275] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:44:45.909981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896abb26-7797-4d27-b2ac-317e7db63805 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:45.925569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896abb26-7797-4d27-b2ac-317e7db63805 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:45.930904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:45.931595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:45.931947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:45.932286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:45.933009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:45.934844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:45.966161 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3158/6276] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:45.967444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:44:46.007272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.022447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c8e7-9151-4d9c-972f-1157008e9ade admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.029537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e82bdb5a67f4d05bd624c1bb23753a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31fd00b0e9164b20a6255be322056081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.030461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.030813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.031196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.032707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorizing `identity:get_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.034591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.036575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3159/6277] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:44:45 2022] GET /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 363 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:46.037433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.053132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3119/6278] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:45 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:46.058573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.068703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8105b1-cc49-4274-a594-648f8820ac09 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.161196 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:46.170037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed61a08-0987-4d1e-b4a3-7d29e80a3d31 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.177207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.178832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.179306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.179741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.180886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.182105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.182855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.184011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.184144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.184512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.186605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.190189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912dd05-27d1-44fd-ba78-e2ff846bdeb2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.207012 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3160/6279] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:46.208749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b952-9206-4d1b-ad7d-2d61473663e5 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.209053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b952-9206-4d1b-ad7d-2d61473663e5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.209456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b952-9206-4d1b-ad7d-2d61473663e5 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.214298 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3161/6280] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:44:46.217526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9b952-9206-4d1b-ad7d-2d61473663e5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.234553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9b952-9206-4d1b-ad7d-2d61473663e5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.238786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.239439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.239766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.242464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] PATH_INFO: `/v3/projects/951f81d582af4c7496d35c48e1f3d03a/users/4abb18bde22f4c8dabaa4edf6f0cd75d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.256043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951f81d582af4c7496d35c48e1f3d03a, user_id=4abb18bde22f4c8dabaa4edf6f0cd75d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.259228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.302415 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3120/6281] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:46 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:46.303351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:44:46.304938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:46.343914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3162/6282] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:46 2022] PUT /identity/v3/projects/951f81d582af4c7496d35c48e1f3d03a/users/4abb18bde22f4c8dabaa4edf6f0cd75d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:46.345540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.392268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.428701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f23cbd-d235-4b12-8d7a-f83de56fc3a5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.458661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77464e6f-49d7-4789-8942-6c9b6617609a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.458819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.458819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.458819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.458819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.459403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.461346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e43542-4009-47c3-9b36-1f5191af378c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.472905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3163/6283] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:46.474300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.474729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.475004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.520486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] MFA Rules not processed for user `4abb18bde22f4c8dabaa4edf6f0cd75d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:46.521760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:46.545670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e82bdb5a67f4d05bd624c1bb23753a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31fd00b0e9164b20a6255be322056081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.546376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.546667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.547065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.548200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorizing `identity:get_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.550080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.557163 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3121/6284] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 363 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:46.558815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.599768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b78b5-e264-460c-9f07-176a8869bb16 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.611249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.612886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.615802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.616366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.617251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.624145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbead2-2729-4bcb-b354-f60f565bec16 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.661071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3122/6285] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:46.661071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283ebb-52ca-422a-981a-2c6e0dbfee9e None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.661315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283ebb-52ca-422a-981a-2c6e0dbfee9e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.661666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7283ebb-52ca-422a-981a-2c6e0dbfee9e None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.664550 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3123/6286] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:44:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:44:46.665514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7283ebb-52ca-422a-981a-2c6e0dbfee9e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.689934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7283ebb-52ca-422a-981a-2c6e0dbfee9e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.699915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.701266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.701266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.701504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] PATH_INFO: `/v3/projects/5c4149bf130a43ca9528b76fad1e2448/users/e8be0141e84d4884a265323642c1c025/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.723790 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3164/6287] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:46.724913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:44:46.734153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4149bf130a43ca9528b76fad1e2448, user_id=e8be0141e84d4884a265323642c1c025, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.736902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.822593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.831099 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3124/6288] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:46 2022] PUT /identity/v3/projects/5c4149bf130a43ca9528b76fad1e2448/users/e8be0141e84d4884a265323642c1c025/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:46.832051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:46.833748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:46.836969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1264f-fcc6-4259-8fe7-8e4588a5a2c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.987475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e82bdb5a67f4d05bd624c1bb23753a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31fd00b0e9164b20a6255be322056081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:46.988386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.988386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.988632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:46.989631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorizing `identity:get_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:46.990699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77129a89-b783-42fe-800e-2b30f165f3d7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:46.991777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f26de-9f57-416e-8d32-e685e495cd97 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:46.994007 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3165/6289] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 363 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:46.995175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:46.995520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:46.995796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.003474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.004098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.004375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.004646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.045628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] MFA Rules not processed for user `e8be0141e84d4884a265323642c1c025`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:47.047137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:47.054768 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:47.133835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.135383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84696b5-5652-4ba6-9add-071b82c43822 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.145774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3125/6290] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:47.147372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.147969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.148424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.150238 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3126/6291] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:44:47.159643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:44:47.210871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3166/6292] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:47.215791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.287800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.301102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2a789-804b-4ee5-831f-13c21ec4befb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.307286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e82bdb5a67f4d05bd624c1bb23753a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31fd00b0e9164b20a6255be322056081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.308224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.308604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.308961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.310394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorizing `identity:get_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.312452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.315407 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3127/6293] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:44:47 2022] GET /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 363 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:47.316499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.326396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:47.331110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671691ae-3e0e-42c7-acf1-97fa43e82fa2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.344222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.344874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.345148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.345442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] PATH_INFO: `/v3/users/4abb18bde22f4c8dabaa4edf6f0cd75d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.354181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abb18bde22f4c8dabaa4edf6f0cd75d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.358020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.427442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd49d2-42ae-4768-8280-104722404c63 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.433125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.434175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.434853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.435310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.449119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.451131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed3798-c224-44e5-8c23-086423fe771a service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.463680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3128/6294] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:47.465577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.465865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.466141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.468654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3129/6295] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 01:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:44:47.478200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] Authenticating service token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 01:44:47.520569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.548203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4969e5c-e16f-4804-ad1f-bf8a12fee4c1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.560259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e82bdb5a67f4d05bd624c1bb23753a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31fd00b0e9164b20a6255be322056081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.561095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.561408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.561688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.567885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorizing `identity:get_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.569750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.573648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3130/6296] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 01:44:47 2022] GET /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 363 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:47.625756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.629531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:47.647576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e7c2c-5b09-45ad-bdbb-cb58b4a160c2 tempest-QuotasTestJSON-356474143 tempest-QuotasTestJSON-356474143-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.651765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abb18bde22f4c8dabaa4edf6f0cd75d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.655262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.656151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.656607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.657037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] PATH_INFO: `/v3/users/0e82bdb5a67f4d05bd624c1bb23753a8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.658444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e82bdb5a67f4d05bd624c1bb23753a8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:47.661031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:47.733535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abb18bde22f4c8dabaa4edf6f0cd75d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.734533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abb18bde22f4c8dabaa4edf6f0cd75d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.761802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abb18bde22f4c8dabaa4edf6f0cd75d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.773987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d84c8a8-e055-4984-a340-c598ea42c908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abb18bde22f4c8dabaa4edf6f0cd75d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.780912 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3167/6297] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:47 2022] DELETE /identity/v3/users/4abb18bde22f4c8dabaa4edf6f0cd75d => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:47.785652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.786012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.786358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.806838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:47.808037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:47.876819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3168/6298] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:47.901986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:47.905930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:47.920467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e82bdb5a67f4d05bd624c1bb23753a8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.921575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e82bdb5a67f4d05bd624c1bb23753a8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.931778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e82bdb5a67f4d05bd624c1bb23753a8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.932694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e82bdb5a67f4d05bd624c1bb23753a8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:47.955062 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:47.983448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf367-f82b-4034-80e9-f37170c7b2e3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:47.986903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:47.987514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:47.987790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:47.988091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:47.989828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:48.002261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:48.003671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085f7fa-0d20-414b-9343-0d8c430935b5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:48.013894 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3169/6299] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:48.073381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e82bdb5a67f4d05bd624c1bb23753a8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:48.097111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3131/6300] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:47 2022] DELETE /identity/v3/users/0e82bdb5a67f4d05bd624c1bb23753a8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:48.102031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:48.102323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:48.102550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:48.162276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:48.174016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:48.308667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:48.310186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:48.325220 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3170/6301] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:48.409229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb9e3b-cfb1-4e94-925a-e5b4323af9e3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:48.412960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:48.413596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:48.413874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:48.414144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:48.427836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:48.430292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:48.451025 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3132/6302] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:48.594458 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:48.661366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:48.662910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:48.675326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c6cd-616b-4ec5-8a5e-7ab60a81bca2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:48.700717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:48.701440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:48.701892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:48.702210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] PATH_INFO: `/v3/users/e8be0141e84d4884a265323642c1c025` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:48.703977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8be0141e84d4884a265323642c1c025)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:48.705919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:48.951137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:48.952651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:48.966840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eda5b5-9e04-4de7-a83b-afc687fe0523 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:48.975154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:48.975805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:48.976089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:48.976369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] PATH_INFO: `/v3/projects/951f81d582af4c7496d35c48e1f3d03a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:48.980043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951f81d582af4c7496d35c48e1f3d03a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.000490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8be0141e84d4884a265323642c1c025'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.007299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.079950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8be0141e84d4884a265323642c1c025'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.080730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8be0141e84d4884a265323642c1c025'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.099055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8be0141e84d4884a265323642c1c025'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.110342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a95911-1508-4f30-94b0-5599c58c5f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8be0141e84d4884a265323642c1c025'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.118098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3171/6303] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:48 2022] DELETE /identity/v3/users/e8be0141e84d4884a265323642c1c025 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:49.122294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.122647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.123020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.147896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:49.149859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.166700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951f81d582af4c7496d35c48e1f3d03a', 'request_id': 'req-0905c28d-ce03-473d-bfff-e4b0e4243b23'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.178296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951f81d582af4c7496d35c48e1f3d03a', 'request_id': 'req-0905c28d-ce03-473d-bfff-e4b0e4243b23'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.256563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951f81d582af4c7496d35c48e1f3d03a', 'request_id': 'req-0905c28d-ce03-473d-bfff-e4b0e4243b23'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.277808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] The token cache is being invalidate because project 951f81d582af4c7496d35c48e1f3d03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:49.278203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.279720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0905c28d-ce03-473d-bfff-e4b0e4243b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.290008 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3133/6304] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:48 2022] DELETE /identity/v3/projects/951f81d582af4c7496d35c48e1f3d03a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:49.293398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56fae7-cff9-4be4-870b-ddfdb2b14588 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.293722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56fae7-cff9-4be4-870b-ddfdb2b14588 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.294025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56fae7-cff9-4be4-870b-ddfdb2b14588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.302911 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3172/6305] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:49.314671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.316097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.343868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ec56fae7-cff9-4be4-870b-ddfdb2b14588 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:49.347135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ec56fae7-cff9-4be4-870b-ddfdb2b14588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.364296 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3134/6306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:49.366034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002994ed-10f8-422f-94d7-f541c201089e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.366472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002994ed-10f8-422f-94d7-f541c201089e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.366912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002994ed-10f8-422f-94d7-f541c201089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.407545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-002994ed-10f8-422f-94d7-f541c201089e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:49.409471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-002994ed-10f8-422f-94d7-f541c201089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.431874 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3135/6307] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:49.433411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002994ed-10f8-422f-94d7-f541c201089e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.444266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002994ed-10f8-422f-94d7-f541c201089e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:49.450689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:49.451571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.452007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.452428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.453313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:49.453826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.455697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.480218 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3136/6308] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:49.481173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.482131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e491a-3fe5-4f78-841b-a307d6e1316e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:49.492704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:49.492704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.492704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.492704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.496638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da8ee0-4feb-44f3-b9c1-ae9b0089de41 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:49.502551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:49.511696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.511696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.511696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.511696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.511696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.523436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.525562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.548917 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3173/6309] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:49.550556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.552232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.574477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef995-6b7d-4f84-9b1c-dad8540930f6 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:49.591048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:49.592428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.592908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.593372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] PATH_INFO: `/v3/projects/31fd00b0e9164b20a6255be322056081` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.594850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fd00b0e9164b20a6255be322056081)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.597322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.621640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3137/6310] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:49.622943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.728885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f6a9-d895-4b82-abfb-e5906de4cee0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:49.734349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:49.734983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.735254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.735530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.736167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:49.738290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8560c06-3684-4457-b518-47b77ae384c4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:49.772116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fd00b0e9164b20a6255be322056081', 'request_id': 'req-3948336f-26ed-455b-9a3e-d4232de7407d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.777849 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:49.865835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fd00b0e9164b20a6255be322056081', 'request_id': 'req-3948336f-26ed-455b-9a3e-d4232de7407d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.880875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fd00b0e9164b20a6255be322056081', 'request_id': 'req-3948336f-26ed-455b-9a3e-d4232de7407d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.882214 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3138/6311] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:49.884220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e248bb-7530-43b9-950c-62cdede9b8bc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:49.884505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e248bb-7530-43b9-950c-62cdede9b8bc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:49.885738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e248bb-7530-43b9-950c-62cdede9b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:49.905985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] The token cache is being invalidate because project 31fd00b0e9164b20a6255be322056081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:49.906277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.908399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:49.911120 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3174/6312] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:49 2022] DELETE /identity/v3/projects/31fd00b0e9164b20a6255be322056081 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:49.929989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:49.940258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:49.962578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-94e248bb-7530-43b9-950c-62cdede9b8bc None None] MFA Rules not processed for user `dcb021152c684983b31e5db439518921`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:49.971842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94e248bb-7530-43b9-950c-62cdede9b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.048324 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3139/6313] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.050016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.050693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.051284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.095628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:50.097023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.116798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948336f-26ed-455b-9a3e-d4232de7407d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.121954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.122579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.123045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.123391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.124112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.126015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.143532 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3175/6314] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:50.144467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.146264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.187871 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3140/6315] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.189064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.202055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7620a52-e110-4ee7-b199-b594aee6939d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.213036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.213594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.213875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.214146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.214923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.217271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.231987 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3141/6316] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:50.231987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.234397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.252203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c43d-3022-407f-8ac4-f46af57fea69 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.257631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.258276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.258618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.258995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] PATH_INFO: `/v3/projects/5c4149bf130a43ca9528b76fad1e2448` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.260032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4149bf130a43ca9528b76fad1e2448)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.262122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.263652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437c9e4-2d2c-4523-9106-dd6126562d22 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.269450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.270117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.270397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.270664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.279133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.280714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13033a76-2b3a-47e5-ad11-ffb9618709ec service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.292277 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3176/6317] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:50.293742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.294031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.294343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.317748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:50.319082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.331971 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3177/6318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.331971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.342736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ff953-5801-4a90-a8cc-12546a0cb084 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.348211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.348898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.349176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.349472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] PATH_INFO: `/v3/projects/b9f09e011fe04399af31005dc1077d9f/users/04422cc4b49f45e5ab1ea670e7be1db3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.368122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f09e011fe04399af31005dc1077d9f, user_id=04422cc4b49f45e5ab1ea670e7be1db3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.368746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.379299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4149bf130a43ca9528b76fad1e2448', 'request_id': 'req-dc1b8a7b-1152-4ed2-908e-c01af754c9de'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:50.385067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4149bf130a43ca9528b76fad1e2448', 'request_id': 'req-dc1b8a7b-1152-4ed2-908e-c01af754c9de'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:50.468771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4149bf130a43ca9528b76fad1e2448', 'request_id': 'req-dc1b8a7b-1152-4ed2-908e-c01af754c9de'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:50.491294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3178/6319] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:50 2022] PUT /identity/v3/projects/b9f09e011fe04399af31005dc1077d9f/users/04422cc4b49f45e5ab1ea670e7be1db3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:50.492449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] The token cache is being invalidate because project 5c4149bf130a43ca9528b76fad1e2448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:50.492586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.492714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:50.494750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dc1b8a7b-1152-4ed2-908e-c01af754c9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:50.500557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3142/6320] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:50 2022] DELETE /identity/v3/projects/5c4149bf130a43ca9528b76fad1e2448 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:50.501897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.502268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.502616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.532221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:50.533866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.594393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed6536-cb3f-4b65-a5bb-3107d1fdb199 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.600837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.601487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.601770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.603558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.604249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:50.604599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.606299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8bde0-66eb-4320-84dd-864f105ff962 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.606786 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:50.630031 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3179/6321] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:50.630031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a580-2bdc-4140-86c0-696fdeaca90d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.630031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a580-2bdc-4140-86c0-696fdeaca90d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.630031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a580-2bdc-4140-86c0-696fdeaca90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.631515 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3143/6322] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.632677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.634520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.664259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88b84-006c-416b-95e4-88e702a03f26 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.665578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ff40a580-2bdc-4140-86c0-696fdeaca90d None None] MFA Rules not processed for user `04422cc4b49f45e5ab1ea670e7be1db3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:50.667147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff40a580-2bdc-4140-86c0-696fdeaca90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.670642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.671500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.672026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.672730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.673812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.676912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.751493 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3180/6323] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.752894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.753180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.753496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.773597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:50.775417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.783881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3181/6324] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:50.784756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.786086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:50.796717 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3144/6325] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:50.797972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:50.803248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737b936-f411-42f1-9ac3-41c2a68e903c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.886941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.887768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.888018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.888359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.889900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.892088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.905144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a891-a3ea-47be-8b05-d383dff9b327 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:50.934124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:50.934791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:50.935046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:50.935329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:50.939031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:50.940099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:50.945258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:50.966680 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:50.999712 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3145/6326] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:51.001172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.032089 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3182/6327] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:51.036684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.051393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693797e4-41c5-4f8b-9ed5-8731df12fcca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.121556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64261613-a048-4ac8-8966-48a04ef48f7d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.124906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.125849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.126135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.126411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.127045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.129039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.130088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.132169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.132742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.132957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.133593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.135592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.283791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3146/6328] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:50 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:51.283791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.290282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3183/6329] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:51 2022] POST /identity/v3/projects => generated 357 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:51.290282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.298701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb584f-200c-42e7-9f55-e18429443e0d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.388075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd2c00-5c85-42da-943d-1f7edc0ff448 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.392825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.393411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.393744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.396706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.396941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.397041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.397122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.397122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.397386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.397468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.397557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.397634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.409932 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3184/6330] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.410984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.426153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb6f2c-a804-4969-ad3f-1071fa07906c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.431500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.432722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.432722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.433101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.433678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.435840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.508013 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3147/6331] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:51 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:51.509694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.519770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa541ba-c20e-4be7-bd49-5180e40d5e87 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.525652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.526278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.526554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.526849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.527491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.529102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.546058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3148/6332] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.547767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.550713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3185/6333] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:51 2022] POST /identity/v3/users => generated 279 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:51.551772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.562480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee068-b615-4b9e-8291-b66d4e6b425f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.565606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38abf-48d8-4b3b-b827-c1ead12c716a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.570195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.571872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.572655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.573504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.574496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.576855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.577614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.578358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.578730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.579108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] PATH_INFO: `/v3/projects/85ce2329fe754ca6930ba693bb02ae2e/users/3ac3815c7b7744508bddf2559c7c7fe9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.598354 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3149/6334] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.598588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ce2329fe754ca6930ba693bb02ae2e, user_id=3ac3815c7b7744508bddf2559c7c7fe9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.598681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.602324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.612017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f38f9-714b-47f3-95f7-427becb469e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.618366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.618986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.619262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.619532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.620167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.621835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.632393 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3150/6335] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.633299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.643570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2b12b-31ed-4772-9531-e0ced31e23ad admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.648270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.650982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.650982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.650982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] PATH_INFO: `/v3/projects/b0634efc8bac43eb912a03b3ca1153a5/users/4d95c5bc5f774f41b63f9652a6afbf55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.662803 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:51.668134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0634efc8bac43eb912a03b3ca1153a5, user_id=4d95c5bc5f774f41b63f9652a6afbf55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.670891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc474-450c-4278-b080-a70b9e320e64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.701182 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3186/6336] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:51 2022] PUT /identity/v3/projects/85ce2329fe754ca6930ba693bb02ae2e/users/3ac3815c7b7744508bddf2559c7c7fe9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:51.702053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.754756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3151/6337] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:51 2022] PUT /identity/v3/projects/b0634efc8bac43eb912a03b3ca1153a5/users/4d95c5bc5f774f41b63f9652a6afbf55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:51.756019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.756305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.756579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.776438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda72b2-5263-419b-aa00-3ac06adf1b9c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.777710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:51.779813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:51.846120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.846738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.847017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.847305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.847960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.851614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.858607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3152/6338] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:51.863082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.867066 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3187/6339] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.868511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.875476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53974-88ac-4fee-919d-76e303057f1a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.879103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd037e-dc30-4f4f-a420-6eb1f570e3d9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.880527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.881246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.881661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.882183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.882963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.885473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.888491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.889386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.889670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.901476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] PATH_INFO: `/v3/projects/84d66d174b1b41329fffbb68649e154e/users/800653326aa743b485942aec01caa125/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.902250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3153/6340] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:51.902250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:51.904194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:51.914470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d66d174b1b41329fffbb68649e154e, user_id=800653326aa743b485942aec01caa125, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.917454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f9a12-895f-44e4-9f0a-6cbcf269f2d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.967506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424a164-83c8-49a4-acae-73ca3159a634 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:51.971916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:51.972243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:51.972630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:51.972968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:51.984046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:51.985801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:51.996964 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3154/6341] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:51.997932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.007507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffbe7d-19ab-4869-ab91-bd28a8c38c3a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.013297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.013883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.014153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.014405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] PATH_INFO: `/v3/projects/b0634efc8bac43eb912a03b3ca1153a5/users/4d95c5bc5f774f41b63f9652a6afbf55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.016621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0634efc8bac43eb912a03b3ca1153a5, user_id=4d95c5bc5f774f41b63f9652a6afbf55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.020949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215820-afde-4059-9d89-f4ed11d9007d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.031610 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3155/6342] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:51 2022] PUT /identity/v3/projects/b0634efc8bac43eb912a03b3ca1153a5/users/4d95c5bc5f774f41b63f9652a6afbf55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:52.039938 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:52.041800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.042160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.042499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.045447 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3188/6343] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:51 2022] PUT /identity/v3/projects/84d66d174b1b41329fffbb68649e154e/users/800653326aa743b485942aec01caa125/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:52.059306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.059684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.060017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.087507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] MFA Rules not processed for user `4d95c5bc5f774f41b63f9652a6afbf55`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:52.088909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:52.101643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] MFA Rules not processed for user `800653326aa743b485942aec01caa125`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:52.105542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:52.192376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3156/6344] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:52.206573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.208591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3189/6345] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:52.209005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:52.214429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.309082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206112b-6058-4a44-840e-9a5bdd4fef6d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.322908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.323715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.324122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.324498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.336134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af6ed9-4557-4ead-b782-770c240d6c25 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.342274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.342993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.343474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.343800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.344557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.346682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.413569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.415234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.425663 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3157/6346] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:52.471694 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3190/6347] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:52 2022] POST /identity/v3/projects => generated 357 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:52.476082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.488593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b746cc-8af7-4109-9f6d-d179dcfb49ae service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.588752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.588752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.588752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.588752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.589239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.589239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.686611 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:52.703270 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3158/6348] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:52 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:52.708063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.728082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f577bd1-297d-4d87-bb7b-60e92db000ee admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.733281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.734148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.734435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.734705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.735348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.736996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.750765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3191/6349] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:52.755195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.768384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e1dd-86d5-402e-ae72-43d43d254aa1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:52.774944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:52.776725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:52.776725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:52.776725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] PATH_INFO: `/v3/projects/bd403a7345704f7094dc8b912faec5e0/users/ae5adfdfdef049219e6f05c2e516e73e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:52.799879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd403a7345704f7094dc8b912faec5e0, user_id=ae5adfdfdef049219e6f05c2e516e73e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:52.803189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:52.925394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3159/6350] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:52 2022] PUT /identity/v3/projects/bd403a7345704f7094dc8b912faec5e0/users/ae5adfdfdef049219e6f05c2e516e73e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:52.929037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:52.945357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245fa19-7b6a-4ea4-82ab-214bf62a10d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.015855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.016586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.017262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.017262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.017984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.020884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f292-d5d2-4ef0-8d4e-c9e35d180708 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.037184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3192/6351] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:53.042057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.060981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493731d-4710-4735-a7be-aee64b67403d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.067999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.069002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.069533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.069966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] PATH_INFO: `/v3/projects/bd403a7345704f7094dc8b912faec5e0/users/ae5adfdfdef049219e6f05c2e516e73e/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.072366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd403a7345704f7094dc8b912faec5e0, user_id=ae5adfdfdef049219e6f05c2e516e73e, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.075736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8c90-30ad-4f86-809b-bb45d6bc7236 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.086863 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:53.093031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3160/6352] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:53 2022] PUT /identity/v3/projects/bd403a7345704f7094dc8b912faec5e0/users/ae5adfdfdef049219e6f05c2e516e73e/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:53.105908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.106222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.106500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.159381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] MFA Rules not processed for user `ae5adfdfdef049219e6f05c2e516e73e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:53.161751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:53.296495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae086-bb00-474b-9dcd-a31aa4672a26 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.297069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae086-bb00-474b-9dcd-a31aa4672a26 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.297655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cae086-bb00-474b-9dcd-a31aa4672a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.352776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3193/6353] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:53.352979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-25cae086-bb00-474b-9dcd-a31aa4672a26 None None] MFA Rules not processed for user `3ac3815c7b7744508bddf2559c7c7fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:53.356253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-25cae086-bb00-474b-9dcd-a31aa4672a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:53.358217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.393050 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:53.396287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b37e64-58b2-410b-b1f5-f2e8f0528557 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.416811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5adfdfdef049219e6f05c2e516e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd403a7345704f7094dc8b912faec5e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.417582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.417870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.422235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.422235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:53.422235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.424124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.444681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3194/6354] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:44:53.451081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.472787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295d5db-1102-4e71-a19e-5b271a0ffb4e tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.477920 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3161/6355] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:44:53.483588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5adfdfdef049219e6f05c2e516e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd403a7345704f7094dc8b912faec5e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.484371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.484743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.485026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.485697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.487971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.490375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.490743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.491054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.513863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] MFA Rules not processed for user `3ac3815c7b7744508bddf2559c7c7fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:53.515238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:53.534831 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3162/6356] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:53.537602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.541089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:53.644235 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3195/6357] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:53 2022] POST /identity/v3/projects => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:53.648795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.674421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d8539-94fb-4941-80ba-3da2b59b0a34 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.727924 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:53.776270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2633cf-dd63-4fa4-85c0-c1784935fd9f tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:53.789019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.792716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.792716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.792716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.792999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5adfdfdef049219e6f05c2e516e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd403a7345704f7094dc8b912faec5e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:53.792999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.792999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.793302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.793302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:53.793942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.797196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2682e10-db4a-4f04-ac51-3861ed0813fa tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.817551 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3196/6358] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:53.817551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:53.817551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:53.817551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:53.838868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] MFA Rules not processed for user `dcb021152c684983b31e5db439518921`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:53.840165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:53.863144 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:53.875432 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:53.921978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:53.923600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:53.943788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3197/6359] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:53.945731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:53.952360 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3163/6360] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:54.026510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b49140-6ab1-4b07-bc65-9f95bc196a72 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:54.032654 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:54.036826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:54.037682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:54.038957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:54.039459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:54.052431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:54.054067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:54.089972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3198/6361] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:54.120135 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:54.249513 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:54.536857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:54.543359 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:54.555184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75678609-c99b-40c0-8b41-9fb5575fb600 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:54.560581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae5adfdfdef049219e6f05c2e516e73e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd403a7345704f7094dc8b912faec5e0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:54.561234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:54.561762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:54.562191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] PATH_INFO: `/v3/projects/5987d44992a842f09ff2241032ffc594` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:54.563390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5987d44992a842f09ff2241032ffc594)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:54.565356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:54.732837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5987d44992a842f09ff2241032ffc594', 'request_id': 'req-a9315481-22ee-4ffa-a751-8e3eac2212df'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:54.739934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5987d44992a842f09ff2241032ffc594', 'request_id': 'req-a9315481-22ee-4ffa-a751-8e3eac2212df'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:54.800732 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:54.856725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5987d44992a842f09ff2241032ffc594', 'request_id': 'req-a9315481-22ee-4ffa-a751-8e3eac2212df'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:54.889087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] The token cache is being invalidate because project 5987d44992a842f09ff2241032ffc594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:54.889448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:54.898441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:54.901385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3164/6362] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:54 2022] DELETE /identity/v3/projects/5987d44992a842f09ff2241032ffc594 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:55.092353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:55.158572 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:55.200860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c61439-87b8-4405-92cb-088084abc46f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:55.274888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:55.275965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:55.276554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:55.276951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] PATH_INFO: `/v3/users/800653326aa743b485942aec01caa125` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:55.279112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=800653326aa743b485942aec01caa125)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:55.281286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:55.502044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800653326aa743b485942aec01caa125'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.595775 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:55.596510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800653326aa743b485942aec01caa125'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.597432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800653326aa743b485942aec01caa125'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.615819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:55.618626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:55.621177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800653326aa743b485942aec01caa125'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.634015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800653326aa743b485942aec01caa125'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.640335 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3199/6363] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:55 2022] DELETE /identity/v3/users/800653326aa743b485942aec01caa125 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:55.641484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:55.644397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9315481-22ee-4ffa-a751-8e3eac2212df tempest-QuotasTest-1920033745 tempest-QuotasTest-1920033745-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:55.644675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:55.719761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:55.720600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:55.721075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:55.721393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] PATH_INFO: `/v3/users/3ac3815c7b7744508bddf2559c7c7fe9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:55.723579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29947b74-f7d7-4c2a-89df-e67a829cadbb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:55.724440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac3815c7b7744508bddf2559c7c7fe9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:55.726702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:55.730234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:55.731154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:55.732386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:55.732386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:55.734324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:55.759731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:55.762543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278d51b-9a9a-4b20-80b2-a11015d9ecd9 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:55.776384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3200/6364] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:55.777710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:55.777999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:55.778270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:55.797933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:55.799323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:55.821490 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3201/6365] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:55.821490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:55.821490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:55.889543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f245-57c5-4253-a53e-10aa1ebc9283 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:55.895608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:55.897466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:55.897803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:55.900253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:55.923131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:55.925504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:55.954030 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3202/6366] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:44:55.991445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac3815c7b7744508bddf2559c7c7fe9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:55.992367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac3815c7b7744508bddf2559c7c7fe9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.004884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac3815c7b7744508bddf2559c7c7fe9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.009322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac3815c7b7744508bddf2559c7c7fe9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.045642 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:56.135877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac3815c7b7744508bddf2559c7c7fe9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.154356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3165/6367] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:55 2022] DELETE /identity/v3/users/3ac3815c7b7744508bddf2559c7c7fe9 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:56.483624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:56.485962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:56.502202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:56.503774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:56.530511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09226807-772a-410a-a848-920ac4bd9be1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:56.598563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd92d83-b27f-484b-8d23-8f558e57fa7d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:56.606228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:56.607434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:56.607880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:56.608371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] PATH_INFO: `/v3/projects/84d66d174b1b41329fffbb68649e154e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:56.610229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d66d174b1b41329fffbb68649e154e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:56.613929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:56.614416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:56.614576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:56.614852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:56.615124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] PATH_INFO: `/v3/projects/85ce2329fe754ca6930ba693bb02ae2e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:56.626302 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:56.626600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ce2329fe754ca6930ba693bb02ae2e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:56.630699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:56.762513 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:56.797859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ce2329fe754ca6930ba693bb02ae2e', 'request_id': 'req-3666c457-cbad-4b9c-88a1-48d2df09ef7d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.820508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d66d174b1b41329fffbb68649e154e', 'request_id': 'req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.828386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d66d174b1b41329fffbb68649e154e', 'request_id': 'req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.908357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ce2329fe754ca6930ba693bb02ae2e', 'request_id': 'req-3666c457-cbad-4b9c-88a1-48d2df09ef7d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.917012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ce2329fe754ca6930ba693bb02ae2e', 'request_id': 'req-3666c457-cbad-4b9c-88a1-48d2df09ef7d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.933713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] The token cache is being invalidate because project 85ce2329fe754ca6930ba693bb02ae2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:56.934381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.935541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3666c457-cbad-4b9c-88a1-48d2df09ef7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:56.937424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3203/6368] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:56 2022] DELETE /identity/v3/projects/85ce2329fe754ca6930ba693bb02ae2e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:56.941926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5ccf-3a0f-4bdd-b421-fd20fac93bf0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:56.942275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5ccf-3a0f-4bdd-b421-fd20fac93bf0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:56.942604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5ccf-3a0f-4bdd-b421-fd20fac93bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:56.965830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-15ae5ccf-3a0f-4bdd-b421-fd20fac93bf0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:56.967260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15ae5ccf-3a0f-4bdd-b421-fd20fac93bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:56.979989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d66d174b1b41329fffbb68649e154e', 'request_id': 'req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.016094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] The token cache is being invalidate because project 84d66d174b1b41329fffbb68649e154e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:57.016708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.017603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.019945 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3166/6369] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:56 2022] DELETE /identity/v3/projects/84d66d174b1b41329fffbb68649e154e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:57.023700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.027946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:57.078668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3204/6370] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:57.082372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.084811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.085201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.112424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76d7a4-4277-4eec-b1f1-a2b14a1109b9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.118542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.119175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.119470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.119743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] PATH_INFO: `/v3/users/ae5adfdfdef049219e6f05c2e516e73e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.120852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5adfdfdef049219e6f05c2e516e73e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.122798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.126862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:57.128800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:57.144868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3205/6371] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:57.149618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.163121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b807230-f2f8-4a10-a393-71b4d2ea0c47 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.173846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.174625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.174979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.175326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.176116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:57.176525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.178351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.182980 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:57.194623 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3206/6372] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:57.199895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.210632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad14a3-1d98-4c44-a02b-f38c4bffb794 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.215444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.218989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.218989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.218989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.218989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.219552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.240085 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:57.352965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3207/6373] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:57 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:57.357398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.361368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5adfdfdef049219e6f05c2e516e73e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.362342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5adfdfdef049219e6f05c2e516e73e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.375550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5adfdfdef049219e6f05c2e516e73e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.376820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5adfdfdef049219e6f05c2e516e73e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.443294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fd643-b21a-49b3-a905-6e1ca9d4da60 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.461313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.461313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.461313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.461313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.461801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.463560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.480210 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:57.482236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5adfdfdef049219e6f05c2e516e73e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:57.506163 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3167/6374] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:57 2022] DELETE /identity/v3/users/ae5adfdfdef049219e6f05c2e516e73e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:57.571773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3208/6375] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:57 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:57.576144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.578345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:57.628667 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:57.657311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee811-759a-473c-ae24-0e1c9de6b428 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.662918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.663763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.664999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.665264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.666254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.668022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.681000 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3168/6376] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:57.684720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.697064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea2f2-de3d-44a3-8e56-0fdc84a0293d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.702063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.702673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.702945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.703206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.703834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.705764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11d563-d8c4-4630-b847-2fbe939d7426 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.720028 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3209/6377] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:57.720837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:57.743470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc95d87-c69e-4087-bd71-651b52352178 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:57.752097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:57.753062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.753528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.753954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] PATH_INFO: `/v3/projects/8661b619a0aa4a4c9678a3ff76e6d1a2/users/23af242da6004d698edf9b530bcc239d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.777562 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:57.783451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8661b619a0aa4a4c9678a3ff76e6d1a2, user_id=23af242da6004d698edf9b530bcc239d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:57.787522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:57.913833 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3169/6378] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:57 2022] PUT /identity/v3/projects/8661b619a0aa4a4c9678a3ff76e6d1a2/users/23af242da6004d698edf9b530bcc239d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:57.916760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:57.917058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:57.917468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:57.976800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] MFA Rules not processed for user `23af242da6004d698edf9b530bcc239d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:57.978917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:58.087781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.090029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:58.181526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3210/6379] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:58.181688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.291513 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:58.323548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb1a6f-abb4-40c2-8bfc-ce6013b76005 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.332075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.332707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.332989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.333672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.334034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.335776 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:58.339079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.342274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad220-d3be-4674-80a1-1ab7ebfc02f9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.354084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.355258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.355736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.356199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] PATH_INFO: `/v3/projects/bd403a7345704f7094dc8b912faec5e0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.359393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd403a7345704f7094dc8b912faec5e0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.375973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.464236 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3211/6380] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/projects => generated 371 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:58.468334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.485212 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:58.510944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd403a7345704f7094dc8b912faec5e0', 'request_id': 'req-68ab78a6-9176-4f2c-8ee8-78e5537e0922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:58.518395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd403a7345704f7094dc8b912faec5e0', 'request_id': 'req-68ab78a6-9176-4f2c-8ee8-78e5537e0922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:58.557812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99e7b-7c11-4913-8a91-ec1def0fe955 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.622254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd403a7345704f7094dc8b912faec5e0', 'request_id': 'req-68ab78a6-9176-4f2c-8ee8-78e5537e0922'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:58.637071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.638676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.639117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.639619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.640423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.642973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.648323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] The token cache is being invalidate because project bd403a7345704f7094dc8b912faec5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:44:58.648626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:58.652595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-68ab78a6-9176-4f2c-8ee8-78e5537e0922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:58.652595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3170/6381] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:44:58 2022] DELETE /identity/v3/projects/bd403a7345704f7094dc8b912faec5e0 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:58.659026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc6e0-33e9-4f3f-bf18-96a8e672cf55 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.659612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc6e0-33e9-4f3f-bf18-96a8e672cf55 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.659847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfc6e0-33e9-4f3f-bf18-96a8e672cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.693314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-68bfc6e0-33e9-4f3f-bf18-96a8e672cf55 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:58.695074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-68bfc6e0-33e9-4f3f-bf18-96a8e672cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:58.704294 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3171/6382] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:58.715237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.715431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.717661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.747275 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3212/6383] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:58.751445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.751858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:58.753197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:58.753621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:58.765540 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3172/6384] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:58.769574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.781797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a05c22-0e88-41fc-8c3c-61e4dc6a6ba6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.785459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dfc10-fec8-41c7-a1e5-1c37f123da85 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.788614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.793167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.793500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.793781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.795173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:44:58.795486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.798155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.798610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.799937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.800887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.801175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.801872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.803480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.818856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3173/6385] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:44:58.824116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.829790 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3213/6386] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:58.834802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.849617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e8817-ed7e-4a04-b3c7-448de559d5cc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.850175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ad1b2-a5a9-44ab-9c51-bc6a7dc96852 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:58.855457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.856079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.856366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.856651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.856757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:58.857709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.857908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:58.858736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:58.859073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] PATH_INFO: `/v3/projects/510507d0e4164c7cbc443f0ddb280621/users/2ef950fccfac4c8ea3e8a8755befa287/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:58.859614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.881942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510507d0e4164c7cbc443f0ddb280621, user_id=2ef950fccfac4c8ea3e8a8755befa287, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:58.885371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:58.992260 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3214/6387] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:58 2022] PUT /identity/v3/projects/510507d0e4164c7cbc443f0ddb280621/users/2ef950fccfac4c8ea3e8a8755befa287/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:44:58.993964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:58.999246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3174/6388] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:59.000358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.139615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3ff5a-f5c6-4cbd-ab37-2c5e638adb66 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.146520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.147201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.148120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.148433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.149117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.151558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa0188-4397-4b5f-ace7-3aff627e3117 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.153057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484052-c9e4-4a17-8762-2d056707ea66 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.166124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.166752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.167036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.167307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.167956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.169610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.181393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3215/6389] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:44:59.184568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.195135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579ca71-5ceb-45a9-8ac0-f4fd448ef187 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.200990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.201902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.202337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.206918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] PATH_INFO: `/v3/projects/510507d0e4164c7cbc443f0ddb280621/users/2ef950fccfac4c8ea3e8a8755befa287/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.206918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510507d0e4164c7cbc443f0ddb280621, user_id=2ef950fccfac4c8ea3e8a8755befa287, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.208105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.221288 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3216/6390] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:59 2022] PUT /identity/v3/projects/510507d0e4164c7cbc443f0ddb280621/users/2ef950fccfac4c8ea3e8a8755befa287/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:44:59.235451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.242262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:59.273612 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3175/6391] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:44:58 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:44:59.275017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.275304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.275584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.350141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] MFA Rules not processed for user `2ef950fccfac4c8ea3e8a8755befa287`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:44:59.351603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:59.378437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f99f-dcc3-401f-bad8-36c670baabb1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.383410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.384025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.385202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.385517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.387999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:59.406319 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:59.456438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3176/6392] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:44:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:44:59.457583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.502263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.504720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.520064 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3217/6393] 10.222.0.13 () {60 vars in 1396 bytes} [Sun Oct 30 01:44:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:44:59.520915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.522361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:44:59.542925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760a04-f17e-4b72-b469-4de27fef8f90 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.548943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.550299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.550577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.551055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.552063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.554184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.589263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3177/6394] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:59.590235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.615601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27f3ed-7bd7-4035-9cb6-9313e3d607ac service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.619091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe0c1-bcf5-4b8f-ad10-fb3acf338a18 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.621405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.622169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.622549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.622943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] PATH_INFO: `/v3/users/04422cc4b49f45e5ab1ea670e7be1db3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.624307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04422cc4b49f45e5ab1ea670e7be1db3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.630240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.630757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.631035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.635302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.635302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.636473 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:44:59.636473 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:44:59.636473 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:44:59.637158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.638700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.642722 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:44:59.734561 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3178/6395] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:44:59 2022] POST /identity/v3/services => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:59.735903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.765033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13147745-af85-49e8-a7f1-bfd2cb6ddb31 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.773463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.775292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.775768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.776194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.781844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.783783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.795918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3179/6396] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:44:59.796874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.832861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3af66-aa59-436b-8618-c6f8ede06558 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:44:59.839659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:44:59.845391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:44:59.845391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:44:59.845391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:44:59.845391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:44:59.846005 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:44:59.846005 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:44:59.846005 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:44:59.854095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:44:59.887591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04422cc4b49f45e5ab1ea670e7be1db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:59.959664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3180/6397] 10.222.0.13 () {60 vars in 1213 bytes} [Sun Oct 30 01:44:59 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:44:59.960763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:44:59.984416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04422cc4b49f45e5ab1ea670e7be1db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:59.985681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04422cc4b49f45e5ab1ea670e7be1db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:44:59.995789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b171fca-a98d-4357-9ede-e32806921fbe tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.003135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04422cc4b49f45e5ab1ea670e7be1db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:00.010312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.011078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.011250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.011882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] PATH_INFO: `/v3/projects/19b70b271bd04ff1811ef1e71229c023/users/b441184d485a41e1b8e3eb0cb1617937/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.019658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04422cc4b49f45e5ab1ea670e7be1db3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:00.038370 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3218/6398] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:44:59 2022] DELETE /identity/v3/users/04422cc4b49f45e5ab1ea670e7be1db3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:00.039404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.042684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:00.050919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b70b271bd04ff1811ef1e71229c023, user_id=b441184d485a41e1b8e3eb0cb1617937, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.055986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee111f-adaf-499d-a2eb-d6eecd79638e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.158659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1a4a8-44b5-4de8-92c6-7b0997698ee5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.167367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3181/6399] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:44:59 2022] PUT /identity/v3/projects/19b70b271bd04ff1811ef1e71229c023/users/b441184d485a41e1b8e3eb0cb1617937/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:00.169244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6126-626a-4392-b1cc-66dca6f69804 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.172981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6126-626a-4392-b1cc-66dca6f69804 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.173300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b6126-626a-4392-b1cc-66dca6f69804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.214215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3f6b6126-626a-4392-b1cc-66dca6f69804 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:00.215866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3f6b6126-626a-4392-b1cc-66dca6f69804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:00.263600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.264325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.265685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.274851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.274851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.276732 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:00.276732 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:00.276732 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:00.277417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.316118 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3182/6400] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:00.316118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471c80-063c-425b-b15f-161fa3103003 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.316118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471c80-063c-425b-b15f-161fa3103003 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.316118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79471c80-063c-425b-b15f-161fa3103003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.353880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-79471c80-063c-425b-b15f-161fa3103003 None None] MFA Rules not processed for user `b441184d485a41e1b8e3eb0cb1617937`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:00.354875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-79471c80-063c-425b-b15f-161fa3103003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:00.366245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3219/6401] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/services => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:00.367315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.373810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:00.490634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3183/6402] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/auth/tokens => generated 3512 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:00.490634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471c80-063c-425b-b15f-161fa3103003 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.524418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79471c80-063c-425b-b15f-161fa3103003 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.524418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.524418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.524768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.524768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.525883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.527403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.542092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a768-dc4f-477a-9829-730f63e4807c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.552008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.552814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.553166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.553634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.565004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.566600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.590353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3220/6403] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:00 2022] GET /identity/v3/auth/tokens => generated 3507 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:00.591182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.592568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:00.616766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a0203-3de4-4121-8f5a-1e7fa6de4aa1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.638683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.638683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.638683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.638683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.639570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.640776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.658656 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3184/6404] 10.222.0.13 () {60 vars in 1213 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:00.661211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.682859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727383-49a0-4db2-94a1-259ba92663a8 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.693257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.693257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.693257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.695555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.696461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.699766 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:00.699766 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:00.699766 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:00.701019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.717757 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3185/6405] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:45:00 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:00.719887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.747878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690ad7e-b46e-4a7f-8b0c-4462f2c68bf7 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.756257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.757006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.757381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.757774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.758489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=5bda985dd28b40999f67dde104553baf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.759522 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:00.759522 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:00.759522 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:00.762902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.778779 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3186/6406] 10.222.0.13 () {58 vars in 1290 bytes} [Sun Oct 30 01:45:00 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf => generated 333 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:00.782161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.801501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d1522-acae-4c7b-9485-93974d08cae3 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.815531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:00.816299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:00.816672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:00.817245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:00.817691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=5bda985dd28b40999f67dde104553baf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:00.819360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:00.832547 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3221/6407] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:00.832856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3187/6408] 10.222.0.13 () {58 vars in 1291 bytes} [Sun Oct 30 01:45:00 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf => generated 0 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 30 01:45:00.842418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.842639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:00.866476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506f2cc-c065-4dd5-819c-5728c2a7ea0a tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.989570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef12fa-970c-488b-9c09-d1edb0c68f97 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:00.999278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.001775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.002137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.004084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.005183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5bda985dd28b40999f67dde104553baf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.007340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.008069 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:01.008069 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:01.008069 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:01.010439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.013040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.013491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.013812 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:01.014437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.016672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.020822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.076622 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3222/6409] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:45:00 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:01.081599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.098953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3188/6410] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:00 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:01.103544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.107413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752f8f9-7010-45d3-a7ed-c0e4401b0a71 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.114935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9b39-9930-40d9-a3ff-607ff3200331 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.120481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.121117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.121570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.122033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.122465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.122942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.123569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.123917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.125296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.125713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.126055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.131228 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:01.131228 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:01.131228 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:01.132401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.138664 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3189/6411] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:01.143326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.150967 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3223/6412] 10.222.0.13 () {58 vars in 1191 bytes} [Sun Oct 30 01:45:01 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:01.155923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49759e-6b0c-4b90-8e6b-64acbab8aa18 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.160341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.161513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.162568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.163070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.163641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] PATH_INFO: `/v3/projects/90b37e316ca542ac915f7d27b062c171/users/5c1f59536ef44328b9c56d5c4cf382df/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.182290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b37e316ca542ac915f7d27b062c171, user_id=5c1f59536ef44328b9c56d5c4cf382df, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.185593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.188041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c57ad-86d5-43ed-8c33-2428c59246c2 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.194482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.195355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.196342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.196787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.197643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5bda985dd28b40999f67dde104553baf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.199430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Could not find Endpoint Group: 5bda985dd28b40999f67dde104553baf.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 5bda985dd28b40999f67dde104553baf. Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 30 01:45:01.224103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 5bda985dd28b40999f67dde104553baf. Oct 30 01:45:01.225434 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:45:01.231172 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3224/6413] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:45:01 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5bda985dd28b40999f67dde104553baf => generated 120 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:45:01.233131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.244881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a80d-6db9-4dfe-bd93-92475aa9a9c4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.251430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.252133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.252415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.252736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services/0b9494591e384e218f29be3c81bd1f91` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.253318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0b9494591e384e218f29be3c81bd1f91)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.254521 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:01.254521 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:01.254521 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:01.259354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.291755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3190/6414] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:01 2022] PUT /identity/v3/projects/90b37e316ca542ac915f7d27b062c171/users/5c1f59536ef44328b9c56d5c4cf382df/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:01.295510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.360049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdce20-463f-4573-81be-296294f3a1d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.365704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.366384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.367413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.367867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.368670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.370400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.378508 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:01.392999 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3225/6415] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:01 2022] DELETE /identity/v3/services/0b9494591e384e218f29be3c81bd1f91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:01.392999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.395177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:01.401167 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3191/6416] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:01.401167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.435518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371c26-4243-4e1e-ba0f-a7bf5a9a3ab4 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.444091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.445071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.445936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.446363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] PATH_INFO: `/v3/projects/b9f09e011fe04399af31005dc1077d9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.447640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f09e011fe04399af31005dc1077d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.450150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.485639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59d8e-881a-4c44-8954-30be6ac28172 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.506970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.509376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.509663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.511341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.512817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.514590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.596508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3192/6417] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:01 2022] POST /identity/v3/services => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:01.597703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.628486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1f87-2585-44bf-a141-9c70d1cbbd9e tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.638248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f09e011fe04399af31005dc1077d9f', 'request_id': 'req-37399dc0-da43-48e5-a418-71a9ee09347e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:01.721063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.721968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.722551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.722981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] PATH_INFO: `/v3/projects/90b37e316ca542ac915f7d27b062c171/users/5c1f59536ef44328b9c56d5c4cf382df/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.726051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b37e316ca542ac915f7d27b062c171, user_id=5c1f59536ef44328b9c56d5c4cf382df, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.726207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f09e011fe04399af31005dc1077d9f', 'request_id': 'req-37399dc0-da43-48e5-a418-71a9ee09347e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:01.730558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.739563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f09e011fe04399af31005dc1077d9f', 'request_id': 'req-37399dc0-da43-48e5-a418-71a9ee09347e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:01.759871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] The token cache is being invalidate because project b9f09e011fe04399af31005dc1077d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:01.760143 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3193/6418] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:01 2022] PUT /identity/v3/projects/90b37e316ca542ac915f7d27b062c171/users/5c1f59536ef44328b9c56d5c4cf382df/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:01.762155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.773558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:01.774982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-37399dc0-da43-48e5-a418-71a9ee09347e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:01.787884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3226/6419] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:01 2022] DELETE /identity/v3/projects/b9f09e011fe04399af31005dc1077d9f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:01.795023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.797791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.797791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.855227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] MFA Rules not processed for user `5c1f59536ef44328b9c56d5c4cf382df`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:01.856723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:01.892466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c035ea-7810-4875-bbe3-630667c430c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:01.899353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:01.900424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:01.900738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:01.901303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:01.902060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:01.908412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:01.975162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3227/6420] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:01 2022] POST /identity/v3/auth/tokens => generated 3581 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:01.976550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:01.982899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:01.995170 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3194/6421] 10.222.0.13 () {60 vars in 1213 bytes} [Sun Oct 30 01:45:01 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:01.998356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:02.000366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:02.065904 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:02.122347 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:02.181919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191d09-18a1-44ba-aed5-8d452486db2e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.187986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.188871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.189240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.189702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] PATH_INFO: `/v3/users/4d95c5bc5f774f41b63f9652a6afbf55` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.191010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d95c5bc5f774f41b63f9652a6afbf55)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.193571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:02.199998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e738c08-46a1-4c50-af8d-18222aead892 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.206361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.207087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.207259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.207535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.218747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.220271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:02.237066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3195/6422] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:01 2022] GET /identity/v3/auth/tokens => generated 3581 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:02.243017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:02.243017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:02.265144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449b0ce-cf99-4ba9-aa82-ac1307d23873 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.269911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.271715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.272248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.272718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.274114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.276113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:02.444157 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3196/6423] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:02 2022] POST /identity/v3/services => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:02.446353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:02.449704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:02.465061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d95c5bc5f774f41b63f9652a6afbf55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:02.572055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa14f9-a491-430a-ae01-461064323512 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.579345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.579969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.580291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.580596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.582370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:02.597660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.599260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:02.615565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3197/6424] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:02 2022] GET /identity/v3/auth/tokens => generated 3772 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:02.616559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:02.633328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d95c5bc5f774f41b63f9652a6afbf55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:02.634147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d95c5bc5f774f41b63f9652a6afbf55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:02.641930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346231-15e0-4445-8f67-536c11bd9727 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.646665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.647437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.647722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.648022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5c3ce372ceec4409a69be001994f2576` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.649209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=5c3ce372ceec4409a69be001994f2576)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.650372 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:02.650372 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:02.650372 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:02.651283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:02.653853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d95c5bc5f774f41b63f9652a6afbf55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:02.662156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d95c5bc5f774f41b63f9652a6afbf55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:02.670359 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3228/6425] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:01 2022] DELETE /identity/v3/users/4d95c5bc5f774f41b63f9652a6afbf55 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:02.755435 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3198/6426] 10.222.0.13 () {60 vars in 1313 bytes} [Sun Oct 30 01:45:02 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/5c3ce372ceec4409a69be001994f2576 => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:02.763635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:02.766985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:02.848392 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:02.852655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b450283-480f-4423-a789-ca75e62c10ea admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:02.857490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:02.858111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:02.858395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:02.858696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services/8209e9b422c34dc49f08e9f80355ed8f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:02.859324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8209e9b422c34dc49f08e9f80355ed8f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:02.860922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.028029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3229/6427] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:02 2022] DELETE /identity/v3/services/8209e9b422c34dc49f08e9f80355ed8f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:03.029144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.046874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2221a-2975-4e24-b13e-69a108e43408 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.075851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.076503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.076786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.077063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/5c3ce372ceec4409a69be001994f2576` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.077688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=5c3ce372ceec4409a69be001994f2576)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.078756 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:03.078756 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:03.078756 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:03.079726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.203588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3199/6428] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/5c3ce372ceec4409a69be001994f2576 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:03.207586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.221638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.223801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:03.229802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624f-64db-4c6b-9f26-55042375a298 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.247054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.248312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.248773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.249906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services/44453c82495e44c2b59da4bcb67b3ef2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.250718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_service(service_id=44453c82495e44c2b59da4bcb67b3ef2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.267126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.364416 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3230/6429] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/services/44453c82495e44c2b59da4bcb67b3ef2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:03.369476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.376633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8508a-ebcc-4f50-a4f4-c8d8a3b97957 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.404663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.406117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.406597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.407026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] PATH_INFO: `/v3/projects/b0634efc8bac43eb912a03b3ca1153a5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.408439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0634efc8bac43eb912a03b3ca1153a5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.410857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.412554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec477b-69d7-4046-9ba1-b8fdd8215122 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.421422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.422399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.422903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.423568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a3404947ca884889a5a6e334f537faa3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.424553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a3404947ca884889a5a6e334f537faa3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.426956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.523619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3231/6430] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a3404947ca884889a5a6e334f537faa3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:03.524622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.536089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372acb1c-a5b6-4eb5-be6a-25fdd9e9771c tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.549624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0634efc8bac43eb912a03b3ca1153a5', 'request_id': 'req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:03.566330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0634efc8bac43eb912a03b3ca1153a5', 'request_id': 'req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:03.605368 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:03.629614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef950fccfac4c8ea3e8a8755befa287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '510507d0e4164c7cbc443f0ddb280621', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.630987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.631280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.631574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] PATH_INFO: `/v3/services/a202e8fe7b9f4928a3b4bf458b452e8f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.632305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a202e8fe7b9f4928a3b4bf458b452e8f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.634246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.648422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0634efc8bac43eb912a03b3ca1153a5', 'request_id': 'req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:03.663672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] The token cache is being invalidate because project b0634efc8bac43eb912a03b3ca1153a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:03.663975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:03.665263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7723e251-5f9c-4601-b1fc-6eb27ad1bd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:03.669379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3200/6431] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/projects/b0634efc8bac43eb912a03b3ca1153a5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:03.672204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56cf25-c49b-447b-bef2-1b69924739a9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.672655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56cf25-c49b-447b-bef2-1b69924739a9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.673083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56cf25-c49b-447b-bef2-1b69924739a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.701190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7c56cf25-c49b-447b-bef2-1b69924739a9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:03.702489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7c56cf25-c49b-447b-bef2-1b69924739a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:03.732739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3232/6432] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/services/a202e8fe7b9f4928a3b4bf458b452e8f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:03.734168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.736934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:03.800824 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3201/6433] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:03.809581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.810433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.810869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.834451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:03.835772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:03.836915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d6b02-6483-4057-95bb-d0dec305d126 tempest-EndPointGroupsTest-122974204 tempest-EndPointGroupsTest-122974204-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.843357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.844227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.844664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.845092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] PATH_INFO: `/v3/users/23af242da6004d698edf9b530bcc239d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.846481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=23af242da6004d698edf9b530bcc239d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.849032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.850025 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3202/6434] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:03.851095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.862364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274fc7b-133a-43b6-9832-3b67607217cd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.868257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.868956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.869310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.869787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.870518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:03.871071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.873571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:03.910756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3203/6435] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:03.911671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:03.922950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60564-9330-4690-a376-4a132280faff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:03.927716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:03.928396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:03.928679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:03.929158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:03.930117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:03.932249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.073637 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3204/6436] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:03 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:04.075649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.155193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23af242da6004d698edf9b530bcc239d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:04.159791 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:04.184976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4743916-d665-42f9-b2a6-ec0bb04df1b4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:04.190064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:04.190756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.190996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.191324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.196224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:04.196224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.245021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23af242da6004d698edf9b530bcc239d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:04.245707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23af242da6004d698edf9b530bcc239d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:04.264910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23af242da6004d698edf9b530bcc239d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:04.274273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-815a3c12-399b-4816-ba7b-bd46adec9ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23af242da6004d698edf9b530bcc239d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:04.281088 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3233/6437] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:03 2022] DELETE /identity/v3/users/23af242da6004d698edf9b530bcc239d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:04.285219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.285541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.285816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.309303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3205/6438] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:04 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:04.310529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:04.311980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:04.313654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.315808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:04.329508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92cecb-906c-4dc8-ba1f-2ce71eef8caf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:04.427709 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3234/6439] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:04.440134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.446385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:04.452215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:04.453463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.455807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.456157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.456894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:04.459796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.493815 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3206/6440] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:04.497292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.530455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae329-038b-4bf4-86ae-e608afc7372a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:04.536131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:04.536896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.537187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.537488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.538131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:04.539863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.554111 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3207/6441] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:04.556293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1f954-a4f5-4b4d-aa90-b05c008d36f8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:04.558224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.562209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:04.563289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.563901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.564380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.569130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7589-249a-43d9-ada8-843d1869bc2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:04.577733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:04.578418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.578768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.579106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] PATH_INFO: `/v3/projects/4413038faa4e48f7b49b37c31bb63da2/users/8c2e24f59fbb419ea9b10b81fe3cf316/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.584286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:04.587049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6a988-16f8-4d51-b538-c2bdfb95bb8f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.605187 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3235/6442] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:45:04.608008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413038faa4e48f7b49b37c31bb63da2, user_id=8c2e24f59fbb419ea9b10b81fe3cf316, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:04.613107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:04.767666 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3208/6443] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:04 2022] PUT /identity/v3/projects/4413038faa4e48f7b49b37c31bb63da2/users/8c2e24f59fbb419ea9b10b81fe3cf316/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:04.780025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:04.780547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:04.780645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:04.821979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] MFA Rules not processed for user `8c2e24f59fbb419ea9b10b81fe3cf316`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:04.823664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:04.936520 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3236/6444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:04.948828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:04.950699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:04.988014 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:05.037451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cff9c3-eadc-40c3-b80c-84d01b4b37cc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:05.041811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:05.042415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:05.042693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:05.043022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:05.051697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:05.053135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:05.063552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3209/6445] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:05.327034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:05.327034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:05.425271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fad27-3bd4-47d5-82aa-1286841b6d72 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:05.431250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:05.431968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:05.432350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:05.432634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] PATH_INFO: `/v3/projects/8661b619a0aa4a4c9678a3ff76e6d1a2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:05.434099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8661b619a0aa4a4c9678a3ff76e6d1a2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:05.436312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:05.574403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8661b619a0aa4a4c9678a3ff76e6d1a2', 'request_id': 'req-e7f4c870-3648-488a-8bdd-5740d54d8200'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:05.661589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8661b619a0aa4a4c9678a3ff76e6d1a2', 'request_id': 'req-e7f4c870-3648-488a-8bdd-5740d54d8200'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:05.668991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8661b619a0aa4a4c9678a3ff76e6d1a2', 'request_id': 'req-e7f4c870-3648-488a-8bdd-5740d54d8200'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:05.679721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] The token cache is being invalidate because project 8661b619a0aa4a4c9678a3ff76e6d1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:05.680116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:05.680786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:05.682448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3237/6446] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:05 2022] DELETE /identity/v3/projects/8661b619a0aa4a4c9678a3ff76e6d1a2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:05.686347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:05.700728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa3f5-0738-4ef3-ace4-46e1aaa186f0 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:05.762309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:05.763077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:05.763959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:05.764234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] PATH_INFO: `/v3/users/2ef950fccfac4c8ea3e8a8755befa287` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:05.765386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef950fccfac4c8ea3e8a8755befa287)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:05.767301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:05.917808 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:06.001187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef950fccfac4c8ea3e8a8755befa287'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:06.002090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef950fccfac4c8ea3e8a8755befa287'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:06.012545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef950fccfac4c8ea3e8a8755befa287'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:06.013546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef950fccfac4c8ea3e8a8755befa287'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:06.095012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6e6a8e53-f736-4fce-af8a-63f6b902cddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef950fccfac4c8ea3e8a8755befa287'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:06.149239 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3210/6447] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:05 2022] DELETE /identity/v3/users/2ef950fccfac4c8ea3e8a8755befa287 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:06.222988 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:06.739874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:06.741552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:06.802498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c870-3648-488a-8bdd-5740d54d8200 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:06.875303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:06.875950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:06.876454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:06.876812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] PATH_INFO: `/v3/projects/510507d0e4164c7cbc443f0ddb280621` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:06.878286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=510507d0e4164c7cbc443f0ddb280621)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:06.880360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:07.044363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510507d0e4164c7cbc443f0ddb280621', 'request_id': 'req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:07.136372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510507d0e4164c7cbc443f0ddb280621', 'request_id': 'req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:07.145130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510507d0e4164c7cbc443f0ddb280621', 'request_id': 'req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:07.156734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] The token cache is being invalidate because project 510507d0e4164c7cbc443f0ddb280621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:07.157131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:07.157907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbb51fd8-5715-4a6c-b5d9-2fb9c73c7e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:07.162936 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3238/6448] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:06 2022] DELETE /identity/v3/projects/510507d0e4164c7cbc443f0ddb280621 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:07.165160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.165654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.166013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.188702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:07.190111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:07.363256 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3211/6449] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:07.365813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.366094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.366366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.397841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:07.399702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:07.424388 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3239/6450] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:07.425973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:07.442365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae2a92-3b4c-4971-a804-98e5d997fde1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:07.452413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:07.453473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.453939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.454423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.455606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:07.456074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:07.460004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:07.506953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3212/6451] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:07.508743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:07.527963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e099e84-32bb-42bf-834b-a4fc63cd0193 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:07.537869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:07.538968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.540232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.540718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.542064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:07.545707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:07.675605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:07.677524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:07.681940 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3240/6452] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:07 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:07.686920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:07.734235 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:07.805465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2574c-5c9d-4a77-b9b9-eee6d3a7cf56 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:07.805465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:07.805465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.805465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.807133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.807133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:07.807133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:07.820975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2304c-db6b-4472-9e06-9daec44eadc2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:07.901869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:07.902173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:07.902582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:07.903152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:07.905463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:07.923260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:07.925135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:07.939419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3213/6453] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:08.032071 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3241/6454] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:07 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:08.037798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.063090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836402c-7f3e-48e2-9302-2a7d50c03808 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.067948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.068822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.069161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.069913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.071310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.073985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.095876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3214/6455] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:08.099156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.112301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36942a-7fc6-43f9-bede-a1dcdd70d694 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.117792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.118777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.119057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.119324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.122550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.125368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1794a-6962-4a3b-a32e-3b429c4d56cb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.139388 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3242/6456] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:08.145165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.156918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd10d7-04c0-4328-85eb-e9ccf7a4d2dd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.170454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.170454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.170454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.170454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] PATH_INFO: `/v3/projects/fda40567743b44b29b771fbb2360c46c/users/843c54ab125349bf94ed821432cb276c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.185725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda40567743b44b29b771fbb2360c46c, user_id=843c54ab125349bf94ed821432cb276c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.188612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.296211 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3215/6457] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:08 2022] PUT /identity/v3/projects/fda40567743b44b29b771fbb2360c46c/users/843c54ab125349bf94ed821432cb276c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:08.307883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.308172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.308471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.339347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] MFA Rules not processed for user `843c54ab125349bf94ed821432cb276c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:08.339938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:08.394835 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:08.416893 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3243/6458] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:08.421059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.496389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b25f-360a-48e7-8052-4932712d4a8a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.503440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.504277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.504639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.505162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.505929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.508475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.630936 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3216/6459] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:08 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:08.634855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.653437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875e976-ec15-4e6f-bbbb-72afc81e645f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.751231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.752836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.753534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.753984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.754847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.758945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.885423 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3244/6460] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:08 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:08.886373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.898924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6712-b0f1-487e-a6e5-002f9876fc26 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.904332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.904941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.905221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.905536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.909803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.909803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:08.920721 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3217/6461] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:08.925778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:08.943702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3198706-38c2-415e-8356-89dc3bb6f4ae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:08.951195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:08.951955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:08.952341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:08.952717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] PATH_INFO: `/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f/users/4eab7d0fbeb54cfb8da3b48a218eb280/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:08.971981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fb8da69bba45fb87f7434a2cd0a46f, user_id=4eab7d0fbeb54cfb8da3b48a218eb280, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:08.975041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.085188 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3245/6462] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:08 2022] PUT /identity/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f/users/4eab7d0fbeb54cfb8da3b48a218eb280/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:09.090465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.104436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad2d8-cd00-4443-a0ac-269d39d30e2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.226589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.228321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.228740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.229117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.229918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.232676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210ba9-2ef8-4767-ab21-0c0098112805 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.260745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3218/6463] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:09.264729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.278941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e3fc2-e69c-4ae5-91db-4710b06e79a1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.287778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.288839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.288839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.289939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] PATH_INFO: `/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f/users/4eab7d0fbeb54cfb8da3b48a218eb280/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.292477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fb8da69bba45fb87f7434a2cd0a46f, user_id=4eab7d0fbeb54cfb8da3b48a218eb280, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.295826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.307825 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3246/6464] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:09 2022] PUT /identity/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f/users/4eab7d0fbeb54cfb8da3b48a218eb280/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:09.318565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.318854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.319128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.359525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] MFA Rules not processed for user `4eab7d0fbeb54cfb8da3b48a218eb280`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:09.361133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:09.442245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3219/6465] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:09.447570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.460344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf19a-91dc-491a-a4af-0d17f2260c84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.482635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.485127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.485127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.485127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.485127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.486209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.602032 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3247/6466] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:09 2022] POST /identity/v3/services => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:09.606203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.618554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842afd3a-e145-4237-ab06-af94f07b9848 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.636489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.637238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.637615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.637962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.638702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.639799 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:09.639799 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:09.639799 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:09.640860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.719473 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1399540818. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:09.719473 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:09.719473 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:09.743688 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:09.872041 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3220/6467] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:45:09 2022] POST /identity/v3/endpoints => generated 361 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:09.873328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.900643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d2f86-2cb1-4725-ad2f-45ebff5bd14a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.931321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.931970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.932303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.932914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-1399540818` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.933615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1399540818)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.934495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:09.939367 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3248/6468] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:45:09 2022] GET /identity/v3/regions/tempest-region-1399540818 => generated 180 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:09.940934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:09.955180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd2ec-2739-44d7-a9b2-0b44c197fd9d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:09.961875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:09.962550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:09.962835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:09.963107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:09.963753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:09.965448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.074921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3221/6469] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:09 2022] POST /identity/v3/services => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:10.080368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.102345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49bda-8ecc-43cf-b57f-7093b63d79ec tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.118679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.120275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.120802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.121382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.123036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.124367 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:10.124367 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:10.124367 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.125728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.216897 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-66972779. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:10.216897 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:10.216897 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.339156 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3249/6470] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:45:10 2022] POST /identity/v3/endpoints => generated 358 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:10.340200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.354607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d589e9e-cd84-46f5-b911-f2d480c6ee8f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.402896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.403837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.404126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.404451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-66972779` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.405095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-66972779)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.406284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.408849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3222/6471] 10.222.0.13 () {58 vars in 1200 bytes} [Sun Oct 30 01:45:10 2022] GET /identity/v3/regions/tempest-region-66972779 => generated 176 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:10.413708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.436551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85111099-0eb2-4629-a7c7-3e6f09936772 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.448428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.449515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.450060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.450600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.451684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.458651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.586358 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-335515244. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:10.586358 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:10.586358 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.627990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.630074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:10.691044 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3250/6472] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:45:10 2022] POST /identity/v3/endpoints => generated 358 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:10.695263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.747117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c180-7e2e-4c54-9aec-d3c75c7efd81 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.761283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.762083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.762455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.762919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-335515244` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.763606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-335515244)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.766029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.774692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3251/6473] 10.222.0.13 () {58 vars in 1203 bytes} [Sun Oct 30 01:45:10 2022] GET /identity/v3/regions/tempest-region-335515244 => generated 178 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:10.775689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.777314 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:10.797906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1358894-a5e3-44eb-92c5-e83241274eaa tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.811459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.812332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.812718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.813617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffc337-f1ee-4746-b2f3-bf0c28495efb tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.814019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.815413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.817819 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:10.817819 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:10.817819 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.823238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.845906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c1f59536ef44328b9c56d5c4cf382df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90b37e316ca542ac915f7d27b062c171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.846752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3252/6474] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:45:10 2022] GET /identity/v3/endpoints => generated 4391 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:10.846864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.846864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.847146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.848195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.851895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:10.852324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.856422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.873077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cfa40-6421-4419-b8dd-e91805eee55f tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.876897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3223/6475] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:10.882873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.884284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.885648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.886132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.886607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.902799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=33d8c914f45d4b1db409c4cd42dd6092)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.905198 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:10.905198 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:10.905198 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.908694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fbecc-1d39-40b5-bd52-cf757166a731 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.911696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.913847 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3253/6476] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:10 2022] GET /identity/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092 => generated 358 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:10.916914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:10.922722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c1f59536ef44328b9c56d5c4cf382df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90b37e316ca542ac915f7d27b062c171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.923633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.925090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.925638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.928679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.933561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:10.948816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc534-55c4-4b06-a4e3-357b1a09ac2d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:10.960384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:10.961497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:10.961964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:10.962420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:10.965189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=33d8c914f45d4b1db409c4cd42dd6092)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:10.966618 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:10.966618 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:10.966618 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:10.967875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.068546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '33d8c914f45d4b1db409c4cd42dd6092', 'request_id': 'req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:11.084342 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3224/6477] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:10 2022] POST /identity/v3/projects => generated 347 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:11.087598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.097749 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3254/6478] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:10 2022] DELETE /identity/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:11.103313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.152943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddfbe2-c3e6-43ee-a3af-a331a0af9e90 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.174900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6456919-562b-4c4d-a681-9cf3c93b8f18 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.191922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c1f59536ef44328b9c56d5c4cf382df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90b37e316ca542ac915f7d27b062c171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.192536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.192814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.193085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.193803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:11.194109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.196261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.215983 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3225/6479] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:11.268724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.269448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.269791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.270172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.270855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.272629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.294905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3255/6480] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints => generated 4046 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:11.295755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.307384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add3f61-0c3e-46f4-86db-1d639192e648 tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.316369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.316369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.316369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.316706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.322290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Could not find endpoint: 33d8c914f45d4b1db409c4cd42dd6092.: keystone.exception.EndpointNotFound: Could not find endpoint: 33d8c914f45d4b1db409c4cd42dd6092. Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._iter().one() Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._only_one_row( Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:11.358607 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 33d8c914f45d4b1db409c4cd42dd6092. Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:11.360224 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:45:11.361552 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 33d8c914f45d4b1db409c4cd42dd6092. Oct 30 01:45:11.362559 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:11.364251 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3226/6481] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:11 2022] DELETE /identity/v3/endpoints/33d8c914f45d4b1db409c4cd42dd6092 => generated 114 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:45:11.369350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.393122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc893b-2d3e-4ecd-a7f0-136ec7533672 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.409840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.410766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.411376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.411841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-335515244` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.412612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-335515244)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.414834 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:11.414834 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:11.414834 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:11.416647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.509216 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3256/6482] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:45:11 2022] DELETE /identity/v3/regions/tempest-region-335515244 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:11.515616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.528325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e234a-89ab-4d7a-97cd-1e584744bef8 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.543457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.544162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.544535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.544994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.545803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.546848 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:11.546848 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:11.546848 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:11.547832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.566877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.569527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3227/6483] 10.222.0.13 () {58 vars in 1134 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints => generated 4046 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:11.580883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a89d0-019c-444c-9b12-90aad166b49c tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.589415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.590648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.590988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.591296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.591982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Adding query filter params (service_id=b9195d3a572d4669968545c3dff07e90) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:11.592291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.594912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.609105 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3257/6484] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints?service_id=b9195d3a572d4669968545c3dff07e90 => generated 503 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:11.610489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.627271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802273-c34a-4a82-8f5d-765d2d0f7643 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.665227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.665949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.666304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.666967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.667458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Adding query filter params (service_id=5caac1b9e4294281b44ef35e89c067b7) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:11.667773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.669861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.681386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3228/6485] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints?service_id=5caac1b9e4294281b44ef35e89c067b7 => generated 500 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:11.683456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.696521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d724c45-c9f8-47dd-a951-8482b898e08a tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.702749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.705371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.705371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.705371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.705371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:11.705371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.706954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.725066 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3258/6486] 10.222.0.13 () {58 vars in 1167 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:11.729372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.740602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddffc-f4f7-4bca-8e6c-59504bf40e66 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.760729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.761403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.761687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.761963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.762629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:11.762939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.764612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.785716 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3229/6487] 10.222.0.13 () {58 vars in 1171 bytes} [Sun Oct 30 01:45:11 2022] GET /identity/v3/endpoints?interface=internal => generated 475 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:11.786988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.802690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225a30-a1ac-413d-8bee-395717ce4689 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.811219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.812266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.812661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.813027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.813903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:11.815714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:11.933389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3259/6488] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:11 2022] POST /identity/v3/services => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:11.936784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:11.950433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65316490-24bd-4a51-a980-2c021e241763 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:11.997548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:11.998084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:11.998368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:11.998639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:11.999509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.001358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.118384 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-948362826. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:12.118384 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:12.118384 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:12.161075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.190898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a50e-fe1c-4ab8-98b9-497e611fa64d tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.219714 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3230/6489] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:45:11 2022] POST /identity/v3/endpoints => generated 359 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:12.220925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.234025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c1f59536ef44328b9c56d5c4cf382df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90b37e316ca542ac915f7d27b062c171', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.235007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.235780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.236290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] PATH_INFO: `/v3/projects/b1c402293a2849e3b466fde271bb607c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.238446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1c402293a2849e3b466fde271bb607c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.240572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.244952 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:12.267572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dde487-5a29-4934-9b58-d884c773d9e5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.280015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.281897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.283733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.284220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-948362826` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.285018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-948362826)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.291226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.294937 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3231/6490] 10.222.0.13 () {58 vars in 1203 bytes} [Sun Oct 30 01:45:12 2022] GET /identity/v3/regions/tempest-region-948362826 => generated 178 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:12.299504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.310811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0946a0-fd80-46c9-b853-3306925315ee tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.315685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.316521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.316819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.317118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/60b3a25370ec46969b3c6db2f5898dd0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.323119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=60b3a25370ec46969b3c6db2f5898dd0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.324148 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:12.324148 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:12.324148 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:12.325046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.353121 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:12.418163 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1478198686. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:12.418163 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:12.418163 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:12.423150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c402293a2849e3b466fde271bb607c', 'request_id': 'req-3791c3ef-6b69-4892-bedb-16990e55670f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.553798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c402293a2849e3b466fde271bb607c', 'request_id': 'req-3791c3ef-6b69-4892-bedb-16990e55670f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.563515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c402293a2849e3b466fde271bb607c', 'request_id': 'req-3791c3ef-6b69-4892-bedb-16990e55670f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.564202 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3232/6491] 10.222.0.13 () {60 vars in 1256 bytes} [Sun Oct 30 01:45:12 2022] PATCH /identity/v3/endpoints/60b3a25370ec46969b3c6db2f5898dd0 => generated 363 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:12.568535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.588155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] The token cache is being invalidate because project b1c402293a2849e3b466fde271bb607c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:12.588586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.589454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.596014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3260/6492] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:12 2022] DELETE /identity/v3/projects/b1c402293a2849e3b466fde271bb607c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:12.606016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.607882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:12.618047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4e1b-199d-4a33-86c2-0e01d7e30020 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.730696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c3ef-6b69-4892-bedb-16990e55670f tempest-RoutersAdminTest-1662023585 tempest-RoutersAdminTest-1662023585-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.758151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.759494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.759930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.760744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.762893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:12.782412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.782412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.782412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.782886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-1478198686` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.782886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1478198686)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.782886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.787130 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3233/6493] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:45:12 2022] GET /identity/v3/regions/tempest-region-1478198686 => generated 180 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:12.788131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.791124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:12.806483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382a385-567d-4cce-b2c3-6977448001af tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:12.814249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:12.815321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:12.815773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:12.816248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/60b3a25370ec46969b3c6db2f5898dd0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:12.824082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=60b3a25370ec46969b3c6db2f5898dd0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.825740 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:12.825740 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:12.825740 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:12.827635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.877647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:12.877647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:12.899630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3261/6494] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:12 2022] GET /identity/v3/auth/tokens => generated 4006 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:12.924200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '60b3a25370ec46969b3c6db2f5898dd0', 'request_id': 'req-900c5a80-9d61-4c14-b7e5-514f71c09568'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:12.943269 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3234/6495] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:12 2022] DELETE /identity/v3/endpoints/60b3a25370ec46969b3c6db2f5898dd0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:12.949362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:12.966839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f95de-f937-40c9-a9a1-c17129d3a3b3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.006691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.007334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.007676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.007946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-1478198686` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.008529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1478198686)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.010577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.034530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.034995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:13.083351 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1478198686. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:13.083351 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:13.083351 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:13.095989 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3262/6496] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:45:12 2022] DELETE /identity/v3/regions/tempest-region-1478198686 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:13.097261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.172881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc4f0-8e5b-407e-be3d-499fda946955 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.180396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.181097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.181417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.181699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-948362826` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.182288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-948362826)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.183886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.196203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c5a80-9d61-4c14-b7e5-514f71c09568 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.218404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.219183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.219571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.220005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] PATH_INFO: `/v3/users/b7ce9d9b570a40f09c12e13847dfcd7d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.221513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ce9d9b570a40f09c12e13847dfcd7d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.223859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.320569 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-948362826. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:13.320569 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:13.320569 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:13.334494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3263/6497] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/regions/tempest-region-948362826 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:13.339275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.366625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a5e64-5dbf-4bb5-8370-e43665716379 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.373193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.374127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.374481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.374788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services/4fadcafcf9bc495c8b1b328af1fdd623` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.375404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4fadcafcf9bc495c8b1b328af1fdd623)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.377774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.491488 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3264/6498] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/services/4fadcafcf9bc495c8b1b328af1fdd623 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:13.492966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.506788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ce9d9b570a40f09c12e13847dfcd7d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.509288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ce9d9b570a40f09c12e13847dfcd7d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.524593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2dc2d-e1ed-4641-9fd6-7ea6255daca4 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.528366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ce9d9b570a40f09c12e13847dfcd7d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.529382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ce9d9b570a40f09c12e13847dfcd7d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.530915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.531663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.532046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.532417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/ea3f656e84cf4984a20a7deadc104aaa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.557020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ea3f656e84cf4984a20a7deadc104aaa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.559693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.622006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9e524eb3-15f2-4d8f-9a36-184e54c1b016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ce9d9b570a40f09c12e13847dfcd7d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.657322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ea3f656e84cf4984a20a7deadc104aaa', 'request_id': 'req-34e6e808-1cd5-4f45-a43f-da63c916db84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:13.657629 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:13.677070 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3235/6499] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/users/b7ce9d9b570a40f09c12e13847dfcd7d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:13.680053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.680433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.680685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.683767 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3265/6500] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/endpoints/ea3f656e84cf4984a20a7deadc104aaa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:13.690406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.715859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:13.739875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:13.746974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:13.766833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6e808-1cd5-4f45-a43f-da63c916db84 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:13.862267 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:13.897065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:13.897778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:13.898089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:13.898362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-66972779` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:13.898972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-66972779)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:13.900602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:13.911606 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3236/6501] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:13 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:13.920248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:13.921971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:13.991696 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3266/6502] 10.222.0.13 () {58 vars in 1203 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/regions/tempest-region-66972779 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:13.994417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.040599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34b6e1-24e4-4234-b54c-fbee5bfa0531 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.051503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.057178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.057178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.057178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services/5caac1b9e4294281b44ef35e89c067b7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.057178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5caac1b9e4294281b44ef35e89c067b7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.057178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.075730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1770a48-018d-414b-b304-8fb0f87f99ac None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.104106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.107707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.107707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.107707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.134019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.134019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.172356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3237/6503] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:14.195879 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3267/6504] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:13 2022] DELETE /identity/v3/services/5caac1b9e4294281b44ef35e89c067b7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:14.199938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.215617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c712a7-d903-4f37-bcc7-e6a320ec5cbc service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.228655 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:14.267084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.267312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.267601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.267825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/endpoints/755d9b6fd12b41f091c6140cfb8dd010` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.297079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=755d9b6fd12b41f091c6140cfb8dd010)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.298875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.408575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '755d9b6fd12b41f091c6140cfb8dd010', 'request_id': 'req-54dc00dc-af02-4f7f-a7c6-da54680de626'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:14.430140 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3238/6505] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:45:14 2022] DELETE /identity/v3/endpoints/755d9b6fd12b41f091c6140cfb8dd010 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:14.433886 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:14.439745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.455566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7490a6-77ca-4acd-a6bf-57ac35e099a5 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.492411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.493066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.504031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.504031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/regions/tempest-region-1399540818` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.504031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1399540818)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.517939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.608241 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1399540818. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:45:14.608241 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:45:14.608241 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:14.621863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3268/6506] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:45:14 2022] DELETE /identity/v3/regions/tempest-region-1399540818 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:14.624165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.641217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc00dc-af02-4f7f-a7c6-da54680de626 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.661276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab7d0fbeb54cfb8da3b48a218eb280', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.661914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.662238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.662567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] PATH_INFO: `/v3/services/b9195d3a572d4669968545c3dff07e90` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.663161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b9195d3a572d4669968545c3dff07e90)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.664347 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:14.664347 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:14.664347 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:14.665369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.759608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.763866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:14.808249 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3239/6507] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:14 2022] DELETE /identity/v3/services/b9195d3a572d4669968545c3dff07e90 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:14.810576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:14.821971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:14.831135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e20e1-51b6-4421-a04c-6b8c8e0adc95 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.855340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.856106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.856381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.856761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70be445-98eb-4f9e-b90e-4d5adfe3d008 tempest-EndPointsTestJSON-363897178 tempest-EndPointsTestJSON-363897178-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:14.857056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] PATH_INFO: `/v3/projects/b40ddceed16d4ddba4106f867affbeb0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.858843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40ddceed16d4ddba4106f867affbeb0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.862168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:14.873831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:14.874492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:14.879334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:14.879334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] PATH_INFO: `/v3/users/843c54ab125349bf94ed821432cb276c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:14.899340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843c54ab125349bf94ed821432cb276c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:14.901406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:15.002456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40ddceed16d4ddba4106f867affbeb0', 'request_id': 'req-7cf09a18-0a06-406e-941d-099f85d671d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.075611 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:15.135724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40ddceed16d4ddba4106f867affbeb0', 'request_id': 'req-7cf09a18-0a06-406e-941d-099f85d671d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.143449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40ddceed16d4ddba4106f867affbeb0', 'request_id': 'req-7cf09a18-0a06-406e-941d-099f85d671d0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.155290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] The token cache is being invalidate because project b40ddceed16d4ddba4106f867affbeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:15.155466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.156148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7cf09a18-0a06-406e-941d-099f85d671d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.157860 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3269/6508] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:14 2022] DELETE /identity/v3/projects/b40ddceed16d4ddba4106f867affbeb0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:15.162769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a40f-d186-4461-94f6-ffa78cc4ea7f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.165733 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:15.174014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a40f-d186-4461-94f6-ffa78cc4ea7f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.174014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a40f-d186-4461-94f6-ffa78cc4ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.208336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843c54ab125349bf94ed821432cb276c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.211055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843c54ab125349bf94ed821432cb276c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.222386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4608a40f-d186-4461-94f6-ffa78cc4ea7f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:15.224592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4608a40f-d186-4461-94f6-ffa78cc4ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:15.225716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843c54ab125349bf94ed821432cb276c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.227193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843c54ab125349bf94ed821432cb276c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.320389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3270/6509] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:15.327734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.328120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.328392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.349002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:15.350247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:15.358952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e4d90f34-dc39-47c9-8a58-f6ba735add51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843c54ab125349bf94ed821432cb276c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:15.362719 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3271/6510] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:15.363601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:15.373855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7105-10c3-48ad-991d-0603abbb84c3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:15.378997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:15.379663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.379931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.380201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.380858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:15.381162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:15.383134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:15.396047 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3272/6511] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:15.399825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3240/6512] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:14 2022] DELETE /identity/v3/users/843c54ab125349bf94ed821432cb276c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:15.400646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:15.403647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.404474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.405066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.421323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b43e-a8c0-4998-a868-156f42463675 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:15.431749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:15.434002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:15.516356 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3241/6513] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:15.526053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:15.527875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:15.528006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:15.530142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.531420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.532039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.534034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:15.538772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:15.623566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da3963-3776-4e8a-8e26-2964acbba079 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:15.627554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:15.628265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.628613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.629104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.641475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:15.642725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:15.655688 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3242/6514] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:45:15.715651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3273/6515] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:15 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:15.719180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:15.732965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77238f-af46-48a0-82ee-430e80efc3df service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:15.812623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:15.812623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.813090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.813309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.814042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:15.817790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:15.965167 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3243/6516] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:15 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:15.966440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:15.984200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3be0f-5fd8-4558-8b76-1d4899cb4edb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:15.989982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:15.990607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:15.990912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:15.991243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:15.993024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:15.994655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.014410 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3274/6517] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:16.015807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.038028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c801063-d9e4-43bb-87a2-de216ac7ed8c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.044870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.045825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.046545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.047055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.047934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.049815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.069406 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=10,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:16.082813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.098435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3077-a605-417e-b800-b684943f394a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.099417 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3244/6518] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:16.115972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.119760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.120216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.120617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] PATH_INFO: `/v3/projects/b20d8e9488bb4cc4abbc496b617e70e9/users/7eb6d188d23941019fb09d0ccf68faa3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.130478 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:16.162764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20d8e9488bb4cc4abbc496b617e70e9, user_id=7eb6d188d23941019fb09d0ccf68faa3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.175998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ee1a1-0799-4042-ba9c-d5bb05d92f0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.281779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.283451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:16.287880 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3275/6519] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:16 2022] PUT /identity/v3/projects/b20d8e9488bb4cc4abbc496b617e70e9/users/7eb6d188d23941019fb09d0ccf68faa3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:16.301100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.301733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.302168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.308003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a68f2d-a9ae-46d9-8d1a-4c182e76a079 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.386919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] MFA Rules not processed for user `7eb6d188d23941019fb09d0ccf68faa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:16.401906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:16.405934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.406631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.407688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.407964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] PATH_INFO: `/v3/projects/fda40567743b44b29b771fbb2360c46c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.410431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda40567743b44b29b771fbb2360c46c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.428358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.551108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3276/6520] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:16.556021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.568510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c91b-c75d-457e-990b-e8bf0b192146 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.573607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.574425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.574762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.577045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.577045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.577906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.639461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda40567743b44b29b771fbb2360c46c', 'request_id': 'req-bad693b2-d50f-4ac2-84be-b64c0caf1847'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:16.645226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda40567743b44b29b771fbb2360c46c', 'request_id': 'req-bad693b2-d50f-4ac2-84be-b64c0caf1847'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:16.707744 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3277/6521] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:16 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:16.712309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.770034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda40567743b44b29b771fbb2360c46c', 'request_id': 'req-bad693b2-d50f-4ac2-84be-b64c0caf1847'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:16.776723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13382e-126c-465a-9df3-2cb83b566783 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.781608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.782215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.782640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.782921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.783114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] The token cache is being invalidate because project fda40567743b44b29b771fbb2360c46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:16.783381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:16.783548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.784049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:16.785581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.785708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3245/6522] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:16 2022] DELETE /identity/v3/projects/fda40567743b44b29b771fbb2360c46c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:16.790408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.791698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:16.869583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad693b2-d50f-4ac2-84be-b64c0caf1847 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.875453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.878306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.878741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.879126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] PATH_INFO: `/v3/users/4eab7d0fbeb54cfb8da3b48a218eb280` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.880725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eab7d0fbeb54cfb8da3b48a218eb280)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.885554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.927667 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3278/6523] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:16 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:16.929347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.931467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:16.952587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e73b5-599c-4db9-9e51-3087a5729db9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.958761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.959488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:16.959893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:16.961171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:16.962900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:16.964674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:16.981068 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3279/6524] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:16.982444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:16.993593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec835d-c050-4625-ae4d-150e8e1b26b3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:16.998575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:16.999751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:17.000138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:17.000517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] PATH_INFO: `/v3/projects/2003ee26604d489392c48b85204f94d4/users/37c732d3c30e445ca29137d5ea671759/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:17.018684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2003ee26604d489392c48b85204f94d4, user_id=37c732d3c30e445ca29137d5ea671759, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:17.021782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318c48a-0b08-498c-b1b6-7eb555b6dceb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:17.028313 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:17.099438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eab7d0fbeb54cfb8da3b48a218eb280'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:17.100134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eab7d0fbeb54cfb8da3b48a218eb280'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:17.107906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eab7d0fbeb54cfb8da3b48a218eb280'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:17.110784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eab7d0fbeb54cfb8da3b48a218eb280'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:17.140676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3280/6525] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:16 2022] PUT /identity/v3/projects/2003ee26604d489392c48b85204f94d4/users/37c732d3c30e445ca29137d5ea671759/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:17.147078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:17.147360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:17.147635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:17.177045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] MFA Rules not processed for user `37c732d3c30e445ca29137d5ea671759`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:17.178406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:17.193101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eab7d0fbeb54cfb8da3b48a218eb280'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:17.214549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3246/6526] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:16 2022] DELETE /identity/v3/users/4eab7d0fbeb54cfb8da3b48a218eb280 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:17.259974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3281/6527] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:17.346761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:17.348457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:17.434559 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:17.495128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0055a-58b3-4309-83c5-add735206550 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:17.504154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:17.504822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:17.505067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:17.505359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:17.574053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:17.575672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e047-fad3-487c-94ee-1210aa0abaec service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:17.586822 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3247/6528] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:45:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:45:17.844252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:17.845733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:17.925529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2a297-fa06-494e-85cb-4ffc6962f514 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:17.984385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:17.984938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:17.985223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:17.985529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] PATH_INFO: `/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:17.986664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fb8da69bba45fb87f7434a2cd0a46f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:17.988600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:18.188184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'request_id': 'req-f5bb810c-42ec-4411-a301-a6d81dc87515'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:18.289252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'request_id': 'req-f5bb810c-42ec-4411-a301-a6d81dc87515'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:18.296884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fb8da69bba45fb87f7434a2cd0a46f', 'request_id': 'req-f5bb810c-42ec-4411-a301-a6d81dc87515'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:18.325160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] The token cache is being invalidate because project d6fb8da69bba45fb87f7434a2cd0a46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:18.325490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:18.326212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5bb810c-42ec-4411-a301-a6d81dc87515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:18.328242 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3282/6529] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:17 2022] DELETE /identity/v3/projects/d6fb8da69bba45fb87f7434a2cd0a46f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:18.333172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:18.334029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:18.334508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:18.367504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:18.371678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:18.428599 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:18.472513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3248/6530] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:18.475015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:18.475569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:18.476103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:18.501153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:18.503298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:18.521777 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3283/6531] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:18.523395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:18.537567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a623a53-0487-42d4-8f62-18039d45719f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:18.564088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:18.567659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:18.567659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:18.567659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:18.567659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:18.567659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:18.571383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:18.609490 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3249/6532] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:18.612893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:18.626332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb223e8-ccfb-4b84-8914-63ce8846959e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:18.639336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:18.640032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:18.640385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:18.640761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:18.641687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:18.649791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:18.740178 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:18.799778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3284/6533] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:18 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:18.804187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:18.818676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a990d-9b8d-478b-9b87-2427cb17aeee admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:18.932697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:18.933322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:18.933635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:18.933911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:18.934568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:18.936545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:19.103710 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3250/6534] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:18 2022] POST /identity/v3/users => generated 282 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:19.108026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:19.119677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2be8be-d9e2-4852-b86d-b1f57116eb28 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:19.126971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:19.128041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.135158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.135158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.135158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:19.135158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:19.144301 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3285/6535] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:19.149123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:19.161256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d4c83-e817-4046-9da3-1301db755288 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:19.167294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:19.167918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.168213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.168605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.169253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:19.171380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf9fb-2e64-42e4-97a6-cfb499787111 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:19.189400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3251/6536] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:19.190482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:19.202347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6765-77cb-4749-aae7-90a3add0f0fb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:19.207257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:19.208152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.208817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.209262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] PATH_INFO: `/v3/projects/24b84d8749f040a0a368b80706f1aa49/users/cd393242495e437eb27939d5c7f7ccb4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.231242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b84d8749f040a0a368b80706f1aa49, user_id=cd393242495e437eb27939d5c7f7ccb4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:19.235998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:19.345265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.351534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.351534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.352048 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3286/6537] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:19 2022] PUT /identity/v3/projects/24b84d8749f040a0a368b80706f1aa49/users/cd393242495e437eb27939d5c7f7ccb4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:19.384537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] MFA Rules not processed for user `cd393242495e437eb27939d5c7f7ccb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:19.386289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:19.563306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:19.577646 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3252/6538] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:19.633565 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:19.682011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54228e99-c389-4089-9725-4225a48b6aa2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:19.689036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:19.689833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.690105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.690378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.691196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:19.697872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:19.857843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3287/6539] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:19 2022] POST /identity/v3/projects => generated 367 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:19.859534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:19.884291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857fc74-1ecd-4736-bcc5-e7579c57989b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:19.983419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:19.984126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:19.984407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:19.984673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:19.985594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:19.987413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.068010 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:20.109199 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3253/6540] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:19 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:20.110664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.122880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da9932-9d93-4883-a0a9-3068e5906bed admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.134936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.135565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.135847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.136125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.137088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.138719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.154323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3288/6541] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:20.156526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.171281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588de8a-4242-414f-aeab-dc12e184e50b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.187885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.188669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.189076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.189490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] PATH_INFO: `/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2/users/f693607c8b73490c9cdec17811fb95d7/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.217925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe3cdbbe52d4e20bf8a9f297740d1c2, user_id=f693607c8b73490c9cdec17811fb95d7, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.221512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.301205 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3254/6542] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:20 2022] PUT /identity/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2/users/f693607c8b73490c9cdec17811fb95d7/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:20.305972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.318322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a7aa-612c-46ad-84b2-c7d2d9cd5567 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.437950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.438514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.439010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.439443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.440485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.443252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dea7be-0d32-47ac-8e9b-bbdc03fe0672 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.456578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3289/6543] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:20.461113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.474005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdeef5-0cb9-4418-888a-5f52ef7066b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.481058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.482329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.486581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.486581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] PATH_INFO: `/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2/users/f693607c8b73490c9cdec17811fb95d7/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.486820 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:20.486936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe3cdbbe52d4e20bf8a9f297740d1c2, user_id=f693607c8b73490c9cdec17811fb95d7, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.488925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.503697 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3255/6544] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:20 2022] PUT /identity/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2/users/f693607c8b73490c9cdec17811fb95d7/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:20.521107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326441-e47a-45c3-a390-1843a85282fe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.521679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326441-e47a-45c3-a390-1843a85282fe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.522108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326441-e47a-45c3-a390-1843a85282fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.561216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-35326441-e47a-45c3-a390-1843a85282fe None None] MFA Rules not processed for user `f693607c8b73490c9cdec17811fb95d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:20.562538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-35326441-e47a-45c3-a390-1843a85282fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:20.636780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3290/6545] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:20.641255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.657095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6051c-e6d8-479b-a09e-64bb4ca47b16 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.662416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.663340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.664309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.664740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.665546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.667766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.734974 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3256/6546] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:20 2022] POST /identity/v3/roles => generated 234 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:20.739165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35326441-e47a-45c3-a390-1843a85282fe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.754192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35326441-e47a-45c3-a390-1843a85282fe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.770154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.770943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.771845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.772133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.773606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.777603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:20.912113 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3291/6547] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:20 2022] POST /identity/v3/roles => generated 235 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:20.913966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:20.924627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a5bfa-8d4d-4fa6-be79-17060777fbad tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:20.930685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:20.931446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:20.932011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:20.932426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:20.933192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:20.934910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.060134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.061919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:21.131811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec8f5-028d-47a8-831d-76e0a0ddd81a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.136455 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3257/6548] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:20 2022] POST /identity/v3/roles => generated 235 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:21.137711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.138454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.138747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.139074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] PATH_INFO: `/v3/users/7eb6d188d23941019fb09d0ccf68faa3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.140546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb6d188d23941019fb09d0ccf68faa3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.140766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.142490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.151872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638cdf-ab3f-4958-9a7b-b1a2370777d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.167264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.168040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.168333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.168615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.169284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.171540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.275826 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3258/6549] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:45:21 2022] POST /identity/v3/domains => generated 277 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:21.280066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.347225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da11f0b-0c1e-4305-ae8b-02293ee17540 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.352859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.353519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.353805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.354081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.354709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.356959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.393298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb6d188d23941019fb09d0ccf68faa3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:21.458686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3259/6550] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:21 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:21.463495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.472857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb6d188d23941019fb09d0ccf68faa3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:21.473635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb6d188d23941019fb09d0ccf68faa3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:21.496420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb6d188d23941019fb09d0ccf68faa3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:21.514856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59baa0ad-f854-4a67-b3d1-4ebc735b3a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb6d188d23941019fb09d0ccf68faa3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:21.530174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3292/6551] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:21 2022] DELETE /identity/v3/users/7eb6d188d23941019fb09d0ccf68faa3 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:21.531565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.531847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.532126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.556243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:21.557655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:21.565137 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:21.573783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1eb7d-f4a1-42a4-a084-baebe051460f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.683311 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3293/6552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:21.695359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.699304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:21.703401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.704032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.704315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.704590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/groups` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.708985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.713520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.771033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9770f-d372-429a-bbdb-788f7ecb5a24 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.776464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.777108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.777429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.777731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.797809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.799647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:21.810753 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3294/6553] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:21.818794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3260/6554] 10.222.0.13 () {60 vars in 1147 bytes} [Sun Oct 30 01:45:21 2022] POST /identity/v3/groups => generated 300 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:21.823386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:21.825531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:21.844788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20fe8-e89f-4838-ab32-5cb6b9462258 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:21.852223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:21.852903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:21.853192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:21.853531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:21.855546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:21.859592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.000073 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3295/6555] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:21 2022] POST /identity/v3/roles => generated 235 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:22.004772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.024389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c8a75-756e-47f6-90b7-710d0d43e4c4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.024389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.024678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.024958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.025237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.025972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.028357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.143945 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3261/6556] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:22 2022] POST /identity/v3/users => generated 436 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:22.150588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.166354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7263-4030-4cb8-a5e3-4b1284fe1cb5 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.181313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.182271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.182561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.182843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.183706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.184724 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:22.184724 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:22.184724 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:22.185844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.282752 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3296/6557] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:22 2022] POST /identity/v3/roles => generated 270 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:22.286931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.298801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abfb88-80fe-4aa8-aab3-1009d231476f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.305006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.306563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.307065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.307422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/40159f6a95124a7abc2f31bfe0f76bd6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.326834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=40159f6a95124a7abc2f31bfe0f76bd6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.329901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.469622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.477121 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3262/6558] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:22 2022] PUT /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/40159f6a95124a7abc2f31bfe0f76bd6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:22.486268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8b83a-7ea3-4506-b648-da16e7d3e6b7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.566305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.566926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.567209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.567517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.568217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Adding query filter params (scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4, user.id=d1e96776526a4c3c848f285a116d7d9f) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:22.568836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.576051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.636725 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3297/6559] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:45:22 2022] GET /identity/v3/role_assignments?scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4&user.id=d1e96776526a4c3c848f285a116d7d9f&effective => generated 228 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:22.638042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.649316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98066-7fba-4955-82db-a30cb609849f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.656000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.656000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.656000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.656458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/40159f6a95124a7abc2f31bfe0f76bd6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.658500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=40159f6a95124a7abc2f31bfe0f76bd6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.662062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.670427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 40159f6a95124a7abc2f31bfe0f76bd6 was removed from user d1e96776526a4c3c848f285a116d7d9f on project c58093f6acb445f5be34d8bdfa93f6b4. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:22.671026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:22.673825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:22.794319 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3263/6560] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:45:22 2022] DELETE /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/40159f6a95124a7abc2f31bfe0f76bd6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:22.798620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:22.800499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:22.814904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f819-5b67-4332-a4bf-03e084f4ecea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:22.902757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:22.903599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:22.903984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:22.904322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/40159f6a95124a7abc2f31bfe0f76bd6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:22.905627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=40159f6a95124a7abc2f31bfe0f76bd6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:22.906818 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:22.906818 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:22.906818 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:22.907880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:22.962591 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:23.051671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 40159f6a95124a7abc2f31bfe0f76bd6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:23.052132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.052803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.056082 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3298/6561] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:22 2022] DELETE /identity/v3/roles/40159f6a95124a7abc2f31bfe0f76bd6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:23.060881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.072917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31728e67-d0ad-4f03-8f30-6a2b15542236 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.143833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.144598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.144993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.145398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/24024778a0c44f75b5837f08c88ad3e7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.148454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=24024778a0c44f75b5837f08c88ad3e7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.155215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.158764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.160176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:23.233085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720899d7-a6a3-4048-8802-de008f0c5cc8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.243778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.244414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.244795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.245274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] PATH_INFO: `/v3/projects/b20d8e9488bb4cc4abbc496b617e70e9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.247265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20d8e9488bb4cc4abbc496b617e70e9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.249986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.274543 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3264/6562] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:23 2022] PUT /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/24024778a0c44f75b5837f08c88ad3e7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:23.277165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.279459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:23.401455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20d8e9488bb4cc4abbc496b617e70e9', 'request_id': 'req-b9676660-d9b0-4271-9320-4a0ef8fe90ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.429480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a7cae-7a03-4cf9-8bbb-4bf12f47fcdf tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.494883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.495827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.496112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.496395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.498120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.499145 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:23.499145 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:23.499145 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:23.500038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.558175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20d8e9488bb4cc4abbc496b617e70e9', 'request_id': 'req-b9676660-d9b0-4271-9320-4a0ef8fe90ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.568209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20d8e9488bb4cc4abbc496b617e70e9', 'request_id': 'req-b9676660-d9b0-4271-9320-4a0ef8fe90ab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.600559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] The token cache is being invalidate because project b20d8e9488bb4cc4abbc496b617e70e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:23.601541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.602302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:23.604485 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3299/6563] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:23 2022] DELETE /identity/v3/projects/b20d8e9488bb4cc4abbc496b617e70e9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:23.608482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.610517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:23.622146 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3265/6564] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:23 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 520 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:23.623684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.626323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:23.737846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdeb31-6cab-43f7-addf-156905e2568c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.752772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.753968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.754328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.754938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.755930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Adding query filter params (scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4, user.id=d1e96776526a4c3c848f285a116d7d9f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:23.756654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.760029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.773562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9676660-d9b0-4271-9320-4a0ef8fe90ab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.857686 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3266/6565] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:45:23 2022] GET /identity/v3/role_assignments?scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4&user.id=d1e96776526a4c3c848f285a116d7d9f&effective => generated 1061 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:23.863141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:23.887181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06733-e18b-44db-8819-fe121c89a725 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:23.901645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.902418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.905082 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:23.906040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.906411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.909795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.910902 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:23.910902 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:23.910902 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:23.912262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.916430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:23.918297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:23.918297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:23.918769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] PATH_INFO: `/v3/users/37c732d3c30e445ca29137d5ea671759` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:23.920226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c732d3c30e445ca29137d5ea671759)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:23.923096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:23.995922 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3267/6566] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:23 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:24.000645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.114733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bff58-ff90-4b03-8141-cdd574e2718d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.120759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.121401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.121686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.121971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.122751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Adding query filter params (scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4, user.id=d1e96776526a4c3c848f285a116d7d9f) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:24.123060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.125553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.167515 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:24.188156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c732d3c30e445ca29137d5ea671759'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.207681 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3268/6567] 10.222.0.13 () {58 vars in 1356 bytes} [Sun Oct 30 01:45:23 2022] GET /identity/v3/role_assignments?scope.project.id=c58093f6acb445f5be34d8bdfa93f6b4&user.id=d1e96776526a4c3c848f285a116d7d9f&effective => generated 577 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:24.208435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.227835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bc616-fbcb-433e-81fe-4faf7f71b8b3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.236081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.236992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.236992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.237169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.239629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.243104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f.: keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = query.one() Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._iter().one() Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._only_one_row( Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:24.256892 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:24.258886 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 30 01:45:24.260110 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 30 01:45:24.260110 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 30 01:45:24.260110 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 30 01:45:24.260110 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:24.260110 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:24.263791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3269/6568] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:24 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 137 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:45:24.265162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.277043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccc11c-47d9-4d1b-aa26-b8c4227e1cdb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.284892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c732d3c30e445ca29137d5ea671759'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.285368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.288240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c732d3c30e445ca29137d5ea671759'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.288359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.288359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.288359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/24024778a0c44f75b5837f08c88ad3e7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.290291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=24024778a0c44f75b5837f08c88ad3e7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.294094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.304917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 24024778a0c44f75b5837f08c88ad3e7 was removed from user d1e96776526a4c3c848f285a116d7d9f on project c58093f6acb445f5be34d8bdfa93f6b4. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:24.306263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.307685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.321981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c732d3c30e445ca29137d5ea671759'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.330944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c732d3c30e445ca29137d5ea671759'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:24.343506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3300/6569] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:23 2022] DELETE /identity/v3/users/37c732d3c30e445ca29137d5ea671759 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:24.405483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3270/6570] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:45:24 2022] DELETE /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/24024778a0c44f75b5837f08c88ad3e7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:24.410457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.411984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:24.498614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe255-4a31-4d79-b71e-283c4c352d8a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.595321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.596025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.596385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.596824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.597679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.599496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.734662 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3301/6571] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:24 2022] POST /identity/v3/roles => generated 272 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:24.735942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.737464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:24.755473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a1b40-8f24-4db8-be1b-999a4a37019e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.765909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.766651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.766978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.767313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.768105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Adding query filter params (domain_id=a260feb8a6944df69cae7904ed7a86b0) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:24.768488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.769679 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:24.769679 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:24.769679 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:24.770924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.785765 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3271/6572] 10.222.0.13 () {58 vars in 1207 bytes} [Sun Oct 30 01:45:24 2022] GET /identity/v3/roles?domain_id=a260feb8a6944df69cae7904ed7a86b0 => generated 409 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:24.787070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.802730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578e160-4525-46ff-95ff-a28d43ed10a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:24.810645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:24.811468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:24.811743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:24.812014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/e200eec2ce0d4657a91edc61d41a2c51` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:24.813498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=e200eec2ce0d4657a91edc61d41a2c51)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:24.815205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:24.889938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:24.895196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.030381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f3606-2a99-4858-aa06-465c46e85b2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.034349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role e200eec2ce0d4657a91edc61d41a2c51 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:25.035279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.035949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.036240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.038040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.039764 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3302/6573] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:24 2022] DELETE /identity/v3/roles/e200eec2ce0d4657a91edc61d41a2c51 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.042913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.043436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] PATH_INFO: `/v3/projects/2003ee26604d489392c48b85204f94d4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.043699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.044913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2003ee26604d489392c48b85204f94d4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.045063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.047086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.141006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275df0-067e-4b6f-9a90-52730dec1984 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.146750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.148216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.148604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.148990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.149941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Adding query filter params (domain_id=a260feb8a6944df69cae7904ed7a86b0) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:25.151264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.152460 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:25.152460 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:25.152460 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:25.153835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.165234 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3303/6574] 10.222.0.13 () {58 vars in 1207 bytes} [Sun Oct 30 01:45:25 2022] GET /identity/v3/roles?domain_id=a260feb8a6944df69cae7904ed7a86b0 => generated 148 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:25.166622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.178640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ed6ae-a612-42a3-a549-ad3ef5d206b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.188805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2003ee26604d489392c48b85204f94d4', 'request_id': 'req-7c3c1b2e-5451-4a84-85f4-c17a707e528f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.196632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2003ee26604d489392c48b85204f94d4', 'request_id': 'req-7c3c1b2e-5451-4a84-85f4-c17a707e528f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.276505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.277522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.278166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.278678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/e200eec2ce0d4657a91edc61d41a2c51` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.292004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:45:25.295971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2003ee26604d489392c48b85204f94d4', 'request_id': 'req-7c3c1b2e-5451-4a84-85f4-c17a707e528f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Could not find role: e200eec2ce0d4657a91edc61d41a2c51.: keystone.exception.RoleNotFound: Could not find role: e200eec2ce0d4657a91edc61d41a2c51. Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 30 01:45:25.298611 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:45:25.300774 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: e200eec2ce0d4657a91edc61d41a2c51. Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:45:25.302144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3304/6575] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:25 2022] DELETE /identity/v3/roles/e200eec2ce0d4657a91edc61d41a2c51 => generated 110 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:45:25.308569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.320416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701636c0-e530-4857-8973-91d738d10636 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.325832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.326505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.326863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.327139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.334016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] The token cache is being invalidate because project 2003ee26604d489392c48b85204f94d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:25.334016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.334710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.336070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7c3c1b2e-5451-4a84-85f4-c17a707e528f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.341830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3272/6576] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:24 2022] DELETE /identity/v3/projects/2003ee26604d489392c48b85204f94d4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.341933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.342744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617132-27f8-429e-94f0-1a520a4cfa63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.344191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617132-27f8-429e-94f0-1a520a4cfa63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.344191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0617132-27f8-429e-94f0-1a520a4cfa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.367295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b0617132-27f8-429e-94f0-1a520a4cfa63 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:25.368917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b0617132-27f8-429e-94f0-1a520a4cfa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.417523 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3305/6577] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:25 2022] PUT /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.421494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.428040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.475462 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3273/6578] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:25.477912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.478357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.478725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.504685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:25.506318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.526448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b112-7212-4220-a108-705e8905a7ea tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.538932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.538932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.538932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.539224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.540452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a260feb8a6944df69cae7904ed7a86b0, group_id=ff68c1e6364646f9a26cbabc99cac833)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.543643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.567509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3306/6579] 10.222.0.13 () {58 vars in 1365 bytes} [Sun Oct 30 01:45:25 2022] GET /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles => generated 410 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:25.567509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.577233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686cb0-714e-4869-bc03-b504f03f170e tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.586920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.587772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.588193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.589002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.591648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.592848 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:25.592848 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:25.592848 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:25.603571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.603658 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3274/6580] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:25.604438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.605884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3307/6581] 10.222.0.13 () {58 vars in 1465 bytes} [Sun Oct 30 01:45:25 2022] HEAD /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.610747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.625662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f3ebb-9245-4cb2-ba52-7767b66e81c1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.634634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318226-84dc-402f-8a74-91258113fb22 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.640286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.641469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.641989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.642552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.642675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.643303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.643752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.643879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.644538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:25.644795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.646735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.650083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.654160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.660769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role be4a2bc97ad341e694328f453bf1b33e was removed from group ff68c1e6364646f9a26cbabc99cac833 on domain a260feb8a6944df69cae7904ed7a86b0. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:25.661626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.663241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:25.675737 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:25.691913 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3275/6582] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:25.693902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.698444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.732672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eabea8-bf6d-4334-a730-62cca9c3b232 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.738055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.738663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.739292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.739574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.740365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.742814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.759734 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3308/6583] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:45:25 2022] DELETE /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.766961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.768934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:25.851225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6763b6-881c-4c35-8584-e18d6e0c25d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:25.858281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:25.859297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:25.859586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:25.859874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:25.863255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:25.866863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:25.873736 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3276/6584] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:25 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:25.879497 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:25.882910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.961402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3309/6585] 10.222.0.13 () {60 vars in 1486 bytes} [Sun Oct 30 01:45:25 2022] PUT /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:25.968636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:25.968866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712175-a411-40ca-a193-ead167cf512a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.040288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.040900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.041180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.041480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.042153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.044088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.071045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92f1c5-0136-452b-a6aa-b5958c563f6a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.077709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.078417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.078703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.078978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.080734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c58093f6acb445f5be34d8bdfa93f6b4, group_id=ff68c1e6364646f9a26cbabc99cac833)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.085901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.099287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3310/6586] 10.222.0.13 () {58 vars in 1368 bytes} [Sun Oct 30 01:45:25 2022] GET /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles => generated 411 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:26.104321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.117939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc7a6-87de-400a-92ad-1466b62465bb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.125946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.126690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.127037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.127312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/groups/ff68c1e6364646f9a26cbabc99cac833/users/d1e96776526a4c3c848f285a116d7d9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.129064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ff68c1e6364646f9a26cbabc99cac833, user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.130127 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:26.130127 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:26.130127 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:26.131476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6167ea4-7426-4af8-9896-45d1a2f85f4a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.142972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3277/6587] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:25 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:26.147716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.162557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eeb40-8673-4691-9323-e02aa1c567d8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.170798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.170798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.170798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.171338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.172045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.174242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.188898 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3278/6588] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:26 2022] GET /identity/v3/roles => generated 2323 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:26.193036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.204137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c74a8-68d8-4942-9393-0f09313e8c0f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.209516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.210428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.210786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.211156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.211875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.213575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.227596 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3279/6589] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:26 2022] GET /identity/v3/roles => generated 2323 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:26.228638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3311/6590] 10.222.0.13 () {60 vars in 1360 bytes} [Sun Oct 30 01:45:26 2022] PUT /identity/v3/groups/ff68c1e6364646f9a26cbabc99cac833/users/d1e96776526a4c3c848f285a116d7d9f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:26.232061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.233933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.234380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.234747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.243212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69119ef-f18b-40f2-a7ab-1e477ea163c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.292145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] MFA Rules not processed for user `d1e96776526a4c3c848f285a116d7d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:26.293492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:26.312290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.313267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.313844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.314287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] PATH_INFO: `/v3/projects/73f4af2d7cc742b98447e28e3c204c11/users/9c53d510d75542a283b7f851a58d3dbf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.330818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f4af2d7cc742b98447e28e3c204c11, user_id=9c53d510d75542a283b7f851a58d3dbf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.334799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466498a-6de0-4569-8bff-cfae81a5ea2d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.402638 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3280/6591] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:26 2022] PUT /identity/v3/projects/73f4af2d7cc742b98447e28e3c204c11/users/9c53d510d75542a283b7f851a58d3dbf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:26.404648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.404940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.405222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.406142 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3312/6592] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:26.410835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.437777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] MFA Rules not processed for user `9c53d510d75542a283b7f851a58d3dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:26.439390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:26.482627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4756b8-42c1-49a3-9eed-be1a2bebd1cc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.525206 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3281/6593] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:26.533551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.562672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.563744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.564106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.564443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.569921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.572674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.584793 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:26.586724 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3313/6594] 10.222.0.13 () {58 vars in 1468 bytes} [Sun Oct 30 01:45:26 2022] HEAD /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:26.591061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.602159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352d8a-814d-4b20-8ef5-c254ee15a954 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.609408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.610108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.610711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.611089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.613620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.616447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.624896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role be4a2bc97ad341e694328f453bf1b33e was removed from group ff68c1e6364646f9a26cbabc99cac833 on project c58093f6acb445f5be34d8bdfa93f6b4. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:26.625236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:26.628503 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:26.629729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:26.631389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098926-5ae0-4a25-9c2c-9ba2822ee78a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.636640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.637276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.638331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.638331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.638647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.640659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.696664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3314/6595] 10.222.0.13 () {58 vars in 1470 bytes} [Sun Oct 30 01:45:26 2022] DELETE /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:26.701085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.702586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:26.722247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3282/6596] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:26 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:26.727119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.733579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:26.812876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1c8b3-bbde-4300-8b6d-2fc24799c733 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.829416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f5e4c-7b5b-45a9-9065-552bf1a4a687 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.839364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.839992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.840351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.840627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.841264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.843230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.886194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.887125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.887571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.888242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/groups/ff68c1e6364646f9a26cbabc99cac833/users/d1e96776526a4c3c848f285a116d7d9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.902718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ff68c1e6364646f9a26cbabc99cac833, user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.905026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.942192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3283/6597] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:26 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:26.946779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:26.962408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3c95e-0320-4ee8-8a19-610017436327 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:26.969209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:26.969504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:26.969882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:26.970348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:26.971307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:26.973117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:26.981368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:26.994706 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3284/6598] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:26 2022] GET /identity/v3/roles => generated 2323 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:26.998885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.021136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8471bc-4d23-4aa1-a89f-731e51b266c2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.028082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.028707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.028990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.029267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.029992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.031615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.050289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3285/6599] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:26 2022] GET /identity/v3/roles => generated 2323 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:27.054432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.067053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35ce3c-6b89-44e0-8f1f-1bedbd052070 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.078288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.078973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.079259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.079538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] PATH_INFO: `/v3/projects/5b1d124bd197495a8ae5c2b090250f18/users/acae2ccb9fea4b7e8c28e3b758bd89f4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.097199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1d124bd197495a8ae5c2b090250f18, user_id=acae2ccb9fea4b7e8c28e3b758bd89f4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.099976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dde76-2c12-4dd6-988e-1f5986bb3f47 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.107823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3315/6600] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:45:26 2022] DELETE /identity/v3/groups/ff68c1e6364646f9a26cbabc99cac833/users/d1e96776526a4c3c848f285a116d7d9f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:27.109438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.182982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88fcb3-021f-491f-8cf5-340a0f320b85 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.189828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.190644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.191043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.191804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.193732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.195472 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:27.195472 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:27.195472 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:27.196630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.220890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3286/6601] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:27 2022] PUT /identity/v3/projects/5b1d124bd197495a8ae5c2b090250f18/users/acae2ccb9fea4b7e8c28e3b758bd89f4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:27.224448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.224810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.225511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.263655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] MFA Rules not processed for user `acae2ccb9fea4b7e8c28e3b758bd89f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:27.263878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3316/6602] 10.222.0.13 () {60 vars in 1381 bytes} [Sun Oct 30 01:45:27 2022] PUT /identity/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:27.265385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:27.267625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.281467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749203-4de6-43be-86a4-8377af69b685 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.352143 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:27.365569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.366889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.367245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.367534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.368679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=ff68c1e6364646f9a26cbabc99cac833)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.369727 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:27.369727 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:27.369727 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:27.374918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.375505 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3287/6603] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:27.376719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.392767 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:27.435099 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3317/6604] 10.222.0.13 () {58 vars in 1263 bytes} [Sun Oct 30 01:45:27 2022] GET /identity/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles => generated 376 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:27.436252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.449590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0f13-7269-495c-915e-c0b7ce2ce5c1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.460251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.460914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.464597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.464597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.468799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.473066 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:27.473066 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:27.473066 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:27.473066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.481590 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3318/6605] 10.222.0.13 () {58 vars in 1363 bytes} [Sun Oct 30 01:45:27 2022] HEAD /identity/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:27.490187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.507861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c970898-7d66-4077-abae-c01855066a73 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.514069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.515113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.515596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.516592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.519051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=ff68c1e6364646f9a26cbabc99cac833, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.520039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203c40b-7976-47d1-8d01-4b11066ebabc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.520156 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:27.520156 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:27.520156 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:27.521176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.525404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.526758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.527050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.527346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.528165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.530200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.618579 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3319/6606] 10.222.0.13 () {58 vars in 1365 bytes} [Sun Oct 30 01:45:27 2022] DELETE /identity/v3/system/groups/ff68c1e6364646f9a26cbabc99cac833/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:27.624280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.637011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd55d-3917-487d-a060-b5b698e357ce tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.643593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.644555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.645121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.645631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.648793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.652007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.653005 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3288/6607] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:27 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:27.657758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.671241 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:27.727078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424f646-c066-4938-ac93-00eda965b5ca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.732861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.733660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.734008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.734375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.735085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.737128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.754868 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3320/6608] 10.222.0.13 () {60 vars in 1480 bytes} [Sun Oct 30 01:45:27 2022] PUT /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:27.754868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.839800 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3289/6609] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:27 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:27.847807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.855169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb3d8-d3d9-4731-a94e-b98e3f0d957d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.862006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72c55-8e0e-490c-8ec0-94f5728f6a5a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.862184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.862976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.863264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.863520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.865628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a260feb8a6944df69cae7904ed7a86b0, user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.872926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.904080 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3321/6610] 10.222.0.13 () {58 vars in 1362 bytes} [Sun Oct 30 01:45:27 2022] GET /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles => generated 409 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:27.908222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.923876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ca8b9-c080-4d2b-8913-d123f8b62fca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.935196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.935942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.937153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.937468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.942440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.946162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.957311 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3322/6611] 10.222.0.13 () {58 vars in 1462 bytes} [Sun Oct 30 01:45:27 2022] HEAD /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:27.965209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.965515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.965601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.965601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.965601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.965601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.965601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:27.971922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c1c19-04e9-4c28-acee-d3874ca00f10 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:27.978688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:27.979288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:27.979566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:27.979845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:27.982753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3290/6612] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:27 2022] GET /identity/v3/roles => generated 2323 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:27.992910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a260feb8a6944df69cae7904ed7a86b0, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:27.994782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:27.999591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.001875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role be4a2bc97ad341e694328f453bf1b33e was removed from user d1e96776526a4c3c848f285a116d7d9f on domain a260feb8a6944df69cae7904ed7a86b0. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:28.002173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:28.002884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:28.011097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd37c9-13e6-4f26-bf75-7efed9d8ea73 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.017032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.017985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.018509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.019036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] PATH_INFO: `/v3/projects/bda61968f18e489894903191b2e15dac/users/1f554dd68cd34d3ab176e931874c7a95/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.042529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda61968f18e489894903191b2e15dac, user_id=1f554dd68cd34d3ab176e931874c7a95, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.048251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.119876 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3323/6613] 10.222.0.13 () {58 vars in 1464 bytes} [Sun Oct 30 01:45:27 2022] DELETE /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.121524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.123199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.136829 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:28.142127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3291/6614] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:27 2022] PUT /identity/v3/projects/bda61968f18e489894903191b2e15dac/users/1f554dd68cd34d3ab176e931874c7a95/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.148641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.151244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.215087 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:28.250952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25683d0-66c4-4c1a-9840-6b0553c7e7c8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.257180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.258604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.258754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.259057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.259762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.261776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.263526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687679f7-8a6e-4a3f-9be8-682ea840529b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.279949 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3292/6615] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:28 2022] GET /identity/v3/roles => generated 2323 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:28.281144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.292756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11368-4195-4064-83e8-93f6f844bce4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.299520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.300653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.301030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.301592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] PATH_INFO: `/v3/projects/bda61968f18e489894903191b2e15dac/users/1f554dd68cd34d3ab176e931874c7a95/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.303795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda61968f18e489894903191b2e15dac, user_id=1f554dd68cd34d3ab176e931874c7a95, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.306854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b83ffa-0f68-43db-a0fc-9a0e6df7a437 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.321117 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3293/6616] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:28 2022] PUT /identity/v3/projects/bda61968f18e489894903191b2e15dac/users/1f554dd68cd34d3ab176e931874c7a95/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.366613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.368638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.369165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.370185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.373724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.376625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.433351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.434030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.434542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.466748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] MFA Rules not processed for user `1f554dd68cd34d3ab176e931874c7a95`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:28.467630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.472843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3324/6617] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:28 2022] PUT /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.474195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.552804 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:28.567003 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3294/6618] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:28.568172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547008a1-9192-45fe-8e32-5607deebff23 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.573875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.574536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.575235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.575502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.577861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_grants(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.582221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.587457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.589218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.601325 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3325/6619] 10.222.0.13 () {58 vars in 1365 bytes} [Sun Oct 30 01:45:28 2022] GET /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles => generated 410 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:28.602602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.615715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f5fea-066c-440c-926d-68e2c17a72e2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.622030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.622876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.623168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.623447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.626226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.628767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.637127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3326/6620] 10.222.0.13 () {58 vars in 1465 bytes} [Sun Oct 30 01:45:28 2022] HEAD /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.642429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.656177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae49be-7c11-4062-a607-10ebf16f404f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.661896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.663001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.663308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.663586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.669570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=c58093f6acb445f5be34d8bdfa93f6b4, user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.672775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.673322 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:28.679621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role be4a2bc97ad341e694328f453bf1b33e was removed from user d1e96776526a4c3c848f285a116d7d9f on project c58093f6acb445f5be34d8bdfa93f6b4. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:28.684091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:28.684091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:28.716690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38fb3b-5281-4328-a178-8ee23d152ead None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.725835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.726613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.726898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.727174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.729006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.796307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.797914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:28.800031 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3327/6621] 10.222.0.13 () {58 vars in 1467 bytes} [Sun Oct 30 01:45:28 2022] DELETE /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:28.805906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:28.807930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:28.814607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3295/6622] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:28.911838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528ad13-5bb5-4f37-a8cc-b5d7a738f060 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:28.921134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:28.922330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:28.922921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:28.935567 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:28.939872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.084526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3328/6623] 10.222.0.13 () {60 vars in 1378 bytes} [Sun Oct 30 01:45:28 2022] PUT /identity/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:29.088736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.099500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66603d7-729a-47dd-87c5-8a33b0b11c64 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.104667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.108305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.108305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.108305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.108305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.108698 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:29.108698 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:29.108698 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:29.109303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.123066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3296/6624] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:45:29 2022] GET /identity/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles => generated 375 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:29.127021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.129934 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:29.140939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3be78-c61c-48dd-b556-dab58971984d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.146276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.146921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.147212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.147514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.149224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.150390 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:29.150390 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:29.150390 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:29.151569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.157256 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3329/6625] 10.222.0.13 () {58 vars in 1360 bytes} [Sun Oct 30 01:45:29 2022] HEAD /identity/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:29.161234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.173376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808999d5-6b9f-474a-8ca1-8b815f3559cc tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.183413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.184227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.184635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.185170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.187470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=d1e96776526a4c3c848f285a116d7d9f, role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.189513 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:29.189513 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:29.189513 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:29.189513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.352195 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3297/6626] 10.222.0.13 () {58 vars in 1362 bytes} [Sun Oct 30 01:45:29 2022] DELETE /identity/v3/system/users/d1e96776526a4c3c848f285a116d7d9f/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:29.371179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.381444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50edcd8-6236-417b-be9b-7cd54571834b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.389075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.389799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.390201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.390551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.396133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.396133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.545695 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3330/6627] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:29 2022] POST /identity/v3/roles => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:29.547506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.557918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dffcb9-49cc-4469-b822-34df8a96cc9a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.563279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.563888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.564172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.564448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.568243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.568243 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:29.568243 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:29.568243 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:29.568243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.628857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:29.697164 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3298/6628] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:29 2022] POST /identity/v3/roles => generated 270 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:29.701226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.712795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588efaa-0c8f-4c29-9261-299df293ef2a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:29.719209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:29.719827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:29.720109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:29.720383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/916e283943ef4e31be4ae4f5ec68a219` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:29.734297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=916e283943ef4e31be4ae4f5ec68a219)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:29.734297 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:29.734297 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:29.734297 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:29.734297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:29.734727 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:29.948222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3331/6629] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:29 2022] PUT /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/916e283943ef4e31be4ae4f5ec68a219 => generated 530 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:29.949583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:29.963913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbef29f-5db0-493b-a28b-7ca8fa45932b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.055935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.056594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.056891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.057168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.057902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.059531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.161419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3299/6630] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:45:29 2022] POST /identity/v3/domains => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:30.162702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:30.177667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeedb-4501-4e6b-89f4-74f18e97131a tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.257532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.258113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.258426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.258691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.259363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.261023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.377578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3332/6631] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:30 2022] POST /identity/v3/roles => generated 268 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:30.381702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:30.392621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b972-0724-48f7-a17d-6ac81dd60b83 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.397281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.397966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.398267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.398529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/7c3b3ed614b9420489a8035e2bd9e48d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.400320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=7c3b3ed614b9420489a8035e2bd9e48d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.401909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.517308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3300/6632] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:30 2022] PUT /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/7c3b3ed614b9420489a8035e2bd9e48d => generated 528 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:30.521518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:30.532842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12882731-956b-4726-a97d-9df46dd52b47 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.606364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.607027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.607311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.607588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.609389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.614686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.759731 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3333/6633] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:30 2022] PUT /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/be4a2bc97ad341e694328f453bf1b33e => generated 525 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:30.763922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:30.775265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdd96b-a4af-4710-b28a-da2f2696f08f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.791501 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:30.852585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.853552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.853905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.854316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/be4a2bc97ad341e694328f453bf1b33e/implies/6e4dbc56fb25441281ebb1db430ae71a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.856414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=be4a2bc97ad341e694328f453bf1b33e, implied_role_id=6e4dbc56fb25441281ebb1db430ae71a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.858187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] 6e4dbc56fb25441281ebb1db430ae71a cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 6e4dbc56fb25441281ebb1db430ae71a cannot be an implied roles. Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 30 01:45:30.878718 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 6e4dbc56fb25441281ebb1db430ae71a cannot be an implied roles. Oct 30 01:45:30.879770 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:30.883889 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3301/6634] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:30 2022] PUT /identity/v3/roles/be4a2bc97ad341e694328f453bf1b33e/implies/6e4dbc56fb25441281ebb1db430ae71a => generated 116 bytes in 120 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:45:30.891263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:30.908528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fcbda-7144-44b2-b70a-892929ab04a9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:30.914512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:30.915757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:30.921635 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:30.922190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:30.941703 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:31.026601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3334/6635] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:30 2022] DELETE /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:31.029125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:31.050538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af0126-9a54-442b-9970-55d8b6205e41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:31.155308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:31.156163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:31.156163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:31.156483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/7c3b3ed614b9420489a8035e2bd9e48d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:31.159217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=7c3b3ed614b9420489a8035e2bd9e48d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:31.163815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:31.261897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3302/6636] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:31 2022] DELETE /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/7c3b3ed614b9420489a8035e2bd9e48d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:31.267963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:31.282240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f3373-deec-4966-999d-8c5d37363187 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:31.347199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:31.348119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:31.348641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:31.349127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/7c3b3ed614b9420489a8035e2bd9e48d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:31.352865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7c3b3ed614b9420489a8035e2bd9e48d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:31.355907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:31.387200 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:31.492625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 7c3b3ed614b9420489a8035e2bd9e48d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:31.492999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.493763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.498823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3335/6637] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:31 2022] DELETE /identity/v3/roles/7c3b3ed614b9420489a8035e2bd9e48d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:31.500569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:31.506383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:31.520707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c818-d63d-4958-82f6-2176fd3ab899 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:31.564570 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:31.589259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:31.589941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:31.590303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:31.590513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/fabaee40a6104a008f8027f673c1efe0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:31.602181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fabaee40a6104a008f8027f673c1efe0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:31.604201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:31.628831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.629745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.736431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.737041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.739445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3303/6638] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:45:31 2022] PATCH /identity/v3/domains/fabaee40a6104a008f8027f673c1efe0 => generated 276 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:31.744170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:31.754658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7082e-c857-4155-bae1-36f20c0ed201 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:31.818302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:31.819029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:31.819720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:31.819997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/fabaee40a6104a008f8027f673c1efe0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:31.831541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fabaee40a6104a008f8027f673c1efe0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:31.833195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:31.859282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:31.873015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.023904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.141845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.153645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.162717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] The token cache is being invalidate because project fabaee40a6104a008f8027f673c1efe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:32.162717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.163883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.181062 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:32.183105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.184071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.184568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fabaee40a6104a008f8027f673c1efe0', 'request_id': 'req-d8d6fb31-c0f5-4726-ae32-971dfd037785'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.193295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3336/6639] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:45:31 2022] DELETE /identity/v3/domains/fabaee40a6104a008f8027f673c1efe0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:32.197797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:32.199237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:32.212047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fb703-76bb-48ea-8657-4c6776544eb6 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:32.271133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:32.271816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:32.272097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:32.272411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/916e283943ef4e31be4ae4f5ec68a219` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:32.274358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6e4dbc56fb25441281ebb1db430ae71a, implied_role_id=916e283943ef4e31be4ae4f5ec68a219)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:32.276238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:32.313121 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:32.417384 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3304/6640] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:32 2022] DELETE /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a/implies/916e283943ef4e31be4ae4f5ec68a219 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:32.424383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:32.426470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:32.432036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:32.435669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:32.450011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6fb31-c0f5-4726-ae32-971dfd037785 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:32.539763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0aed-f265-42ec-891f-006b28be0afe tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:32.543956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:32.544566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:32.544841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:32.545111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:32.547907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:32.548170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:32.548340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:32.548628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:32.549703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/916e283943ef4e31be4ae4f5ec68a219` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:32.553461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=916e283943ef4e31be4ae4f5ec68a219)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:32.555189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:32.627050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:32.627050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:32.640350 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3305/6641] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:32.690455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 916e283943ef4e31be4ae4f5ec68a219 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:32.691078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.691805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:32.694653 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3337/6642] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:32 2022] DELETE /identity/v3/roles/916e283943ef4e31be4ae4f5ec68a219 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:32.704272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:32.716618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8377e-d597-484b-ba18-b416ffd657de service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:32.788513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:32.790286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:32.790286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:32.790286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/6e4dbc56fb25441281ebb1db430ae71a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:32.791340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6e4dbc56fb25441281ebb1db430ae71a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:32.792466 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:32.792466 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:32.792466 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:32.793459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:32.811139 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:33.040092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 6e4dbc56fb25441281ebb1db430ae71a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:33.040473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:33.045051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:33.047151 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3306/6643] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:32 2022] DELETE /identity/v3/roles/6e4dbc56fb25441281ebb1db430ae71a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:33.053065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.056862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:33.068266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b489f-6c2b-4a75-9821-5d2c98e9e323 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.130221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.130871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.131153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.131426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.133867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.135836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.241393 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3338/6644] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:33 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 520 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:33.245443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.247364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:33.261891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2671e-d328-4c4b-99ed-67aed2480a98 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.375999 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:33.391001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.391872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.392030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.392242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.396112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.397220 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:33.397220 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:33.397220 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:33.398163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.399082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.399969 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:33.399969 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:33.399969 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:33.400941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.419303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3307/6645] 10.222.0.13 () {58 vars in 1345 bytes} [Sun Oct 30 01:45:33 2022] HEAD /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:33.423843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.442166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499131df-4f3b-4f0a-a4f1-65c2ebe4e792 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.448088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.448888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.449107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.449450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.451729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.455668 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:33.455668 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:33.455668 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:33.456617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.463439 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3339/6646] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:45:33 2022] GET /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 520 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:33.467482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.483620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b9d50-e2ff-48e9-a73a-86d5bac9e25d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.492935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.493617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.494444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.494444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.495959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.497582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.678198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3308/6647] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:33 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:33.684031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.708760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd375ff7-53f4-4840-951d-5d26b6171364 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.710446 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:33.832540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.834077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.835190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.835190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.837755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.839361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f.: keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = query.one() Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._iter().one() Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._only_one_row( Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:33.851211 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 30 01:45:33.852448 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 30 01:45:33.853521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 30 01:45:33.853521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:33.853521 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:45:33.856435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3340/6648] 10.222.0.13 () {58 vars in 1344 bytes} [Sun Oct 30 01:45:33 2022] GET /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 137 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:45:33.857101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.868082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818fbe7-162b-471b-a74e-4c09f39b648f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.874526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.875846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.881477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.881477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.883105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.888996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f.: keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = query.one() Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._iter().one() Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._only_one_row( Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:33.917079 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 30 01:45:33.918158 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 24024778a0c44f75b5837f08c88ad3e7 does not imply c587e67294bc42c6998850378177b47f. Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:33.919128 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3309/6649] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:33 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 137 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:45:33.919651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:33.926716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20161cf0-3536-490f-ae44-b9f21af2ae84 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:33.932185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:33.932960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:33.933243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:33.933547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:33.946471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:33.948093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:34.109689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:34.116041 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3341/6650] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:33 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 520 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:34.122413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89796ea-f62c-4b28-9161-6bcdd1e157d9 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:34.222956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:34.224730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:34.225360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:34.225941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:34.227959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:34.234042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:34.296695 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:34.368314 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3310/6651] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:34 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8 => generated 520 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:34.372142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:34.385029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c72e-1bf1-47eb-8c7e-58e670eade2f tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:34.512624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:34.513829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:34.514273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:34.518710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:34.520821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ab37d4c26c2c4293b69548b456561af8, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:34.523302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:34.650310 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3342/6652] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:34 2022] PUT /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e => generated 521 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:34.654382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:34.666121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9e7b3-d7a9-4228-8258-f50c72b5d78b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:34.753860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:34.754572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:34.754920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:34.755160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:34.755790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:34.757439 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:34.757439 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:34.757439 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:34.759545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:34.790408 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3311/6653] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:45:34 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:34.791673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:34.803073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0917-7eb1-4434-8452-adbea8a03ac8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:34.815396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:34.816105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:34.816571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:34.818518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:34.819912 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:34.823388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ab37d4c26c2c4293b69548b456561af8, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:34.826189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:34.902029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3343/6654] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:34 2022] DELETE /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:34.906013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:34.920479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974672b3-4df8-4691-8982-71149b77d5c7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:35.010052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:35.011322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:35.011816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:35.012590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:35.014770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:35.020945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:35.149261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3312/6655] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:34 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:35.153515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:35.180556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481038f5-7b1e-479e-a37e-fdd3b34a11d4 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:35.292743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:35.293442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:35.293707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:35.293982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:35.295742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:35.297485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:35.388557 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3344/6656] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:35 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:35.393442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:35.406783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38add779-2223-4b04-bc6a-1ef1be30143b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:35.534927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:35.535563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:35.536195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:35.536477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:35.541252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:35.542984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:35.577896 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3313/6657] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:35 2022] GET /identity/v3/roles => generated 2323 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:35.583269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:35.595240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048257-c18d-4d10-b0a1-0e7c4c970b41 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:35.616843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:35.617505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:35.617956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:35.618312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:35.619081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:35.623200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:35.796771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3345/6658] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:45:35 2022] POST /identity/v3/roles => generated 235 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:35.801058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:35.823275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e7ac-b739-4446-aede-0406de14a8fb tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:35.830741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:35.831461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:35.831919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:35.832503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/9c0e7033852244fe969c174ab958ba1d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:35.834262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:update_role(role_id=9c0e7033852244fe969c174ab958ba1d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:35.835580 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:35.835580 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:35.835580 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:35.838757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:35.899876 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:36.026926 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3314/6659] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:45:35 2022] PATCH /identity/v3/roles/9c0e7033852244fe969c174ab958ba1d => generated 238 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:36.032056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.044199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38245075-5371-45f5-b931-eadd6e665eca tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.049285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.050260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.050550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.050829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/9c0e7033852244fe969c174ab958ba1d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.060820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:get_role(role_id=9c0e7033852244fe969c174ab958ba1d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.061994 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:36.061994 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:36.061994 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:36.063016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:36.064515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3346/6660] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:45:36 2022] GET /identity/v3/roles/9c0e7033852244fe969c174ab958ba1d => generated 238 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:36.068890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.083795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127515a5-e450-4593-b772-8837c0bd6ad3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.088867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.089709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.090097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.090498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.091496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.096978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:36.112074 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3315/6661] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:36 2022] GET /identity/v3/roles => generated 2552 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:36.116001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.126723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d66bcd-5e2e-45fe-a045-25cc2192780c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.138313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.139229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.139577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.140035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/9c0e7033852244fe969c174ab958ba1d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.141836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9c0e7033852244fe969c174ab958ba1d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.143737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:36.307665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 9c0e7033852244fe969c174ab958ba1d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:36.313222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:36.315040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:36.318676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3347/6662] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:36 2022] DELETE /identity/v3/roles/9c0e7033852244fe969c174ab958ba1d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:36.324101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.325958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:36.342083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea0a13-2c91-4f56-b14b-7339881cb1d1 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.424649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.426007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.426477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.426901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.428946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.434435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:36.548807 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3316/6663] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:36 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 520 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:36.552635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.572492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645c138-25c4-480e-9c74-4899329735d7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.660849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.661718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.662162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.662541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.664563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.670712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:36.719149 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:36.838534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3348/6664] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:36 2022] PUT /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8 => generated 520 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:36.840437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:36.867886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f7be-b350-4865-b73f-d958b1a428b2 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:36.975410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:36.976248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:36.979892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:36.980192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:36.982918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=ab37d4c26c2c4293b69548b456561af8, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:36.984612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:37.123473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3317/6665] 10.222.0.13 () {60 vars in 1363 bytes} [Sun Oct 30 01:45:36 2022] PUT /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e => generated 521 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:37.127685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:37.145707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2e83-b1de-4da6-a7a7-6d55dff38aa7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:37.226679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:37.229242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:37.230076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:45:37.235659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:37.256779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3349/6666] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:45:37 2022] GET /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies => generated 490 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:37.260679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:37.279043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7012a09-1bf4-41b9-b789-b5dc7b099554 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:37.288228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:37.288925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:37.289228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:37.289535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:37.294200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=24024778a0c44f75b5837f08c88ad3e7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:37.295293 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:45:37.295293 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:45:37.295293 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:45:37.296299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:37.318361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:37.319974 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3318/6667] 10.222.0.13 () {58 vars in 1245 bytes} [Sun Oct 30 01:45:37 2022] GET /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies => generated 660 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:37.330612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c890-ca6d-446f-a7f8-3c73e3c10e0d tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:37.346009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:37.346009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:37.346009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:37.346571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:37.346571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=ab37d4c26c2c4293b69548b456561af8, implied_role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:37.346571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:37.496250 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3350/6668] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:37 2022] DELETE /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8/implies/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:37.500592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:37.529705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaae18-2d3f-427e-990e-95eb23ef6938 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:37.673840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:37.675928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:37.676480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:37.677027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:37.680214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:37.683421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:37.782794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3319/6669] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:37 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/ab37d4c26c2c4293b69548b456561af8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:37.786938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:37.808439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6bef-880c-4bc3-af2b-3703ae256b18 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:37.969631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:37.970663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:37.971145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:37.972144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:37.974585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=24024778a0c44f75b5837f08c88ad3e7, implied_role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:37.977204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:38.079408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3351/6670] 10.222.0.13 () {58 vars in 1347 bytes} [Sun Oct 30 01:45:37 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7/implies/c587e67294bc42c6998850378177b47f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:38.085514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:38.099365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b78c-b943-4d72-bcd2-74d85e18fde3 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:38.193439 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:38.268185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:38.269115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:38.269738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:38.270210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/fabaee40a6104a008f8027f673c1efe0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:38.289072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Could not find domain: fabaee40a6104a008f8027f673c1efe0.: keystone.exception.DomainNotFound: Could not find domain: fabaee40a6104a008f8027f673c1efe0. Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fabaee40a6104a008f8027f673c1efe0. Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:45:38.297501 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:45:38.299751 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application with Lock( Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fabaee40a6104a008f8027f673c1efe0. Oct 30 01:45:38.301069 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:45:38.308031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3320/6671] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:45:38 2022] PATCH /identity/v3/domains/fabaee40a6104a008f8027f673c1efe0 => generated 112 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:45:38.312003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:38.328233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44a30-d7c4-4870-ae0d-b67ceb15a47c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:38.341019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:38.342006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:38.343000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:38.343859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/users/d1e96776526a4c3c848f285a116d7d9f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:38.345374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d1e96776526a4c3c848f285a116d7d9f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:38.347838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:38.509134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:38.638260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:38.639023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:38.665735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:38.687631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e96776526a4c3c848f285a116d7d9f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:38.700671 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3352/6672] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:38 2022] DELETE /identity/v3/users/d1e96776526a4c3c848f285a116d7d9f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:38.702065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:38.707098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:38.721370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce1bd7-848b-4aee-a2ae-bf6925c57945 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:38.813855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:38.814509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:38.815046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:38.815226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/be4a2bc97ad341e694328f453bf1b33e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:38.816740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_role(role_id=be4a2bc97ad341e694328f453bf1b33e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:38.818456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:39.023868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role be4a2bc97ad341e694328f453bf1b33e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:39.028763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.028763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.030578 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3321/6673] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:38 2022] DELETE /identity/v3/roles/be4a2bc97ad341e694328f453bf1b33e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:39.031466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:39.042952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44e3c-0baa-484a-a199-671138deb183 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:39.120065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:39.120742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:39.121069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:39.121371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/groups/ff68c1e6364646f9a26cbabc99cac833` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:39.122539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ff68c1e6364646f9a26cbabc99cac833)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:39.124446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:39.304338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:39.305142 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3353/6674] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:45:39 2022] DELETE /identity/v3/groups/ff68c1e6364646f9a26cbabc99cac833 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:39.306343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:39.313143 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:39.329377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6837f70-e460-4853-8fd5-b53ede1a5d8b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:39.422573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:39.423252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:39.423530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:39.423804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:39.425036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c58093f6acb445f5be34d8bdfa93f6b4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:39.427481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:39.574089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58093f6acb445f5be34d8bdfa93f6b4', 'request_id': 'req-6a9f69da-33e4-44b5-ae77-fead0423510b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.582719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58093f6acb445f5be34d8bdfa93f6b4', 'request_id': 'req-6a9f69da-33e4-44b5-ae77-fead0423510b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.696294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58093f6acb445f5be34d8bdfa93f6b4', 'request_id': 'req-6a9f69da-33e4-44b5-ae77-fead0423510b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.718388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] The token cache is being invalidate because project c58093f6acb445f5be34d8bdfa93f6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:39.718969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.719350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6a9f69da-33e4-44b5-ae77-fead0423510b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.735260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:39.736629 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3322/6675] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:39 2022] DELETE /identity/v3/projects/c58093f6acb445f5be34d8bdfa93f6b4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:39.739242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:39.766743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3676d4b-e307-4e50-be3c-3c93effde51c tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:39.825477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:39.826011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:39.827088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:39.860915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] MFA Rules not processed for user `9c53d510d75542a283b7f851a58d3dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:39.863180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:39.899307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:39.900748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:39.900748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:39.900948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:39.902369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a260feb8a6944df69cae7904ed7a86b0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:39.904135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:39.929822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.930731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:39.964182 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3323/6676] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:39.988494 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:40.062117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.062117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.062117 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3354/6677] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:45:39 2022] PATCH /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0 => generated 278 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:40.063929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:40.066906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:40.084468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2137a-087e-41ec-8d4d-d5ddb1fb2594 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:40.193579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:40.193579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:40.193579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:40.194736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/domains/a260feb8a6944df69cae7904ed7a86b0` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:40.208803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a260feb8a6944df69cae7904ed7a86b0)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:40.211085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:40.246672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.251998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.384215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.392047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.483674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.504920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] The token cache is being invalidate because project a260feb8a6944df69cae7904ed7a86b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:40.505291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.506087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.517753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.521837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.526801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a260feb8a6944df69cae7904ed7a86b0', 'request_id': 'req-ae9298a5-170e-412c-bd40-ba016e75e81b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.529316 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3324/6678] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:45:40 2022] DELETE /identity/v3/domains/a260feb8a6944df69cae7904ed7a86b0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:40.533745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:40.537988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:40.563409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141c214-e610-4eed-981b-c64241688804 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:40.664927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:40.664927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:40.664927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:40.665240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/ab37d4c26c2c4293b69548b456561af8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:40.665240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ab37d4c26c2c4293b69548b456561af8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:40.665240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:40.871039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role ab37d4c26c2c4293b69548b456561af8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:40.872972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.872972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:40.874039 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3355/6679] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:40 2022] DELETE /identity/v3/roles/ab37d4c26c2c4293b69548b456561af8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:40.879146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:40.880772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:40.900379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9298a5-170e-412c-bd40-ba016e75e81b tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:40.978142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:40.978941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:40.979315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:40.980009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/c587e67294bc42c6998850378177b47f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:40.982164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c587e67294bc42c6998850378177b47f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:40.985296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:41.118259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role c587e67294bc42c6998850378177b47f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:41.118259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.119739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.121592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3325/6680] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:40 2022] DELETE /identity/v3/roles/c587e67294bc42c6998850378177b47f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:41.125549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:41.127094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:41.145752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162218a-2ebb-4bde-a4d0-453e49631d14 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:41.238576 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:41.240467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f693607c8b73490c9cdec17811fb95d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:41.241140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:41.241724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:41.241951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] PATH_INFO: `/v3/roles/24024778a0c44f75b5837f08c88ad3e7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:41.243563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorizing `identity:delete_role(role_id=24024778a0c44f75b5837f08c88ad3e7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:41.245402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:41.383375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invalidating the token cache because role 24024778a0c44f75b5837f08c88ad3e7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:41.387003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.387003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ce9d787a-3f10-42a7-a800-e14735beaed7 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.388736 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3356/6681] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:41 2022] DELETE /identity/v3/roles/24024778a0c44f75b5837f08c88ad3e7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:41.393371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:41.394779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:41.559395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432e2eb-c5a3-497d-8503-b1610507dab8 tempest-RolesV3TestJSON-2062661341 tempest-RolesV3TestJSON-2062661341-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:41.562129 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:41.634418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:41.635679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:41.636063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:41.636457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] PATH_INFO: `/v3/users/cd393242495e437eb27939d5c7f7ccb4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:41.638084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd393242495e437eb27939d5c7f7ccb4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:41.640135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:41.914160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd393242495e437eb27939d5c7f7ccb4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.914956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd393242495e437eb27939d5c7f7ccb4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.932122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd393242495e437eb27939d5c7f7ccb4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:41.933699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd393242495e437eb27939d5c7f7ccb4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:42.044999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd393242495e437eb27939d5c7f7ccb4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:42.075597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3326/6682] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:41 2022] DELETE /identity/v3/users/cd393242495e437eb27939d5c7f7ccb4 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:42.076797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:42.077262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:42.077395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:42.100844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:42.102355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:42.176337 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3357/6683] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:42.185908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:42.187348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:42.264371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d83c5b-4ce4-4f29-a9d0-37e3e0d82e52 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:42.273403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:42.273403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:42.273403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:42.273403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:42.279831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:42.281357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:42.293105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3327/6684] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:42.678391 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:42.811244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:42.815969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:42.848503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b10d-8c1a-4b38-9d96-3305b1a1cdf3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:42.860057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:42.861026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:42.861308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:42.861616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] PATH_INFO: `/v3/projects/24b84d8749f040a0a368b80706f1aa49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:42.862777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b84d8749f040a0a368b80706f1aa49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:42.864711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:42.993538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b84d8749f040a0a368b80706f1aa49', 'request_id': 'req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.073558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b84d8749f040a0a368b80706f1aa49', 'request_id': 'req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.092364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b84d8749f040a0a368b80706f1aa49', 'request_id': 'req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.109578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] The token cache is being invalidate because project 24b84d8749f040a0a368b80706f1aa49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:43.113132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.113132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.113132 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3358/6685] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:42 2022] DELETE /identity/v3/projects/24b84d8749f040a0a368b80706f1aa49 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:43.119017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:43.135258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450fdd8-1b2f-4297-af92-0756f377aa70 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:43.194252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:43.194798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:43.195059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:43.195320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] PATH_INFO: `/v3/users/f693607c8b73490c9cdec17811fb95d7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:43.196568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f693607c8b73490c9cdec17811fb95d7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:43.198493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:43.333788 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:43.460371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f693607c8b73490c9cdec17811fb95d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.460371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f693607c8b73490c9cdec17811fb95d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.460371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f693607c8b73490c9cdec17811fb95d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.460371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f693607c8b73490c9cdec17811fb95d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.552389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-95ab7e2b-c6b2-4212-9768-e8898ff18553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f693607c8b73490c9cdec17811fb95d7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:43.587392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3328/6686] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:43 2022] DELETE /identity/v3/users/f693607c8b73490c9cdec17811fb95d7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:43.992612 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:44.167537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:44.170097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:44.183397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462d8fa-9dd2-4125-9bb6-701e9edc7e0e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:44.282114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:44.282814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:44.283103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:44.284178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] PATH_INFO: `/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:44.287326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe3cdbbe52d4e20bf8a9f297740d1c2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:44.289509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:44.466260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'request_id': 'req-b904298b-6867-4ef9-8878-6272fe1540e3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:44.598482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'request_id': 'req-b904298b-6867-4ef9-8878-6272fe1540e3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:44.606673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe3cdbbe52d4e20bf8a9f297740d1c2', 'request_id': 'req-b904298b-6867-4ef9-8878-6272fe1540e3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:44.620505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] The token cache is being invalidate because project ffe3cdbbe52d4e20bf8a9f297740d1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:44.620958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:44.621741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b904298b-6867-4ef9-8878-6272fe1540e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:44.628479 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3359/6687] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:44 2022] DELETE /identity/v3/projects/ffe3cdbbe52d4e20bf8a9f297740d1c2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:44.630198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:44.630641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:44.630748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:44.656907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:44.658469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:44.738326 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3329/6688] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:44.746782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:44.747075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:44.747357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:44.769760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:44.771282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:44.781410 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3360/6689] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:44.790100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:44.809872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c552d8-07b5-46f3-b122-446aecdb6cc5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:44.820296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:44.820920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:44.821195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:44.821515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:44.822164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:44.822458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:44.824160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:44.841791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3330/6690] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:44.845083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:44.863947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ccbd-3112-4bbe-81b0-e24cc041d90d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:44.866495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:44.867185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:44.867490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:44.867788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:44.868474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:44.870468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:44.929121 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:45.060601 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3361/6691] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:44 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:45.061731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.074038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436bf8c-41bd-4249-852a-4e454b3bd769 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.183129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.185142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.185142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.185142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.189079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:45.199311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:45.306718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3331/6692] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:45 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:45.310976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.321971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4efb16-7df0-459a-804c-5386bb0ff53b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.332400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.334956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.334956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.334956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.334956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:45.336636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:45.365917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.368655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3362/6693] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:45.384714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f0e98-4a23-4a4d-8bf6-893fd34c6a44 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.390683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.391702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.391702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.395955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.397424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:45.399872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986728bf-7d27-4335-b391-4bef40a448db admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:45.429777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.430398 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3332/6694] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:45.446870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276a23-d579-4ed4-964c-2580cb7e82ae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.454580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.455528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.463720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.463720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] PATH_INFO: `/v3/projects/bd7bbc16e55f4430926333e5bcb62f5d/users/59b70dfc1f45400e8c53449b5c52bfb5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.482558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7bbc16e55f4430926333e5bcb62f5d, user_id=59b70dfc1f45400e8c53449b5c52bfb5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:45.485321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:45.571686 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3363/6695] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:45 2022] PUT /identity/v3/projects/bd7bbc16e55f4430926333e5bcb62f5d/users/59b70dfc1f45400e8c53449b5c52bfb5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:45.582899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.583576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.584037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.598645 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:45.613576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] MFA Rules not processed for user `59b70dfc1f45400e8c53449b5c52bfb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:45.621760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:45.691010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3333/6696] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:45.697498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.708575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4cf72-8903-44e5-967d-4d31e5e8670c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.714957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b70dfc1f45400e8c53449b5c52bfb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd7bbc16e55f4430926333e5bcb62f5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.715277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.715555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.715833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] PATH_INFO: `/v3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.717573 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3364/6697] 10.222.0.13 () {58 vars in 1104 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:45.724210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.740850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6687ac4-31ec-4235-b1a4-6e6553ca4ecd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.745598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2128a-d5d2-4e82-b7a5-4fb5101158a4 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b70dfc1f45400e8c53449b5c52bfb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd7bbc16e55f4430926333e5bcb62f5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.746235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2128a-d5d2-4e82-b7a5-4fb5101158a4 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.746516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2128a-d5d2-4e82-b7a5-4fb5101158a4 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.746786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2128a-d5d2-4e82-b7a5-4fb5101158a4 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] PATH_INFO: `/v3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.753532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3334/6698] 10.222.0.13 () {58 vars in 1104 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/v3 => generated 255 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:45.758452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.778336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39402d55-42f8-41e3-8f41-888253d7d70f tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.787342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e9404-4411-4f1a-a69d-41bf3e348c43 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b70dfc1f45400e8c53449b5c52bfb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd7bbc16e55f4430926333e5bcb62f5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.788392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e9404-4411-4f1a-a69d-41bf3e348c43 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.788809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e9404-4411-4f1a-a69d-41bf3e348c43 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.789148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e9404-4411-4f1a-a69d-41bf3e348c43 tempest-TestApiDiscovery-1876842611 tempest-TestApiDiscovery-1876842611-project] PATH_INFO: `/v3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.791427 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3365/6699] 10.222.0.13 () {58 vars in 1104 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/v3 => generated 255 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:45.812701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1947d-78a8-473a-8ff9-cb20715edde5 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.813228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1947d-78a8-473a-8ff9-cb20715edde5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.813979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1947d-78a8-473a-8ff9-cb20715edde5 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.819308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3335/6700] 10.222.0.13 () {56 vars in 895 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:45:45.821012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac33c-da68-4e58-a147-c7f98a8dc409 None None] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.821326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac33c-da68-4e58-a147-c7f98a8dc409 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.821628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eac33c-da68-4e58-a147-c7f98a8dc409 None None] PATH_INFO: `/` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.823138 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3366/6701] 10.222.0.13 () {56 vars in 895 bytes} [Sun Oct 30 01:45:45 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 01:45:45.829612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1947d-78a8-473a-8ff9-cb20715edde5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:45.978416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1947d-78a8-473a-8ff9-cb20715edde5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:45.983656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:45.984461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:45.984763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:45.985025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] PATH_INFO: `/v3/users/59b70dfc1f45400e8c53449b5c52bfb5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:45.986323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b70dfc1f45400e8c53449b5c52bfb5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:45.988265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:46.068017 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:46.226800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b70dfc1f45400e8c53449b5c52bfb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:46.228637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b70dfc1f45400e8c53449b5c52bfb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:46.239119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b70dfc1f45400e8c53449b5c52bfb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:46.241293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b70dfc1f45400e8c53449b5c52bfb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:46.334895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b70dfc1f45400e8c53449b5c52bfb5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:46.363476 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3336/6702] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:45 2022] DELETE /identity/v3/users/59b70dfc1f45400e8c53449b5c52bfb5 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:46.368728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:46.369210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:46.369308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:46.422993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:46.425994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:46.516501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3367/6703] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:46.540724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:46.543505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:46.546471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:46.547152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:46.674425 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:46.692955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3431d-8b62-42c8-b8ef-a1bd68db7adc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:46.702121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:46.702758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:46.703034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:46.703315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:46.718636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c9e5-ae89-4ebc-859a-da22364a4d39 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:46.726912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:46.728116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:46.728706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:46.729445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:46.730082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:46.732502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:46.733991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:46.746174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3368/6704] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:46.758677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:46.760748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e495-c0ec-40c7-a834-cc62d7215a1b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:46.780841 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3337/6705] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:47.272603 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:47.742752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:47.744483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:47.764708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d95fb-c43d-4fdc-a07a-ba70912a7b3e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:47.770666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:47.772029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:47.772573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:47.773062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] PATH_INFO: `/v3/projects/bd7bbc16e55f4430926333e5bcb62f5d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:47.774958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7bbc16e55f4430926333e5bcb62f5d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:47.777286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:47.942996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7bbc16e55f4430926333e5bcb62f5d', 'request_id': 'req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:48.047303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7bbc16e55f4430926333e5bcb62f5d', 'request_id': 'req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:48.059100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7bbc16e55f4430926333e5bcb62f5d', 'request_id': 'req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:48.075608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] The token cache is being invalidate because project bd7bbc16e55f4430926333e5bcb62f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:48.077113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:48.078961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b52ed6a9-9fa4-4d75-8eba-53608b7068e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:48.086564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3369/6706] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:47 2022] DELETE /identity/v3/projects/bd7bbc16e55f4430926333e5bcb62f5d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:48.091699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.092169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.092280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.117642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:48.118849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:48.224615 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3338/6707] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:48.232556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.233665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.234095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.258912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:48.260693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:48.270823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3370/6708] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:48.275455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.286982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64641c45-46bf-4f03-b6b7-24bda928dd54 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.295836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.295836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.296368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.296800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.298203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:48.298802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.301934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.331623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3339/6709] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:48.336062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.345776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea19db-94a5-430d-8c49-7d244b034278 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.350562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.351159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.351434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.351701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.352363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.354295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.386146 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:48.433987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3371/6710] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:48 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:48.437980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.449918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ae88e-ac20-4cb7-873c-2a13e181a717 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.461824 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:48.549268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.549839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.550108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.550389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.551076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.553669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.641040 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3340/6711] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:48 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:48.644860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.658196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f2408-a7c0-4bc3-acb1-f2a4635f2e9e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.668140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.668807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.669084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.669383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.670058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.674417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.691322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.693671 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3372/6712] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:48.703887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dcdc-47c0-41c1-8324-44bd61007d35 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.709128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.709861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.710136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.710406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.711040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.712779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec0a62-8aa1-46ae-9720-979b09083b9e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.726053 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3341/6713] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:48.730122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:48.742088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef04cf-8aa1-4377-8986-f36ddbd5659b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:48.746961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:48.747598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.747887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.750264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] PATH_INFO: `/v3/projects/d3b9c7212d2242d89a202eb30689b985/users/d6c42cd189b84cbcaff5d4de1510a2ca/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:48.764985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b9c7212d2242d89a202eb30689b985, user_id=d6c42cd189b84cbcaff5d4de1510a2ca, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:48.767930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:48.965875 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3373/6714] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:48 2022] PUT /identity/v3/projects/d3b9c7212d2242d89a202eb30689b985/users/d6c42cd189b84cbcaff5d4de1510a2ca/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:48.978273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:48.978592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:48.978853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:49.023776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] MFA Rules not processed for user `d6c42cd189b84cbcaff5d4de1510a2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:49.024976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:49.091774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3342/6715] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:49.096734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:49.108193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27948-d428-48d2-a227-4e3a91c563e6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:49.112541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c42cd189b84cbcaff5d4de1510a2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd3b9c7212d2242d89a202eb30689b985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:49.113146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:49.113464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:49.113738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:49.114310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:49.115579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37beab-afd6-4e60-9d48-96bb764cb5ed tempest-IdentityCatalogTest-1690713466 tempest-IdentityCatalogTest-1690713466-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:49.117347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3374/6716] 10.222.0.13 () {58 vars in 1143 bytes} [Sun Oct 30 01:45:49 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:49.127381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:49.196126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08273-50bc-4c05-8985-bae142bef8ba None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:49.200869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:49.201568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:49.201851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:49.202121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] PATH_INFO: `/v3/users/d6c42cd189b84cbcaff5d4de1510a2ca` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:49.203332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c42cd189b84cbcaff5d4de1510a2ca)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:49.205256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:49.393494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c42cd189b84cbcaff5d4de1510a2ca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:49.394198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c42cd189b84cbcaff5d4de1510a2ca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:49.402022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c42cd189b84cbcaff5d4de1510a2ca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:49.402687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c42cd189b84cbcaff5d4de1510a2ca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:49.500505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c42cd189b84cbcaff5d4de1510a2ca'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:49.520207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3343/6717] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:49 2022] DELETE /identity/v3/users/d6c42cd189b84cbcaff5d4de1510a2ca => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:49.524580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:49.525095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:49.525404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:49.556724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:49.558052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:49.650664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3375/6718] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:49.663012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:49.665967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:49.753146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2774c-776a-4280-ad90-4af7186b0f58 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:49.757037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:49.757687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:49.757964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:49.758238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:49.770092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:49.772566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0a38f-e75f-4563-a84f-e614a70b107c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:49.785683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3344/6719] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:50.429176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:50.435264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:50.474820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582746bc-0de1-41d4-bd37-88eb77598baf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:50.484041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:50.484797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:50.485300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:50.485809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] PATH_INFO: `/v3/projects/d3b9c7212d2242d89a202eb30689b985` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:50.488205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b9c7212d2242d89a202eb30689b985)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:50.490745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:50.511725 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:50.535088 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:50.695992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b9c7212d2242d89a202eb30689b985', 'request_id': 'req-4b09e635-ee51-4a7d-ad48-587f0ee5130e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:50.780735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b9c7212d2242d89a202eb30689b985', 'request_id': 'req-4b09e635-ee51-4a7d-ad48-587f0ee5130e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:50.794557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b9c7212d2242d89a202eb30689b985', 'request_id': 'req-4b09e635-ee51-4a7d-ad48-587f0ee5130e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:50.813456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] The token cache is being invalidate because project d3b9c7212d2242d89a202eb30689b985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:50.814131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:50.814976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4b09e635-ee51-4a7d-ad48-587f0ee5130e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:50.816413 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3376/6720] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:50 2022] DELETE /identity/v3/projects/d3b9c7212d2242d89a202eb30689b985 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:50.821511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:50.821730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:50.822008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:50.843741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:50.848529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:50.910243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3345/6721] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:50.918099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:50.918366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:50.918645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:50.938803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:50.939920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:50.948489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3377/6722] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:50.952743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:50.962473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4f2a-d9d8-4cba-b90b-daa8213c2c4a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:50.967369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:50.975457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:50.975840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:50.976124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:50.976813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:50.977117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:50.978828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:50.997063 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3346/6723] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:50.997728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.009153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93c02-9605-48d2-9cac-1c8a74add469 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.014924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.015772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.016126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.016569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.017270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.020476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.141080 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3378/6724] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:50 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:51.145084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.158217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78232c-7530-40ae-8ff2-7a76c017e80f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.226623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.227327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.227673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.228030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.228731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.232408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.322724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3347/6725] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:51 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:51.326792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.338083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e44f2-bc0d-493a-aab5-543817fca318 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.342870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.348583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.348583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.348583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.348583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.348583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.368986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3379/6726] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:51.373264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.385300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce44-a8ad-4bf1-bb56-72f9fc545578 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.396905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.399063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.399554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.401519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] PATH_INFO: `/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1/users/95a0fa48d5174e7db417f1b4829e05a4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.430883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab913f2cb14d42dc8534a28cbd2d72f1, user_id=95a0fa48d5174e7db417f1b4829e05a4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.433879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.501141 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3348/6727] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:51 2022] PUT /identity/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1/users/95a0fa48d5174e7db417f1b4829e05a4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:51.505099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.517084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4203636-99dc-424b-ad97-852fe99eae4d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.598792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.599798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.606998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.606998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.606998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.608432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209cb2f-995c-41ca-9d11-416be24df4d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.624828 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3380/6728] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:45:51.628563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.645389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349504a-bc37-449d-b6c0-52f48386fff7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.656442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.657189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.657517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.657784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] PATH_INFO: `/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1/users/95a0fa48d5174e7db417f1b4829e05a4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.659836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab913f2cb14d42dc8534a28cbd2d72f1, user_id=95a0fa48d5174e7db417f1b4829e05a4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.662649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.689419 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3349/6729] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:51 2022] PUT /identity/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1/users/95a0fa48d5174e7db417f1b4829e05a4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:51.697602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.697917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.698199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.731446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] MFA Rules not processed for user `95a0fa48d5174e7db417f1b4829e05a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:51.732733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:51.811621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3381/6730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:51.821582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:51.907940 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:51.916390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a642-caa2-4c18-a090-2ef8487f263a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:51.924124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:51.924746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:51.925033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:51.925445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:51.926377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:51.929360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:51.958197 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:52.025256 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3350/6731] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:51 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:52.029114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:52.043721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad3e40-8408-44cb-9c2f-fa335ec8cbab None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:52.152826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:52.153702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.154166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.154597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:52.155759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:52.159409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:52.236130 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3382/6732] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:52 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:52.241002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:52.271477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e45d-78ec-4cfe-b9bc-4c556d5312a2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:52.285189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:52.285790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.286085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.286392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:52.288810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:52.293322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:52.327589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3351/6733] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:52.332936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:52.346834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aa295-0cbd-4178-92f9-e2f645ea9119 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:52.362959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:52.362959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.362959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.362959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:52.363295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:52.368430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377791e-eeb4-4141-8062-21558e6e8935 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:52.389200 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3383/6734] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:52.393088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:52.408443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682dde-51d4-49f5-8d0c-0e1d3c27ac18 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:52.415600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:52.418047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.418526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.419313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] PATH_INFO: `/v3/projects/7ff2c51ea2e24e16adb0a6eaef7139a9/users/02c524eded704946ac18e56e3b755faf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:52.450852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff2c51ea2e24e16adb0a6eaef7139a9, user_id=02c524eded704946ac18e56e3b755faf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:52.457172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:52.527574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3352/6735] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:52 2022] PUT /identity/v3/projects/7ff2c51ea2e24e16adb0a6eaef7139a9/users/02c524eded704946ac18e56e3b755faf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:52.539891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.541106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.541691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:52.590790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] MFA Rules not processed for user `02c524eded704946ac18e56e3b755faf`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:52.592719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:52.733820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3384/6736] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:52.745791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:52.747872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:52.860453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8748b-aa42-46b0-9382-10f5023bd205 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:52.864951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:52.865788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:52.866152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:52.866539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:53.006733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:53.009107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:53.037239 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3353/6737] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:45:53.045909 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:53.152646 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:54.232978 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:54.368753 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:54.701252 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:54.847812 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:55.071748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:55.073158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:55.157903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd19d78-de9e-4421-96d8-02b8742f552b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:55.163141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:55.164012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:55.164288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:55.164559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] PATH_INFO: `/v3/users/b441184d485a41e1b8e3eb0cb1617937` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:55.165781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b441184d485a41e1b8e3eb0cb1617937)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:55.167773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:55.375122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b441184d485a41e1b8e3eb0cb1617937'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.444626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:55.463211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b45ec-84d4-4150-98e9-a2d39c5db208 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:55.466593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b441184d485a41e1b8e3eb0cb1617937'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.467873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b441184d485a41e1b8e3eb0cb1617937'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.475662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:55.476565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:55.477684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:55.478444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] PATH_INFO: `/v3/users/95a0fa48d5174e7db417f1b4829e05a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:55.481597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a0fa48d5174e7db417f1b4829e05a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:55.485464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:55.489824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b441184d485a41e1b8e3eb0cb1617937'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.511330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-232d2a92-e222-437e-9877-9454ac068e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b441184d485a41e1b8e3eb0cb1617937'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.527452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3385/6738] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:55 2022] DELETE /identity/v3/users/b441184d485a41e1b8e3eb0cb1617937 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:55.538192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:55.538192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:55.538192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:55.559935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:55.561628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:55.601077 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:55.639299 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3386/6739] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:55.650726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:55.652413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:55.750411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580f43-3ddb-4382-bbeb-3a319cf8250d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:55.762216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:55.764140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:55.764571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:55.764854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:55.788756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:55.791748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a0fa48d5174e7db417f1b4829e05a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.792683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a0fa48d5174e7db417f1b4829e05a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.797636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807fed2-21b7-4336-b373-6695d8e5060a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:55.810910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a0fa48d5174e7db417f1b4829e05a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.814015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a0fa48d5174e7db417f1b4829e05a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.824067 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3387/6740] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:45:55.948106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a0fa48d5174e7db417f1b4829e05a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:55.976818 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3354/6741] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:55 2022] DELETE /identity/v3/users/95a0fa48d5174e7db417f1b4829e05a4 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:55.978429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:55.978718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:55.978992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:56.006315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:56.007400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:56.119840 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3388/6742] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:56.151950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:56.153672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:56.295708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f7f3f-6f43-475a-b0a6-7db9e3837242 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:56.300076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:56.300702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:56.300979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:56.301254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:56.327125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:56.328571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:56.357185 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3355/6743] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:45:56.693795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:56.695920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:56.720046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a5f53-dcc2-4484-be56-23208dd6bf16 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:56.727294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:56.727960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:56.728242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:56.728679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] PATH_INFO: `/v3/projects/19b70b271bd04ff1811ef1e71229c023` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:56.731506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b70b271bd04ff1811ef1e71229c023)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:56.733824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:56.955878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:56.957500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:56.978381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdfa99-5ba3-48e6-a1ca-4021112b12f8 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:56.981071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:56.981994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:56.982500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:56.982906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] PATH_INFO: `/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:56.984169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab913f2cb14d42dc8534a28cbd2d72f1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:56.986583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:57.029494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b70b271bd04ff1811ef1e71229c023', 'request_id': 'req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.146770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b70b271bd04ff1811ef1e71229c023', 'request_id': 'req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.158688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b70b271bd04ff1811ef1e71229c023', 'request_id': 'req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.179765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] The token cache is being invalidate because project 19b70b271bd04ff1811ef1e71229c023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:57.180470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.182175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.183150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab913f2cb14d42dc8534a28cbd2d72f1', 'request_id': 'req-b42a7547-70a3-46b6-acc7-d7399bd4273e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.184956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3389/6744] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:56 2022] DELETE /identity/v3/projects/19b70b271bd04ff1811ef1e71229c023 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:57.189660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:57.190760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab913f2cb14d42dc8534a28cbd2d72f1', 'request_id': 'req-b42a7547-70a3-46b6-acc7-d7399bd4273e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.191640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:57.195434 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:57.202587 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:57.299854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe031-2eb8-48e8-9ea5-0d53a0443a21 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:57.300548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab913f2cb14d42dc8534a28cbd2d72f1', 'request_id': 'req-b42a7547-70a3-46b6-acc7-d7399bd4273e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.315386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] The token cache is being invalidate because project ab913f2cb14d42dc8534a28cbd2d72f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:57.315814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.317096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.322712 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3356/6745] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:56 2022] DELETE /identity/v3/projects/ab913f2cb14d42dc8534a28cbd2d72f1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:57.323808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:57.327727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:57.386409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:57.387359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:57.387896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:57.388383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] PATH_INFO: `/v3/users/5c1f59536ef44328b9c56d5c4cf382df` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:57.390205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1f59536ef44328b9c56d5c4cf382df)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:57.392766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:57.423330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a7547-70a3-46b6-acc7-d7399bd4273e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:57.428443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:57.429085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:57.429406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:57.429689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] PATH_INFO: `/v3/users/02c524eded704946ac18e56e3b755faf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:57.430872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c524eded704946ac18e56e3b755faf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:57.432854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:57.647775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1f59536ef44328b9c56d5c4cf382df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.675214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c524eded704946ac18e56e3b755faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.676441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c524eded704946ac18e56e3b755faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.685100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c524eded704946ac18e56e3b755faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.685975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c524eded704946ac18e56e3b755faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.705254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1f59536ef44328b9c56d5c4cf382df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.706400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1f59536ef44328b9c56d5c4cf382df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.724016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1f59536ef44328b9c56d5c4cf382df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.739302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1f59536ef44328b9c56d5c4cf382df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.743497 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3390/6746] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:57 2022] DELETE /identity/v3/users/5c1f59536ef44328b9c56d5c4cf382df => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:57.786958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c524eded704946ac18e56e3b755faf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:57.817037 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3357/6747] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:45:57 2022] DELETE /identity/v3/users/02c524eded704946ac18e56e3b755faf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:58.068754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.070013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.127003 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:58.172998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0249156-b22e-4d88-8a36-bcd4683c6fe6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.254069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.255055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.255773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.256418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] PATH_INFO: `/v3/projects/90b37e316ca542ac915f7d27b062c171` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.258368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b37e316ca542ac915f7d27b062c171)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.261090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:58.406073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b37e316ca542ac915f7d27b062c171', 'request_id': 'req-ddf11569-33e4-42d1-a19a-448a08e27dd5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.464056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.465750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.483139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b37e316ca542ac915f7d27b062c171', 'request_id': 'req-ddf11569-33e4-42d1-a19a-448a08e27dd5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.488693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6afc20-933c-471f-9a5d-7a62999d9394 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.509025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b37e316ca542ac915f7d27b062c171', 'request_id': 'req-ddf11569-33e4-42d1-a19a-448a08e27dd5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.530347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] The token cache is being invalidate because project 90b37e316ca542ac915f7d27b062c171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:58.531147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.532147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ddf11569-33e4-42d1-a19a-448a08e27dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.534002 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3391/6748] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:58 2022] DELETE /identity/v3/projects/90b37e316ca542ac915f7d27b062c171 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:58.540495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344edd-b3b4-46cc-b009-2fa13b87b35f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.541773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344edd-b3b4-46cc-b009-2fa13b87b35f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.542325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344edd-b3b4-46cc-b009-2fa13b87b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.574792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-45344edd-b3b4-46cc-b009-2fa13b87b35f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:58.578823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-45344edd-b3b4-46cc-b009-2fa13b87b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.580904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.581628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.581983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.582428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] PATH_INFO: `/v3/projects/7ff2c51ea2e24e16adb0a6eaef7139a9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.584385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff2c51ea2e24e16adb0a6eaef7139a9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.586479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:58.587450 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3392/6749] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:58.595466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.595752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.596058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.607177 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:58.619474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:58.621029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.630113 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3393/6750] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:45:58.634994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.646619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ce63b-0d1c-47b5-a799-0c364925a3c8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.651977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.652573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.652852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.653122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.653968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:58.654269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.655936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:58.670078 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3394/6751] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:45:58.674691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.685127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74994-0f55-4b80-9f0a-424e2dc0e7a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.689925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.690641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.690988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.691264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.691921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.693923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:58.742166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff2c51ea2e24e16adb0a6eaef7139a9', 'request_id': 'req-aca34a67-5edc-4795-9fa4-3636200f73bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.749049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff2c51ea2e24e16adb0a6eaef7139a9', 'request_id': 'req-aca34a67-5edc-4795-9fa4-3636200f73bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.805225 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3395/6752] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:58.809222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.835787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff2c51ea2e24e16adb0a6eaef7139a9', 'request_id': 'req-aca34a67-5edc-4795-9fa4-3636200f73bd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.836154 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:58.869301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] The token cache is being invalidate because project 7ff2c51ea2e24e16adb0a6eaef7139a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:45:58.869935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.870695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aca34a67-5edc-4795-9fa4-3636200f73bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:45:58.872527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3358/6753] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:45:58 2022] DELETE /identity/v3/projects/7ff2c51ea2e24e16adb0a6eaef7139a9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:58.877118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526612-f8cd-4c82-9cb5-43598a1f333d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.877441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526612-f8cd-4c82-9cb5-43598a1f333d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.877720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526612-f8cd-4c82-9cb5-43598a1f333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.898583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fa95d-1f94-4467-80ff-bcfee821836d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.903640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.904456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.904573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d0526612-f8cd-4c82-9cb5-43598a1f333d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:58.904786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.905010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.905688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.905942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d0526612-f8cd-4c82-9cb5-43598a1f333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.907746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:58.915448 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3359/6754] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:58.922841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.923129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.923406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.943953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:58.945577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:58.956319 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3360/6755] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:58.961207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:58.971476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf041a-86a8-4ce6-9eef-f8bf51132912 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:58.979899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:58.979899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:58.979899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:58.979899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:58.981236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:45:58.981628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:58.983324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.003809 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3361/6756] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:45:59.012515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.033716 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3396/6757] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:58 2022] POST /identity/v3/users => generated 282 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:45:59.035356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d394d-8add-45e7-91da-ffd2f80156ff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.037959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.040461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:59.052714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.053433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.053699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.055537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.055537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.059406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.062332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b455b5d-2888-4745-b91b-94d99994e64e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.073876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.073876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.073876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.073876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.075176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.079453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.107560 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3397/6758] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:59.111156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.124748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3f201-ab17-4c1c-99a4-72ff306ca013 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.132696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.133447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.133828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.134266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.135268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.137373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.168408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3398/6759] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:59.173414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.181054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3362/6760] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:59 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:59.182158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.195902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e044f9-2e1d-494f-abe1-8cca44d072bb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.330947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.331861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.332290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.346205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] PATH_INFO: `/v3/projects/09f7be65f0bb4d319ea83da24d1ed96a/users/911dbc1397d9452e8dd1d42b633d93b3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.381911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22eea2-59f4-4936-8548-628358770c4a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.388810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.389976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.390607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.391178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.392226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.395493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.409026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f7be65f0bb4d319ea83da24d1ed96a, user_id=911dbc1397d9452e8dd1d42b633d93b3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.415413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a082726-012b-4cd4-a81f-852b111fdd5b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.514877 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3363/6761] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:45:59 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:45:59.519712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.535198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ec6f-91e4-429b-93e8-d5e0a1a15a81 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.549850 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3399/6762] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:59 2022] PUT /identity/v3/projects/09f7be65f0bb4d319ea83da24d1ed96a/users/911dbc1397d9452e8dd1d42b633d93b3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:45:59.557943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.558348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.558748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.620298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] MFA Rules not processed for user `911dbc1397d9452e8dd1d42b633d93b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:45:59.620916 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:59.621960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:45:59.645498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.645498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.645498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.645498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.645988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.647459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.663688 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3364/6763] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:59.665246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.678448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a9f51-24ee-4e25-b2e9-772bfbea79b5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.688614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.690014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.690489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.690871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.692118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.695783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.717967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3365/6764] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:45:59.719561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.736381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19884-049f-49c6-86b7-40847fb6ff96 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.751642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.752662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.752793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.752972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] PATH_INFO: `/v3/projects/d1ced93d2d0b4fad8e8e2b792fe7ae4f/users/44b4f51a68414355b62cfeb59e67e530/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.760143 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:45:59.765395 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3400/6765] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:45:59.769871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:45:59.782595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3f5c5-0de5-4474-8698-73b9e363c7f8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:45:59.789078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:45:59.790080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ced93d2d0b4fad8e8e2b792fe7ae4f, user_id=44b4f51a68414355b62cfeb59e67e530, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.793233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.793233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.793233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.793233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:45:59.794414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.797141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9201-5603-462c-b619-33ccf18267a0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:45:59.952357 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3366/6766] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:45:59 2022] PUT /identity/v3/projects/d1ced93d2d0b4fad8e8e2b792fe7ae4f/users/44b4f51a68414355b62cfeb59e67e530/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:45:59.963458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:45:59.963798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:45:59.964021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:45:59.996027 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3401/6767] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:45:59 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:00.002606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.020570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] MFA Rules not processed for user `44b4f51a68414355b62cfeb59e67e530`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:00.021810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:00.159429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768beda5-7937-4608-ab24-431d6851682a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.161412 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3367/6768] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:45:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:00.163045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.172176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.172861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.173667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.173667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.174113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.178141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.180611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cbe24-1691-4194-a26f-e39ba95d441c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.187838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.190030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.190030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.190030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.190030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.192418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.323652 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3402/6769] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:00 2022] POST /identity/v3/users => generated 288 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:00.327567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.340160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8c829-86e9-4267-ac22-c91453f90219 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.345832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.346802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.347262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.347692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.348504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.352808 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3368/6770] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:00 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:00.354383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.354978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.371069 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3403/6771] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:00.390111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.414456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707430ce-067a-4990-81c3-b1a16f82d632 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.486433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bccdc3-cb21-4439-8efc-7933356d3025 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.502949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.503815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.504163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.504503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.505825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.508525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.546967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.547648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.550808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.550808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] PATH_INFO: `/v3/projects/13054bd3d61f470ea6568435b3b3787f/users/7ac3aa9c107f4d619059c1d9da98e38d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.565264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13054bd3d61f470ea6568435b3b3787f, user_id=7ac3aa9c107f4d619059c1d9da98e38d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.568734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.597614 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:00.603023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3369/6772] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:00 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:00.607393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.618132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745385f-684f-44a9-99c5-b6d853a2dc75 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.623929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.624551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.624830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.625101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.625855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.627938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.640639 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3370/6773] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:00.647057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.666417 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3404/6774] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:00 2022] PUT /identity/v3/projects/13054bd3d61f470ea6568435b3b3787f/users/7ac3aa9c107f4d619059c1d9da98e38d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:00.667927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50973e5e-f678-4722-9ef6-61a8a1831f52 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.671211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.763346 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:00.790299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.791194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.791539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.792162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.793154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.794885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.805708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ac9b2-f53c-4f73-a58c-796d207dfd8c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.813858 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3371/6775] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:00.815055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.816985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.818922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.819207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.819483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.822230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.824403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.828141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28150f6b-78a5-4ea3-95a6-88e849b37131 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.834969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.835840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.835949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.836187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] PATH_INFO: `/v3/projects/fca1ee5b5790483ab9df117ed620c4dd/users/122a00d190a34363a2bb925c52ea2c83/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.840856 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3405/6776] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:00.843007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:00.855722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c496a8-41bd-4979-9780-ab7b7f5e88d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:00.859600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca1ee5b5790483ab9df117ed620c4dd, user_id=122a00d190a34363a2bb925c52ea2c83, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.861207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:00.861938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.862218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.862490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] PATH_INFO: `/v3/projects/13054bd3d61f470ea6568435b3b3787f/users/7ac3aa9c107f4d619059c1d9da98e38d/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.862862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268f80-dc9e-4854-be97-624daf2e5724 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.866175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13054bd3d61f470ea6568435b3b3787f, user_id=7ac3aa9c107f4d619059c1d9da98e38d, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:00.868806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06019a1d-18e5-4750-8af3-e71194a3cbcb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:00.881222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3406/6777] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:00 2022] PUT /identity/v3/projects/13054bd3d61f470ea6568435b3b3787f/users/7ac3aa9c107f4d619059c1d9da98e38d/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:00.895277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:00.895501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:00.896301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:00.926239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] MFA Rules not processed for user `7ac3aa9c107f4d619059c1d9da98e38d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:00.927898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:00.998947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3372/6778] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:00 2022] PUT /identity/v3/projects/fca1ee5b5790483ab9df117ed620c4dd/users/122a00d190a34363a2bb925c52ea2c83/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:01.011179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3407/6779] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:01.017083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:01.017083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:01.017083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:01.026686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:01.028537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:01.043880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] MFA Rules not processed for user `122a00d190a34363a2bb925c52ea2c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:01.045215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:01.101642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59952ae-9185-42f8-b705-c24dd9bd50e6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:01.136447 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3373/6780] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:01.152790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:01.155990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:01.160213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:01.161026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:01.161515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:01.161792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:01.186136 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:01.227073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede86e0-9e26-4b3c-adb3-7c55429b6565 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:01.231447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:01.232155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:01.232439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:01.232712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:01.237302 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:01.238579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:01.240712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3807-7d86-471d-9fea-200c4c90bc5c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:01.251825 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3408/6781] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:01.312304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:01.313843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:01.324012 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3374/6782] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:01.611675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:01.611990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:01.612273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:01.635168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:01.636394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:01.717189 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3409/6783] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:46:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:01.886021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:01.887649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:01.982959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed68f84-7398-471b-b59c-9a46e1bda75e service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:01.990216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:01.990913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:01.991197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:01.991475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:02.000843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:02.002464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74beadd-bf89-4fc3-8f75-45ee3b8d0b9a service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:02.013275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3375/6784] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:46:02.537838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:02.553439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76031-918a-4739-b0fd-59b6c96de08b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:02.557793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:02.559569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:02.560109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:02.561004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:02.574114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:02.576108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:02.589043 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3410/6785] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:02.648738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:02.649020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:02.649300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:02.671374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:02.674504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:02.685494 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3376/6786] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:02.698216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:02.712879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbf3db-5fd4-4c92-a1b1-af5a55cf9f13 service glance] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:02.718167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:02.718862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:02.719199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:02.719536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:02.729746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:02.731694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caf6cb-bb99-4714-bb71-be7d1af0de43 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:02.742334 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3411/6787] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:46:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:46:03.181879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:03.283981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5535f0-b334-4c07-80f9-43821e2ef2b0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:03.291633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:03.292360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:03.298357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:03.298357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] PATH_INFO: `/v3/users/44b4f51a68414355b62cfeb59e67e530` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:03.298357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b4f51a68414355b62cfeb59e67e530)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:03.298357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:03.490663 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:03.506420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b4f51a68414355b62cfeb59e67e530'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:03.507103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b4f51a68414355b62cfeb59e67e530'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:03.515594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b4f51a68414355b62cfeb59e67e530'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:03.516319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b4f51a68414355b62cfeb59e67e530'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:03.642585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b4f51a68414355b62cfeb59e67e530'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:03.669259 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3377/6788] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:03 2022] DELETE /identity/v3/users/44b4f51a68414355b62cfeb59e67e530 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:03.673966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:03.674453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:03.674679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:03.696952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:03.698261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:03.775538 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3412/6789] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:03.784024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:03.785694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:03.857758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a5a89-7e2e-40cd-8420-d66748279680 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:03.863561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:03.863561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:03.863561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:03.863561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:03.874152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:03.876162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:03.887849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3378/6790] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:04.295401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:04.297048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:04.322886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191a177-81bb-4885-80f7-f42b73003a7f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:04.334066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:04.334726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:04.335009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:04.335285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] PATH_INFO: `/v3/projects/d1ced93d2d0b4fad8e8e2b792fe7ae4f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:04.336571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ced93d2d0b4fad8e8e2b792fe7ae4f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:04.338822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:04.377845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:04.505549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:04.507312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:04.527789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38feb4-179f-4eb4-9b01-99b3cece9241 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:04.534071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ced93d2d0b4fad8e8e2b792fe7ae4f', 'request_id': 'req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:04.584316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:04.585028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:04.585325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:04.585626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:04.587813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:04.647814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ced93d2d0b4fad8e8e2b792fe7ae4f', 'request_id': 'req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:04.655791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ced93d2d0b4fad8e8e2b792fe7ae4f', 'request_id': 'req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:04.666566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:04.669313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:04.674427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] The token cache is being invalidate because project d1ced93d2d0b4fad8e8e2b792fe7ae4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:04.674427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:04.674427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:04.674427 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3413/6791] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:04 2022] DELETE /identity/v3/projects/d1ced93d2d0b4fad8e8e2b792fe7ae4f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:04.676252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:04.678581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:04.684695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3379/6792] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:04.755961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a425-c0b2-48d2-81c9-7a3d443faf1d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:04.760954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:04.761603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:04.766742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:04.766742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] PATH_INFO: `/v3/users/122a00d190a34363a2bb925c52ea2c83` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:04.766742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122a00d190a34363a2bb925c52ea2c83)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:04.766742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:05.059385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122a00d190a34363a2bb925c52ea2c83'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:05.150814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122a00d190a34363a2bb925c52ea2c83'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:05.151702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122a00d190a34363a2bb925c52ea2c83'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:05.166786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122a00d190a34363a2bb925c52ea2c83'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:05.174258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122a00d190a34363a2bb925c52ea2c83'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:05.182638 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3414/6793] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:04 2022] DELETE /identity/v3/users/122a00d190a34363a2bb925c52ea2c83 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:05.971996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:05.974314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:05.983183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:05.984630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:05.994415 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:05.999694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca72d2-f331-4590-93cd-f3a50cf8c23e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.028502 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:06.070781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.071482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.072251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.072251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] PATH_INFO: `/v3/users/911dbc1397d9452e8dd1d42b633d93b3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.073173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=911dbc1397d9452e8dd1d42b633d93b3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.075336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.078501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb66198-ad04-4511-a82b-4b39481b5747 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.084846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.085676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.086050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.086421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] PATH_INFO: `/v3/projects/fca1ee5b5790483ab9df117ed620c4dd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.088178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca1ee5b5790483ab9df117ed620c4dd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.090964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.308669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca1ee5b5790483ab9df117ed620c4dd', 'request_id': 'req-a0aa4b6b-1535-49b6-9dbf-f66f825db476'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.310667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '911dbc1397d9452e8dd1d42b633d93b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.311443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '911dbc1397d9452e8dd1d42b633d93b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.319223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '911dbc1397d9452e8dd1d42b633d93b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.321630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '911dbc1397d9452e8dd1d42b633d93b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.384563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca1ee5b5790483ab9df117ed620c4dd', 'request_id': 'req-a0aa4b6b-1535-49b6-9dbf-f66f825db476'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.392020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca1ee5b5790483ab9df117ed620c4dd', 'request_id': 'req-a0aa4b6b-1535-49b6-9dbf-f66f825db476'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.403333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] The token cache is being invalidate because project fca1ee5b5790483ab9df117ed620c4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:06.403598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.404722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a0aa4b6b-1535-49b6-9dbf-f66f825db476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.408495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3415/6794] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:05 2022] DELETE /identity/v3/projects/fca1ee5b5790483ab9df117ed620c4dd => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:06.415069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e887d-15ad-41eb-a3a5-54069f24157d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.415427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e887d-15ad-41eb-a3a5-54069f24157d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.415793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e887d-15ad-41eb-a3a5-54069f24157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.437917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-385e887d-15ad-41eb-a3a5-54069f24157d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:06.439777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-385e887d-15ad-41eb-a3a5-54069f24157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:06.470461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34315f38-ac2c-49dd-9508-d0856fd70f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '911dbc1397d9452e8dd1d42b633d93b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:06.501243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3380/6795] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:05 2022] DELETE /identity/v3/users/911dbc1397d9452e8dd1d42b633d93b3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:06.506855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.507141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.507422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.528496 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3416/6796] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:06.535346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:06.536570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.536723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:06.537038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.537869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.559592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:06.561419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:06.620588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3381/6797] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:06.631357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:06.632924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:06.643489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3417/6798] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:06.649084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:06.659872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaf326-b870-4566-8eb3-9c708bad5f12 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.664707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.665398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.665729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.667984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.668843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:06.669777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.671852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.688822 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3418/6799] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:06.690292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:06.707966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc09931-483c-4b85-a878-0088287deacc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.711114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1688fa-f4a0-495e-be39-6a80599949ee None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.715749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.724888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.724888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.725160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.725160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.725160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.725558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.725558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.725558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.725558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.728411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.730369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823335fd-b626-4276-bdf1-ffb5e65780e2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.746192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3382/6800] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:06.816161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.816802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.817139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.825144 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:06.828827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3419/6801] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:06.832865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:06.846303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] MFA Rules not processed for user `dcb021152c684983b31e5db439518921`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:06.847832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:06.911091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fc1cc-fcc4-4c14-b3f0-9ca1b1ac5f20 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:06.916740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:06.917317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:06.917691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:06.918024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:06.918723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:06.920698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:06.925718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3383/6802] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:06.952671 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:07.042692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.044968 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3420/6803] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:06 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:07.058155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c1629-22e8-4398-af76-74ba0cf4a315 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.067254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.068278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.068559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.068827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.069558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.071736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.086567 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3384/6804] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:07.090656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.102893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e5bd-f40b-4a52-b5fe-78e7598bf533 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.112940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.115231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.115557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.115871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.116518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.121308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.139591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3421/6805] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:07.143648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.155306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b4f4e-db7e-4ff8-96b6-328915572acf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.160908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.162454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.162736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.163011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] PATH_INFO: `/v3/projects/f19154f3c5974c36a3626c9edcff062c/users/da5f207ca3ac4b54888568d2ba32ca4b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.188293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19154f3c5974c36a3626c9edcff062c, user_id=da5f207ca3ac4b54888568d2ba32ca4b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.191336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91db176-4e23-4521-8ed9-a61a6845e4c8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.212032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.214276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:07.237248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc061f-a983-4196-b28a-504d045d02ff admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.246416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.246416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.246661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.246955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] PATH_INFO: `/v3/projects/09f7be65f0bb4d319ea83da24d1ed96a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.248094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f7be65f0bb4d319ea83da24d1ed96a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.250049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.295989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3385/6806] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:07 2022] PUT /identity/v3/projects/f19154f3c5974c36a3626c9edcff062c/users/da5f207ca3ac4b54888568d2ba32ca4b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:07.307956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.308430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.308706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.344784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] MFA Rules not processed for user `da5f207ca3ac4b54888568d2ba32ca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:07.346144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:07.404513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f7be65f0bb4d319ea83da24d1ed96a', 'request_id': 'req-33e8626f-fa47-484f-8dd2-60fc7703738e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.417258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3386/6807] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:07.417503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.460623 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:07.483984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899eee4-d93d-4196-93b8-2d622f0d45ad None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.504367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f7be65f0bb4d319ea83da24d1ed96a', 'request_id': 'req-33e8626f-fa47-484f-8dd2-60fc7703738e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.512971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f7be65f0bb4d319ea83da24d1ed96a', 'request_id': 'req-33e8626f-fa47-484f-8dd2-60fc7703738e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.528123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] The token cache is being invalidate because project 09f7be65f0bb4d319ea83da24d1ed96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:07.528445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.529135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.530713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3422/6808] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:07 2022] DELETE /identity/v3/projects/09f7be65f0bb4d319ea83da24d1ed96a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:07.531448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.533169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:07.537964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.538582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.538858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.539134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.540879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:07.552948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.554411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.567287 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3387/6809] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:07.568713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.570035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:07.586874 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:07.616614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8626f-fa47-484f-8dd2-60fc7703738e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.631300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.631557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.633192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.633192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.633192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.634630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.644874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e14be-2b78-4e40-a6cc-6dca88b2d4e4 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.652633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.653273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.653647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.654041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] PATH_INFO: `/v3/users/7ac3aa9c107f4d619059c1d9da98e38d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.655450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac3aa9c107f4d619059c1d9da98e38d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.661768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.768152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3423/6810] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:07 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:07.770523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:07.839339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d929cd0-8838-481d-bd7e-294754c60a55 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:07.845655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:07.846282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:07.846569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:07.846869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:07.847505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:07.849509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:07.913204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac3aa9c107f4d619059c1d9da98e38d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.913835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac3aa9c107f4d619059c1d9da98e38d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.921081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac3aa9c107f4d619059c1d9da98e38d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:07.921840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac3aa9c107f4d619059c1d9da98e38d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:08.026359 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3424/6811] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:07 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:08.030241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:08.031862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:08.045165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321b74-3fe1-4261-be00-3a2c3ea0d0e0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:08.050323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:08.050928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.051210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.053465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.053465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:08.054406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:08.065402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3425/6812] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:08.069196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:08.071969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac3aa9c107f4d619059c1d9da98e38d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:08.083645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee05654-67bb-47f6-9537-b6a058b91fd7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:08.085897 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:08.090012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:08.090728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.091038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.091319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.091964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:08.093580 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3388/6813] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:07 2022] DELETE /identity/v3/users/7ac3aa9c107f4d619059c1d9da98e38d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:08.097413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e4e60-8eea-484c-a76b-9f1ea76a384b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:08.110855 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3426/6814] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:08.120262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:08.237518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8add8b-c1b2-412d-bc97-bec5b6ac9000 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:08.258732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:08.258732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.258732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.258732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] PATH_INFO: `/v3/projects/8e245240028f4e9493c7368873512dc4/users/311355f90ac648229b72657a0a532711/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.284946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e245240028f4e9493c7368873512dc4, user_id=311355f90ac648229b72657a0a532711, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:08.288755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:08.392731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3389/6815] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:08 2022] PUT /identity/v3/projects/8e245240028f4e9493c7368873512dc4/users/311355f90ac648229b72657a0a532711/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:08.404737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.405032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.405314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.439459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] MFA Rules not processed for user `311355f90ac648229b72657a0a532711`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:08.440991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:08.529980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3427/6816] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:08.542746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:08.544820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:08.610062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e23a-68fb-47dc-aaf7-41755e1bbc20 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:08.614259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:08.615066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.615302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.615439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:08.615576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.617489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:08.617619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:08.633411 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:08.704851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab2644-d8c5-451c-a390-b83b352181b3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:08.705460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:08.706937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:08.710167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:08.710931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:08.711307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:08.711817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] PATH_INFO: `/v3/projects/13054bd3d61f470ea6568435b3b3787f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:08.713374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13054bd3d61f470ea6568435b3b3787f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:08.715891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:08.717418 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3390/6817] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:08.898739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13054bd3d61f470ea6568435b3b3787f', 'request_id': 'req-e5258b5e-1984-4080-a5ae-190fb385690e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:09.002826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13054bd3d61f470ea6568435b3b3787f', 'request_id': 'req-e5258b5e-1984-4080-a5ae-190fb385690e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:09.013280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13054bd3d61f470ea6568435b3b3787f', 'request_id': 'req-e5258b5e-1984-4080-a5ae-190fb385690e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:09.021470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.028038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] The token cache is being invalidate because project 13054bd3d61f470ea6568435b3b3787f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:09.028448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:09.029135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e5258b5e-1984-4080-a5ae-190fb385690e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:09.033894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fe36b-81ce-4481-8388-5ec4b0bebcab service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.035446 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3428/6818] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:08 2022] DELETE /identity/v3/projects/13054bd3d61f470ea6568435b3b3787f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:09.036936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbd72-f887-4bdf-853e-f2bedfa8cfd4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.037225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbd72-f887-4bdf-853e-f2bedfa8cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.037553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bbd72-f887-4bdf-853e-f2bedfa8cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.057999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-999bbd72-f887-4bdf-853e-f2bedfa8cfd4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:09.060117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-999bbd72-f887-4bdf-853e-f2bedfa8cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:09.065646 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:09.091330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.092051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.092285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.092568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.094536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:09.132003 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3429/6819] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:09.139956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.140246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.140514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.162508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:09.163722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:09.167487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.169500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.175377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3430/6820] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:09.178234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.186211 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3391/6821] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:09.188789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6ca99-416d-4ea8-8b40-fb026fd689c0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.194422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.195084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.197845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.197845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.197845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:09.197845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.199890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.217086 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3431/6822] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:09.222637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.235318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0426-d9aa-4a58-a911-1da90158d9ff service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.240660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.241389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.241739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.242300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.242996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.244940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.354360 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3392/6823] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:09 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:09.359922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.377844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36770639-ee24-4d08-842e-d71624b401be admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.395371 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:09.459566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.460183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.460464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.460744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.461428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.463344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.545656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3432/6824] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:09 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:09.550183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.562185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0836-a81b-429c-bda3-cc906d3717ff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.568592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.569614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.569962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.570297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.571128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.573060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.586778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3393/6825] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:09.594772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.605992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a23f7-f56c-4920-8daa-eb450044496f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.611129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.611818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.612162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.612593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.613250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.615519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05fa4-2cae-4603-b726-621e1445f3f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.631949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3433/6826] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:09.636474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:09.647375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6e05-8b1f-4b96-bff3-6eccf5349ab9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:09.652480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:09.654901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.654901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.654901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] PATH_INFO: `/v3/projects/57869c0e376946958c726a9de4ba2ce0/users/147c8ae6066341878e0bd7b3b6e75fc3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.670098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57869c0e376946958c726a9de4ba2ce0, user_id=147c8ae6066341878e0bd7b3b6e75fc3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:09.672764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:09.927018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3394/6827] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:09 2022] PUT /identity/v3/projects/57869c0e376946958c726a9de4ba2ce0/users/147c8ae6066341878e0bd7b3b6e75fc3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:09.937314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:09.937672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:09.938016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:09.969883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] MFA Rules not processed for user `147c8ae6066341878e0bd7b3b6e75fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:09.971216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:10.067162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3434/6828] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:10.077550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:10.079245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:10.155890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3daba-7379-4433-b222-4c8766d676b9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:10.159931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:10.160592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:10.160875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:10.161803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:10.171180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:10.172576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06970e31-0a20-4037-9e5c-8adf5d5214ab service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:10.184040 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3395/6829] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:13.050571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:13.052733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:13.216590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7068f8-2ce8-4c5e-8370-b3b5e2cd8a26 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:13.230666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:13.230994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:13.231279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:13.231554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] PATH_INFO: `/v3/users/da5f207ca3ac4b54888568d2ba32ca4b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:13.235668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5f207ca3ac4b54888568d2ba32ca4b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:13.242376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:13.381779 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:13.465209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5f207ca3ac4b54888568d2ba32ca4b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:13.522112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5f207ca3ac4b54888568d2ba32ca4b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:13.522894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5f207ca3ac4b54888568d2ba32ca4b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:13.548232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5f207ca3ac4b54888568d2ba32ca4b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:13.568749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5f207ca3ac4b54888568d2ba32ca4b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:13.586139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3435/6830] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:13 2022] DELETE /identity/v3/users/da5f207ca3ac4b54888568d2ba32ca4b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:13.587917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:13.588451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:13.589116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:13.627877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:13.640419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:13.689302 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:13.741509 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3396/6831] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:13.760694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:13.764420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:13.851236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11cff-e875-4760-b979-bd821d5cef84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:13.857516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:13.860472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:13.862405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:13.862405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:13.878586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:13.881400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:13.896060 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3436/6832] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:15.270735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:15.273238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:15.289515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fca69-62d9-428e-90d2-9302c411fd54 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:15.295141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:15.296263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:15.296746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:15.297472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] PATH_INFO: `/v3/projects/f19154f3c5974c36a3626c9edcff062c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:15.298850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19154f3c5974c36a3626c9edcff062c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:15.308727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:15.500008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19154f3c5974c36a3626c9edcff062c', 'request_id': 'req-0666deac-9b13-405c-82b8-49784b922c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:15.512126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19154f3c5974c36a3626c9edcff062c', 'request_id': 'req-0666deac-9b13-405c-82b8-49784b922c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:15.613000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19154f3c5974c36a3626c9edcff062c', 'request_id': 'req-0666deac-9b13-405c-82b8-49784b922c3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:15.637519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] The token cache is being invalidate because project f19154f3c5974c36a3626c9edcff062c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:15.637989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:15.641987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:15.644344 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3397/6833] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:15 2022] DELETE /identity/v3/projects/f19154f3c5974c36a3626c9edcff062c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:15.648780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:15.664545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbbb9c-0cbd-4689-a1cf-e42e7c7bbb80 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:15.768459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:15.769106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:15.769418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:15.769693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] PATH_INFO: `/v3/users/311355f90ac648229b72657a0a532711` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:15.771062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] RBAC: Authorizing `identity:delete_user(user_id=311355f90ac648229b72657a0a532711)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:15.773734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:16.062651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311355f90ac648229b72657a0a532711'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:16.063571 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:16.138818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311355f90ac648229b72657a0a532711'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:16.139411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311355f90ac648229b72657a0a532711'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:16.154919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311355f90ac648229b72657a0a532711'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:16.166010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9fb1a2e-e924-4549-8fbd-fa0140daefed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311355f90ac648229b72657a0a532711'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:16.176295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3437/6834] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:15 2022] DELETE /identity/v3/users/311355f90ac648229b72657a0a532711 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:16.758316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:16.758316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:16.779667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666deac-9b13-405c-82b8-49784b922c3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:16.869039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:16.870396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:16.871613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:16.871613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] PATH_INFO: `/v3/projects/8e245240028f4e9493c7368873512dc4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:16.874375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e245240028f4e9493c7368873512dc4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:16.878796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.039110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e245240028f4e9493c7368873512dc4', 'request_id': 'req-5bcd406a-b877-4b72-8c96-fce5f693b105'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:17.047434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e245240028f4e9493c7368873512dc4', 'request_id': 'req-5bcd406a-b877-4b72-8c96-fce5f693b105'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:17.049004 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:17.174400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e245240028f4e9493c7368873512dc4', 'request_id': 'req-5bcd406a-b877-4b72-8c96-fce5f693b105'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:17.187261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] The token cache is being invalidate because project 8e245240028f4e9493c7368873512dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:17.187567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:17.188393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5bcd406a-b877-4b72-8c96-fce5f693b105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:17.190423 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3398/6835] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:16 2022] DELETE /identity/v3/projects/8e245240028f4e9493c7368873512dc4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:17.196940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.199678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.199678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.221453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:17.228327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:17.311328 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3438/6836] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:17.320925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.321305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.321513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.360338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:17.360666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:17.373231 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3399/6837] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:17.375317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.388675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201137d-3ebc-4f57-b78b-4bbb01f290f3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.400325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.400325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.400325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.400325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.400945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:17.400945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.400945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.412408 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3439/6838] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:17.416583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.427000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc5eb-bc78-4da9-b098-defe1bd96e5c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.432370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.433869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.433869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.433869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.434365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.436109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.539085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3400/6839] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:17.543271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.565510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884d8bf-306b-41b0-a763-1fda8eea835e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.652886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.653946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.654228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.654496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.655143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.659597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.747631 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3440/6840] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:17 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:17.752011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.764068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc2353-d7e9-4dfe-bb0d-39abc372cacf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.779500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.779500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.779500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.779500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.779889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.781124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.797836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3401/6841] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:17.804117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.819208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0df33-de8e-4b83-a793-697edc880b64 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.825736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.832901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.832901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.832901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.832901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.832901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa7a08-af07-4cef-876a-bb01ecaff608 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.850567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3441/6842] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:17.861815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:17.866550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db7cdb-73e0-4aca-892d-9e043d84538a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:17.871404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:17.872062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.872469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.872775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] PATH_INFO: `/v3/projects/ac8612c6940e4c96bc96f648c1ff8450/users/83a358ed99594619b1b2fc55438731ad/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:17.890267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8612c6940e4c96bc96f648c1ff8450, user_id=83a358ed99594619b1b2fc55438731ad, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:17.893739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:17.982369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3402/6843] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:17 2022] PUT /identity/v3/projects/ac8612c6940e4c96bc96f648c1ff8450/users/83a358ed99594619b1b2fc55438731ad/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:17.996483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:17.996894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:17.997249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.026789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] MFA Rules not processed for user `83a358ed99594619b1b2fc55438731ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:18.028119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:18.053202 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:18.106107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3442/6844] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:18.108532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.185268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5add0-06f9-4883-b7fa-27fc381bf7d9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:18.192354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:18.193210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.193572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.193802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.194432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:18.196600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:18.315677 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3403/6845] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:18 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:18.320082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.331693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb26c1-c9cc-4bda-84d2-e16a0e0a7b89 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:18.397845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:18.398459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.398739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.399016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.399667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:18.402174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:18.530643 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3443/6846] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:18 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:18.534700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.547227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5bdd-cdfc-48e2-83d5-941eef863fb1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:18.552980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:18.553788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.554171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.554544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.555356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:18.557494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:18.571434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3404/6847] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:18.575298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.586979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3154cb0-9651-4845-b997-3c1e1b15dc1d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:18.591946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:18.592690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.593110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.593694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.594403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:18.597538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee8d7-d810-4304-b1ac-8f5d9c0018fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:18.612250 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3444/6848] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:18.614539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.625832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eac65-1318-435f-a408-c093de6d74da admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:18.631456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:18.632323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.632759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.633197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] PATH_INFO: `/v3/projects/c4ec0d955b074b4f81fc5bf30263945f/users/87511cb0a8a14d49a9edecfc57a7c810/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.651035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ec0d955b074b4f81fc5bf30263945f, user_id=87511cb0a8a14d49a9edecfc57a7c810, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:18.654411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:18.729940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3405/6849] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:18 2022] PUT /identity/v3/projects/c4ec0d955b074b4f81fc5bf30263945f/users/87511cb0a8a14d49a9edecfc57a7c810/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:18.818740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:18.819177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:18.819555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:18.850869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] MFA Rules not processed for user `87511cb0a8a14d49a9edecfc57a7c810`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:18.853012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:18.945174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3445/6850] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:18.957264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:18.959527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:18.997306 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:19.022780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dfeb5-7564-4391-a5e2-cc0b0716287c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:19.026396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:19.027007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:19.027287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:19.027555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:19.099122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:19.101057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:19.117322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3406/6851] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:19.490939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:19.509177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb1f22-d88a-4e6e-b291-26f422b783f9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:19.518744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:19.521799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:19.521799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:19.521799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:19.538666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:19.540432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3966de-30e9-4b1f-978c-9d4f564b769a service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:19.553887 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3446/6852] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:20.570365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:20.639842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee462359-76e0-4a46-bcc6-bea4b53279e5 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:20.644439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:20.645596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:20.646433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:20.646735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] PATH_INFO: `/v3/users/83a358ed99594619b1b2fc55438731ad` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:20.648112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a358ed99594619b1b2fc55438731ad)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:20.650055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:21.047951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a358ed99594619b1b2fc55438731ad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:21.048926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a358ed99594619b1b2fc55438731ad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:21.056499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a358ed99594619b1b2fc55438731ad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:21.057777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a358ed99594619b1b2fc55438731ad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:21.162757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a358ed99594619b1b2fc55438731ad'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:21.182361 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3407/6853] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:20 2022] DELETE /identity/v3/users/83a358ed99594619b1b2fc55438731ad => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:21.187026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:21.187882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:21.188163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:21.208211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:21.213920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:21.222052 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:21.273056 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3447/6854] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:21.283105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:21.284561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:21.294336 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:21.354031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a806d8d-5a1a-4a68-ab8b-b21e83b929d5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:21.354031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:21.354031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:21.354031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:21.354872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:21.365488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:21.366930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:21.376399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3408/6855] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:21.919061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:21.920165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:21.949363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acba01-fb80-4773-a078-45be9dbfff4c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:21.949363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:21.949363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:21.949363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:21.949947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] PATH_INFO: `/v3/projects/ac8612c6940e4c96bc96f648c1ff8450` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:21.949947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8612c6940e4c96bc96f648c1ff8450)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:21.952225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:22.113277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8612c6940e4c96bc96f648c1ff8450', 'request_id': 'req-7c80360c-5247-4f80-9b0f-313d591a9086'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.225461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8612c6940e4c96bc96f648c1ff8450', 'request_id': 'req-7c80360c-5247-4f80-9b0f-313d591a9086'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.234616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8612c6940e4c96bc96f648c1ff8450', 'request_id': 'req-7c80360c-5247-4f80-9b0f-313d591a9086'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.252719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] The token cache is being invalidate because project ac8612c6940e4c96bc96f648c1ff8450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:22.253403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.254279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.256052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3448/6856] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:21 2022] DELETE /identity/v3/projects/ac8612c6940e4c96bc96f648c1ff8450 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:22.260240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:22.271205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec39ab9-a92e-44d3-a14f-2d68eec2739c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:22.341496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:22.342070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:22.342352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:22.342623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] PATH_INFO: `/v3/users/87511cb0a8a14d49a9edecfc57a7c810` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:22.343845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87511cb0a8a14d49a9edecfc57a7c810)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:22.345850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:22.620184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87511cb0a8a14d49a9edecfc57a7c810'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.621009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87511cb0a8a14d49a9edecfc57a7c810'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.635646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87511cb0a8a14d49a9edecfc57a7c810'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.636387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87511cb0a8a14d49a9edecfc57a7c810'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.723416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bf0a8f76-e8f0-4d45-b377-25bddddd254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87511cb0a8a14d49a9edecfc57a7c810'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:22.754158 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3409/6857] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:22 2022] DELETE /identity/v3/users/87511cb0a8a14d49a9edecfc57a7c810 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:23.858208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:23.860545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:23.884709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80360c-5247-4f80-9b0f-313d591a9086 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:23.990735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:23.991821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:23.992309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:23.992818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] PATH_INFO: `/v3/projects/c4ec0d955b074b4f81fc5bf30263945f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:23.994264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ec0d955b074b4f81fc5bf30263945f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:23.996334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:24.167828 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:24.184738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ec0d955b074b4f81fc5bf30263945f', 'request_id': 'req-98c5e04a-ad58-40b6-bfb6-582a32c498f8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:24.300720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ec0d955b074b4f81fc5bf30263945f', 'request_id': 'req-98c5e04a-ad58-40b6-bfb6-582a32c498f8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:24.311770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ec0d955b074b4f81fc5bf30263945f', 'request_id': 'req-98c5e04a-ad58-40b6-bfb6-582a32c498f8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:24.337791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] The token cache is being invalidate because project c4ec0d955b074b4f81fc5bf30263945f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:24.338152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:24.339547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-98c5e04a-ad58-40b6-bfb6-582a32c498f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:24.341643 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3449/6858] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:23 2022] DELETE /identity/v3/projects/c4ec0d955b074b4f81fc5bf30263945f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:24.349023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:24.349647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:24.349647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:24.377196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:24.378463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:24.416389 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:24.459530 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3410/6859] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:24.468910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:24.469785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:24.470058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:24.495070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:24.496969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:24.512822 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3450/6860] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:24.514839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:24.526493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e5fef-a462-404d-b9d3-905d56dc510d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:24.533082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:24.533669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:24.533956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:24.534231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:24.539866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:24.540468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:24.553834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:24.572843 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3411/6861] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:24.576052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:24.588502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d0795-5dd8-4f0d-874c-9de67b0a8c32 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:24.593756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:24.599446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:24.599446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:24.599446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:24.599446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:24.599446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:24.714107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3451/6862] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:24 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:24.714722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:24.726206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88690c6-fd34-4f6b-b0ed-0cd03e807637 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:24.813958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:24.814574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:24.814854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:24.815127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:24.815755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:24.817917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.059175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3412/6863] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:24 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:25.061684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:25.074976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a652a73-f5c0-4b79-b2ea-b7f5f04b7e63 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:25.080119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:25.081157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.081539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.081886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.083174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:25.085753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.102100 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3452/6864] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:25.106817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:25.118708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a33ab-1211-4f04-8380-5c60af75a650 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:25.124885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:25.125909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.126264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.127092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.127471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:25.129791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc0ef-7bf8-4bbc-8d61-de8107e32648 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.147836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3413/6865] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:25.149120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:25.162106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a386-a57d-4c00-b3f3-bed2929f38cc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:25.168183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:25.168866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.169254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.169410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] PATH_INFO: `/v3/projects/e7df218219234442aa6d0a57b1a26164/users/dc13e23bdde241538ed2151d10a7e6e2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.187153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7df218219234442aa6d0a57b1a26164, user_id=dc13e23bdde241538ed2151d10a7e6e2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:25.191046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.314732 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3453/6866] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:25 2022] PUT /identity/v3/projects/e7df218219234442aa6d0a57b1a26164/users/dc13e23bdde241538ed2151d10a7e6e2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:25.328997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.329667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.332468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.399438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] MFA Rules not processed for user `dc13e23bdde241538ed2151d10a7e6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:25.399438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:25.489831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:25.491859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:25.494872 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3414/6867] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:25.508739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:25.510282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:25.548430 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:25.589607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c09c0c-cf9d-4bd7-b611-68f6eba708d7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:25.593549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe549a-34fe-4690-b357-6b679c5e2762 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:25.594934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:25.596502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.596790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.597267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] PATH_INFO: `/v3/users/147c8ae6066341878e0bd7b3b6e75fc3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.598661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:25.599168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147c8ae6066341878e0bd7b3b6e75fc3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:25.599281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:25.599557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:25.599832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:25.601130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.611447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:25.612935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020213d-d523-4fc9-8e26-07e8849005b7 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:25.626935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3415/6868] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:25.826315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147c8ae6066341878e0bd7b3b6e75fc3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:25.951439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147c8ae6066341878e0bd7b3b6e75fc3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:25.952056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147c8ae6066341878e0bd7b3b6e75fc3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:25.970639 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:25.976528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147c8ae6066341878e0bd7b3b6e75fc3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:25.987196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147c8ae6066341878e0bd7b3b6e75fc3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:25.997091 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3454/6869] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:25 2022] DELETE /identity/v3/users/147c8ae6066341878e0bd7b3b6e75fc3 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:26.002015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.005099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.005099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.022889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:26.024163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.089040 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3416/6870] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:26.100055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.101382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.181291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb84f-870e-47f3-a7ff-23ce32ecbea7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.185057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.185702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.185978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.186251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.192525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.193942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.202657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.204102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.207923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2578-0d29-48ee-af9f-491eadb8cd6b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.212956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.213629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.213906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.214188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] PATH_INFO: `/v3/users/dc13e23bdde241538ed2151d10a7e6e2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.214726 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3455/6871] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:26.215734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc13e23bdde241538ed2151d10a7e6e2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.217921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.417299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc13e23bdde241538ed2151d10a7e6e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.418394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc13e23bdde241538ed2151d10a7e6e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.425591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc13e23bdde241538ed2151d10a7e6e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.426759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc13e23bdde241538ed2151d10a7e6e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.490297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.492395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.508109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf193b4-1cc3-4ab0-ae06-ef294ea57e52 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.512189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc5d4063-3329-44df-aba8-5fcdc69a3a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc13e23bdde241538ed2151d10a7e6e2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.514145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.514989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.515828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.516284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] PATH_INFO: `/v3/projects/57869c0e376946958c726a9de4ba2ce0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.517695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57869c0e376946958c726a9de4ba2ce0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.519816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.544750 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3417/6872] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:26 2022] DELETE /identity/v3/users/dc13e23bdde241538ed2151d10a7e6e2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:26.546440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363653d1-e729-4783-a009-7360425d2822 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.546726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363653d1-e729-4783-a009-7360425d2822 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.547003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363653d1-e729-4783-a009-7360425d2822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.570991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-363653d1-e729-4783-a009-7360425d2822 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:26.572332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-363653d1-e729-4783-a009-7360425d2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.608964 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:26.637533 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3418/6873] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:26.647156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363653d1-e729-4783-a009-7360425d2822 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.648646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-363653d1-e729-4783-a009-7360425d2822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.652898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57869c0e376946958c726a9de4ba2ce0', 'request_id': 'req-31952eaa-206d-40ee-882f-f7d4314fab74'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.710264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363653d1-e729-4783-a009-7360425d2822 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.722258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57869c0e376946958c726a9de4ba2ce0', 'request_id': 'req-31952eaa-206d-40ee-882f-f7d4314fab74'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.730804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57869c0e376946958c726a9de4ba2ce0', 'request_id': 'req-31952eaa-206d-40ee-882f-f7d4314fab74'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.743519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] The token cache is being invalidate because project 57869c0e376946958c726a9de4ba2ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:26.743703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.749730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-31952eaa-206d-40ee-882f-f7d4314fab74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:26.749730 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3456/6874] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:26 2022] DELETE /identity/v3/projects/57869c0e376946958c726a9de4ba2ce0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:26.751183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f709b-0c69-4354-8544-c488f6e6935e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.751532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f709b-0c69-4354-8544-c488f6e6935e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.751895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f709b-0c69-4354-8544-c488f6e6935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.764706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.765596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.765828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.766103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.767923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.772639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d60f709b-0c69-4354-8544-c488f6e6935e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:26.773829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d60f709b-0c69-4354-8544-c488f6e6935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.836970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3457/6875] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:26.844798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.845098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.845388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.846269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.848714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.859225 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3419/6876] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:26.869872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:26.871123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:26.881476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3458/6877] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:26.884213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.894595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f66d-6661-471d-8357-84fdeb572028 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.899975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.900591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.900876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.901153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.901883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:26.902235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.903831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.921325 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3420/6878] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:46:26.922436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:26.932435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a10f-4fe3-469d-8301-c20fdebb53ab None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:26.937744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:26.942065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:26.942065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:26.942065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:26.942065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:26.942065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:26.946478 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:27.026272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3459/6879] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:26 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:27.031103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.041745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a6924-6819-4f32-befa-59664a50fa96 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.076203 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:27.107606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.110697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.110697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.110697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.110697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.111456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.211724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3421/6880] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:27.212952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.224024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aed8f-bf4e-477d-b6bd-a96bb09a37ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.228955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.229849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.230302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.230581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.234444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.234444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.242776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3460/6881] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:27.246762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.256717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da03bd-d475-4710-a271-5accb9fd606e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.261456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.262059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.262341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.263136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.263293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.264917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.276087 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3422/6882] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:27.280201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.291058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c28a60-c299-40fb-8646-0367ef00558a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.295714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.296367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.296647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.296920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] PATH_INFO: `/v3/projects/5028dd4dd468488aa386d7055aa9b13b/users/3110d5fc72b24853a0f103a5763b1a4f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.317368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5028dd4dd468488aa386d7055aa9b13b, user_id=3110d5fc72b24853a0f103a5763b1a4f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.317368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8e8da-d141-4e24-aa85-d5c86538f23f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.318926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.321236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.335554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa070b0-4dbb-4632-b3dd-0a06364b895a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.340575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.345496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.345496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.345496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] PATH_INFO: `/v3/projects/e7df218219234442aa6d0a57b1a26164` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.345496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7df218219234442aa6d0a57b1a26164)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.346302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.414937 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3461/6883] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:27 2022] PUT /identity/v3/projects/5028dd4dd468488aa386d7055aa9b13b/users/3110d5fc72b24853a0f103a5763b1a4f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:27.425080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.425393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.425782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.455140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] MFA Rules not processed for user `3110d5fc72b24853a0f103a5763b1a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:27.456372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.472467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7df218219234442aa6d0a57b1a26164', 'request_id': 'req-45a17de5-8b97-4b38-a160-5a8361e17386'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:27.478805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7df218219234442aa6d0a57b1a26164', 'request_id': 'req-45a17de5-8b97-4b38-a160-5a8361e17386'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:27.521200 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3462/6884] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:27.531822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.533112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.562005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7df218219234442aa6d0a57b1a26164', 'request_id': 'req-45a17de5-8b97-4b38-a160-5a8361e17386'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:27.573957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] The token cache is being invalidate because project e7df218219234442aa6d0a57b1a26164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:27.574250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:27.574907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45a17de5-8b97-4b38-a160-5a8361e17386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:27.576405 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3423/6885] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:27 2022] DELETE /identity/v3/projects/e7df218219234442aa6d0a57b1a26164 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:27.581500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cac67-cd8b-4522-8f44-cdbcb29589b5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.581788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cac67-cd8b-4522-8f44-cdbcb29589b5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.582082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cac67-cd8b-4522-8f44-cdbcb29589b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.593151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be49b3-545f-4580-9d60-e7cfbe254a1c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.602324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-062cac67-cd8b-4522-8f44-cdbcb29589b5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:27.607988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-062cac67-cd8b-4522-8f44-cdbcb29589b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.645602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.646131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.646410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.646682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.648542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.657977 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:27.664774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3424/6886] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:27.672255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.672539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.676694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.693442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:27.694542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.702884 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3425/6887] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:27.707156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.712435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.713974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.716501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677aad-be25-40dc-8ff7-6cb4895020d1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.721791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.722380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.722686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.723528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.723858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3463/6888] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:27.725750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:27.726131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.727958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.739697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.741093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:27.741831 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3426/6889] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:46:27.745841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.754938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13850-4777-4d55-bfc8-f1c79b56066c service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.756171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b737-be5a-42d1-a0b5-68c486bd83e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.760052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.760675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.760953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.761093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.761207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] PATH_INFO: `/v3/users/3110d5fc72b24853a0f103a5763b1a4f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.761556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.761835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.762102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.762386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3110d5fc72b24853a0f103a5763b1a4f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.762714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.764316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.764637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.781106 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:27.871790 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3427/6890] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:27.876023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:27.940793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355fabe-7c7b-469a-9071-fdc5a52c3b8b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:27.945475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:27.946150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:27.950589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:27.950589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:27.950589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:27.950589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:27.998680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3110d5fc72b24853a0f103a5763b1a4f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.064665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3110d5fc72b24853a0f103a5763b1a4f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.065566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3110d5fc72b24853a0f103a5763b1a4f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.071429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3428/6891] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:27 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:28.075359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.076895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:28.082781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3110d5fc72b24853a0f103a5763b1a4f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.091489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24a29e-395d-4680-a7b5-7861c5860571 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.092826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2cc1fe4e-140a-466c-b834-209978b1ca42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3110d5fc72b24853a0f103a5763b1a4f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.097920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.098528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.098918 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3464/6892] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:27 2022] DELETE /identity/v3/users/3110d5fc72b24853a0f103a5763b1a4f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:28.101485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.102221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.103570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.103846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.104113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.104945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.106561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.120495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3429/6893] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:28.126417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.127163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:28.128367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:28.138538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c481a8-cb7c-4ac7-9d4a-8387525b60df admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.194162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3465/6894] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:28.204584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.204777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.205200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.205641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.205925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.206328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:28.206674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.208262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.219569 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3430/6895] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:28.223378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.233168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db9867-c010-4ecc-9d0f-037587784059 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.235977 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:28.238667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.239311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.239589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.239887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] PATH_INFO: `/v3/projects/74197d6e6eb44d1b8102e0d8fd2247c9/users/51d9cbc753034ddb8c9ab85c3c874e4d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.261550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74197d6e6eb44d1b8102e0d8fd2247c9, user_id=51d9cbc753034ddb8c9ab85c3c874e4d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.261550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.269923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158e6b-5d34-4927-8672-96b3575c99d5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.274417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.275043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.275318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.275586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.284864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.286351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafd7f2-54e2-45e9-bdc7-b6dad6aefa7f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.301556 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3466/6896] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:28.345665 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3431/6897] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:28 2022] PUT /identity/v3/projects/74197d6e6eb44d1b8102e0d8fd2247c9/users/51d9cbc753034ddb8c9ab85c3c874e4d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:28.357980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.358445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.358729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.402771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] MFA Rules not processed for user `51d9cbc753034ddb8c9ab85c3c874e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:28.404204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:28.476034 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3467/6898] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:28.478969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.557167 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:28.579687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061fd01-f8ca-433c-b271-925ef14275cc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.585197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.586067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.586425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.586648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.587411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.589149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.706849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3432/6899] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:28 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:28.710730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.721867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7573-91d7-4358-b7bd-7d213b958882 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.784855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.786415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:28.789371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.789988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.790364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.790533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.791171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.793096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.813729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a216-a6d4-4804-89fd-01f5c0b750e2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.820730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.821515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.825007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.825007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] PATH_INFO: `/v3/projects/5028dd4dd468488aa386d7055aa9b13b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.825007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5028dd4dd468488aa386d7055aa9b13b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.825319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.882933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3468/6900] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:28 2022] POST /identity/v3/users => generated 301 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:28.884019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.899607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a974a2-d344-4888-93da-48c1ac1ba307 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.904381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.905010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.905314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.905629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.906274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.907861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.919230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3469/6901] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:28.922761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:28.933095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7e2fb-74dd-48ae-ae3f-a04969cf075a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:28.937924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:28.938575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:28.938888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:28.939165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] PATH_INFO: `/v3/projects/ae160536cac24d8097e990fd90803828/users/b45e58ebe36047f6bf28ddf63f77929a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:28.955501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae160536cac24d8097e990fd90803828, user_id=b45e58ebe36047f6bf28ddf63f77929a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:28.958151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:28.960652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5028dd4dd468488aa386d7055aa9b13b', 'request_id': 'req-2c774dee-25ff-4ec8-9ad6-dbba809d2411'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:28.969733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5028dd4dd468488aa386d7055aa9b13b', 'request_id': 'req-2c774dee-25ff-4ec8-9ad6-dbba809d2411'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:29.044382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3470/6902] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:28 2022] PUT /identity/v3/projects/ae160536cac24d8097e990fd90803828/users/b45e58ebe36047f6bf28ddf63f77929a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:29.048139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.058832 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:29.071961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5028dd4dd468488aa386d7055aa9b13b', 'request_id': 'req-2c774dee-25ff-4ec8-9ad6-dbba809d2411'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:29.091257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] The token cache is being invalidate because project 5028dd4dd468488aa386d7055aa9b13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:29.091553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:29.094026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2c774dee-25ff-4ec8-9ad6-dbba809d2411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:29.109692 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3433/6903] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:28 2022] DELETE /identity/v3/projects/5028dd4dd468488aa386d7055aa9b13b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:29.114434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c324-b5cb-4379-9af9-e8fb19729f45 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.114841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c324-b5cb-4379-9af9-e8fb19729f45 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.115709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c324-b5cb-4379-9af9-e8fb19729f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.128190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc882-e8ab-4892-8820-e32627a960ca admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.134898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.135697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.136797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.137257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.138109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.139717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.147014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-82f7c324-b5cb-4379-9af9-e8fb19729f45 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:29.148508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-82f7c324-b5cb-4379-9af9-e8fb19729f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.154069 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3471/6904] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:29.155962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.159101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.170723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3434/6905] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:29.177047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808008-5833-4a5c-a175-d268a39463dc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.179386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc8ad-a1ca-4f88-a169-abfcca92f32c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.179782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc8ad-a1ca-4f88-a169-abfcca92f32c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.180198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccc8ad-a1ca-4f88-a169-abfcca92f32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.184246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.184903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.185266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.185577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] PATH_INFO: `/v3/projects/ae160536cac24d8097e990fd90803828/users/b45e58ebe36047f6bf28ddf63f77929a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.187612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae160536cac24d8097e990fd90803828, user_id=b45e58ebe36047f6bf28ddf63f77929a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.190409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70a8f3-a422-4355-a8fa-154fa2b339f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.200881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3472/6906] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:29 2022] PUT /identity/v3/projects/ae160536cac24d8097e990fd90803828/users/b45e58ebe36047f6bf28ddf63f77929a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:29.205658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-25ccc8ad-a1ca-4f88-a169-abfcca92f32c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:29.205772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.205772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.205939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-25ccc8ad-a1ca-4f88-a169-abfcca92f32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.206033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.226015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:29.228224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.278258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3435/6907] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:29.282677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.282677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.282677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.304994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3473/6908] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:29.306139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.311782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] MFA Rules not processed for user `b45e58ebe36047f6bf28ddf63f77929a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:29.312974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.317601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b7242-87d7-4947-91e8-6572affc8b1e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.322411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.323011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.323289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.323558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.324201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:29.324501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.326349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.338864 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3474/6909] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:29.343113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.353602 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:29.354028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9299d-2a50-4906-a753-a6a4f42a09fa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.359919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.361124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.361124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.361124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.362160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.364972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.397375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3436/6910] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:29.407315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.408818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.462746 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3475/6911] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:29.466759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.480222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d849dd-774a-4e96-bcac-513f5a5fc244 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.539090 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:29.550917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.551729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.552013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.552312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.555476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:29.559685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3b030-acd8-47e6-a0ac-f3771abba6a2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.566391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.567284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.567662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.568033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.568738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.571471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.633718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.635495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.646683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3437/6912] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:29.700059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3476/6913] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:29.702429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.715876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f0e73-6748-4ec7-9d5f-94ccce29d09a service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.720490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.721935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.722246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.728052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.728052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.728052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.736779 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3438/6914] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:29.740892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.751269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcf279-d426-4f92-b8d9-5c3d3aaf5418 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.756564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.757170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.757483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.758395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.758395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.759984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240ca74-975b-48c4-9131-4598d26780d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.785664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3477/6915] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:29.785894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:29.798933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cdad-94d2-4c3c-93fd-21fdd81a73e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:29.807554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:29.808241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.808523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.808827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] PATH_INFO: `/v3/projects/cfd1f4cb0ad1485da3e922edb9137d8b/users/0aab2d012bb24efe97e6108a0e2ffcad/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.829315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd1f4cb0ad1485da3e922edb9137d8b, user_id=0aab2d012bb24efe97e6108a0e2ffcad, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:29.832262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:29.912632 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3439/6916] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:29 2022] PUT /identity/v3/projects/cfd1f4cb0ad1485da3e922edb9137d8b/users/0aab2d012bb24efe97e6108a0e2ffcad/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:29.922474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:29.922778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:29.923048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:29.951352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] MFA Rules not processed for user `0aab2d012bb24efe97e6108a0e2ffcad`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:29.952537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:30.055055 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3478/6917] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:30.066371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:30.068166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:30.079300 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:30.164184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684986-4e9e-404f-aa95-79842c7c2d53 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:30.168189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:30.168776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:30.169058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:30.169350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:30.178557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:30.180553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcde833-a6ea-4b83-8b8f-ef02ab858ce5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:30.189739 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3440/6918] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:30.204826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:30.345210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c8be-57a9-4d4a-894b-d3135fa3a927 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:30.353435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:30.357352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:30.357352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:30.357352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] PATH_INFO: `/v3/users/0aab2d012bb24efe97e6108a0e2ffcad` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:30.357352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aab2d012bb24efe97e6108a0e2ffcad)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:30.358577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:30.567113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aab2d012bb24efe97e6108a0e2ffcad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:30.682514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aab2d012bb24efe97e6108a0e2ffcad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:30.683506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aab2d012bb24efe97e6108a0e2ffcad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:30.692209 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:30.699082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aab2d012bb24efe97e6108a0e2ffcad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:30.707105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aab2d012bb24efe97e6108a0e2ffcad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:30.719403 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3479/6919] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:30 2022] DELETE /identity/v3/users/0aab2d012bb24efe97e6108a0e2ffcad => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:30.719581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:30.719581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:30.719581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:30.742484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:30.747498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:30.805597 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3441/6920] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:30.815391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:30.816931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:30.877626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd7f90-99c0-4114-aa06-d4cb1359f09b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:30.881881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:30.882628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:30.883073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:30.883456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:30.893855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:30.895448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb718-7f6e-42b9-b8ab-f3cb2f3ac770 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:30.906382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3480/6921] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:31.386641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:31.388254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:31.412476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33477-2e8d-4cf6-beea-6c86a35ecd76 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:31.419749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:31.420390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:31.420666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:31.420935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] PATH_INFO: `/v3/projects/cfd1f4cb0ad1485da3e922edb9137d8b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:31.422211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd1f4cb0ad1485da3e922edb9137d8b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:31.424398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:31.544058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd1f4cb0ad1485da3e922edb9137d8b', 'request_id': 'req-fe0b49ed-a790-4faa-a860-7d7e26387683'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:31.551366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd1f4cb0ad1485da3e922edb9137d8b', 'request_id': 'req-fe0b49ed-a790-4faa-a860-7d7e26387683'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:31.613261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd1f4cb0ad1485da3e922edb9137d8b', 'request_id': 'req-fe0b49ed-a790-4faa-a860-7d7e26387683'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:31.625509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] The token cache is being invalidate because project cfd1f4cb0ad1485da3e922edb9137d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:31.625800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:31.626432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fe0b49ed-a790-4faa-a860-7d7e26387683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:31.627917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3442/6922] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:31 2022] DELETE /identity/v3/projects/cfd1f4cb0ad1485da3e922edb9137d8b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:31.633771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:31.634270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:31.634368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:31.655845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:31.657093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:31.751034 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3481/6923] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:31.759842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:31.761224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:31.761692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:31.809085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:31.812800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:31.830910 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3443/6924] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:31.835635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:31.857664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3fc72-a97b-4416-9b77-d92c98a08585 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:31.866837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:31.867396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:31.867926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:31.868220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:31.869178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:31.869418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:31.871034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:31.904984 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3482/6925] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:31.906301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:31.917971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2196b-0546-49a7-8580-702243ead28e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:31.924812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:31.928195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:31.928195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:31.928195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:31.928195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:31.928961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.055897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3444/6926] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:31 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:32.059942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:32.071279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442da7e-83d9-4e4c-a52b-9d7b5406f80a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:32.173400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:32.174355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.175647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.176124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.178346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:32.181733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.266877 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:32.287501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3483/6927] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:32 2022] POST /identity/v3/users => generated 279 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:32.288720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:32.301371 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:32.324614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b252cca-7098-4424-8145-17d4edd9cdd9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:32.329604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:32.330224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.330506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.330778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.331428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:32.334447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.350274 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3445/6928] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:32.355011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:32.382665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71a2b-cf8e-437e-87ac-caced717aec1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:32.413034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:32.413858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.414134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.414410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.415070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:32.417099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc558e2-93a6-4451-9e4f-f9566c086a5f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.440646 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3484/6929] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:32.441950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:32.455644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbebf9-aba5-467f-be02-969bf37c0ae7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:32.468243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:32.468997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.469291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.469603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] PATH_INFO: `/v3/projects/bef7978eace3493b816ddb0f4e67bcbb/users/7aa6ab881c0c48d49ed398c520911413/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.498340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef7978eace3493b816ddb0f4e67bcbb, user_id=7aa6ab881c0c48d49ed398c520911413, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:32.508628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.592776 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3446/6930] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:32 2022] PUT /identity/v3/projects/bef7978eace3493b816ddb0f4e67bcbb/users/7aa6ab881c0c48d49ed398c520911413/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:32.603830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.604119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.604646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.641356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] MFA Rules not processed for user `7aa6ab881c0c48d49ed398c520911413`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:32.642683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:32.753710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3485/6931] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:32.760196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:32.849976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab11b5-471a-4489-b218-c9aa268074c8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:32.860071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:32.860697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:32.860978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:32.861251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:32.862685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:32.864048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:32.981142 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3447/6932] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:32 2022] POST /identity/v3/projects => generated 355 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:32.983310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.000897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a619a-0387-4dda-a574-335a11daa960 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.089546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.090469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.090919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.091373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.092257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.094874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.182296 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3486/6933] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:32 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:33.186140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.199548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5f177-aec9-4183-82eb-509ed4db02c0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.205519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.206584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.207154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.207707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.209199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.211508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.228536 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3448/6934] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:33.232613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.245894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ff76a-be76-419e-b3a6-3dc9a0fc563f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.252581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.253458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.253846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.254231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] PATH_INFO: `/v3/projects/086505747861465b865478287d106a22/users/3133110b7d664dc28dcf2d43b2f3af8a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.276765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] RBAC: Authorizing `identity:create_grant(project_id=086505747861465b865478287d106a22, user_id=3133110b7d664dc28dcf2d43b2f3af8a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.279743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.336537 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3487/6935] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:33 2022] PUT /identity/v3/projects/086505747861465b865478287d106a22/users/3133110b7d664dc28dcf2d43b2f3af8a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:33.341212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.355041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd3574-659d-4508-abb8-2aea6e3550e8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.440897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.441561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.441954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.442319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.443641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.445494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbebb0d-209b-4ba2-83e7-314f8675708b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.459031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3449/6936] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:33.463668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.474684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662779c-5b34-4724-83e0-bb7a0b28477b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.479925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.480607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.480895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.481405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] PATH_INFO: `/v3/projects/086505747861465b865478287d106a22/users/3133110b7d664dc28dcf2d43b2f3af8a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.483485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086505747861465b865478287d106a22, user_id=3133110b7d664dc28dcf2d43b2f3af8a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.486874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.538388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.538818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.539256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.556878 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3488/6937] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:33 2022] PUT /identity/v3/projects/086505747861465b865478287d106a22/users/3133110b7d664dc28dcf2d43b2f3af8a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:33.565652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.568903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:33.588123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] MFA Rules not processed for user `3133110b7d664dc28dcf2d43b2f3af8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:33.589373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:33.626769 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:33.636610 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:33.692629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b8e1f-a8cd-42b1-909c-0fab292945d0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.704225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.705221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.705512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.706500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.707075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3450/6938] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:33.711023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:33.725503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:33.726920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:33.868377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.870052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:33.903884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855f8dd-1246-4638-bba6-c4ac43bb9b6d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:33.906621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3489/6939] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:33.912522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:33.915141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:33.916569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:33.919704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:33.949565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:33.955785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:34.014318 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3451/6940] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:34.238248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:34.260975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5034d5-a4d4-4440-8c15-8406af84b80e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:34.277857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:34.278813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:34.279475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:34.279967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:34.442850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:34.445767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5e19d-52ec-431b-8597-afded0bbab6f service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:34.464589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3490/6941] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:39.833255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:39.835604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:39.985254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbbced-5a29-497d-9000-4dd14e08e587 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:39.992047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:39.992798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:39.993090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:39.996190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] PATH_INFO: `/v3/users/51d9cbc753034ddb8c9ab85c3c874e4d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:39.996190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d9cbc753034ddb8c9ab85c3c874e4d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:39.997140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:40.242830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d9cbc753034ddb8c9ab85c3c874e4d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:40.244345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d9cbc753034ddb8c9ab85c3c874e4d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:40.256937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d9cbc753034ddb8c9ab85c3c874e4d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:40.261498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d9cbc753034ddb8c9ab85c3c874e4d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:40.264902 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:40.351777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d9cbc753034ddb8c9ab85c3c874e4d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:40.412450 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3452/6942] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:39 2022] DELETE /identity/v3/users/51d9cbc753034ddb8c9ab85c3c874e4d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:40.413669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:40.414132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:40.414244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:40.436555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:40.438751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:40.547084 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3491/6943] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:40.554071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:40.572455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:40.706741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b960-ad65-4cac-9b97-853f71b866b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:40.736566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:40.746079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:40.755998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:40.755998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:40.778184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:40.781102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:40.810363 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3453/6944] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:41.345077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:41.346565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:41.359639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ff47d-5e19-4e58-be81-f4846571cd4a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:41.365678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:41.367975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:41.368283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:41.368558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] PATH_INFO: `/v3/projects/74197d6e6eb44d1b8102e0d8fd2247c9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:41.370183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74197d6e6eb44d1b8102e0d8fd2247c9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:41.372748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:41.405621 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:41.572952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74197d6e6eb44d1b8102e0d8fd2247c9', 'request_id': 'req-021f0d1a-08b3-49a9-9361-cccb607e2306'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:41.653941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74197d6e6eb44d1b8102e0d8fd2247c9', 'request_id': 'req-021f0d1a-08b3-49a9-9361-cccb607e2306'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:41.663144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74197d6e6eb44d1b8102e0d8fd2247c9', 'request_id': 'req-021f0d1a-08b3-49a9-9361-cccb607e2306'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:41.686909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] The token cache is being invalidate because project 74197d6e6eb44d1b8102e0d8fd2247c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:41.687516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:41.688679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:41.691776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3492/6945] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:41 2022] DELETE /identity/v3/projects/74197d6e6eb44d1b8102e0d8fd2247c9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:41.695720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:41.708734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36fb75-f938-4b66-91d3-86ce61edd79b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:41.863840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:41.865624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:41.866009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:41.866388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] PATH_INFO: `/v3/users/b45e58ebe36047f6bf28ddf63f77929a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:41.869080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45e58ebe36047f6bf28ddf63f77929a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:41.871345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:42.166972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45e58ebe36047f6bf28ddf63f77929a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.168903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45e58ebe36047f6bf28ddf63f77929a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.180050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45e58ebe36047f6bf28ddf63f77929a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.183818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45e58ebe36047f6bf28ddf63f77929a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.270691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45e58ebe36047f6bf28ddf63f77929a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.299146 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:42.304790 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3454/6946] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:41 2022] DELETE /identity/v3/users/b45e58ebe36047f6bf28ddf63f77929a => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:42.422492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:42.426685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:42.452606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d1a-08b3-49a9-9361-cccb607e2306 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:42.613096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:42.613980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:42.615679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:42.616436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] PATH_INFO: `/v3/users/8c2e24f59fbb419ea9b10b81fe3cf316` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:42.622346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2e24f59fbb419ea9b10b81fe3cf316)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:42.624568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:42.873912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2e24f59fbb419ea9b10b81fe3cf316'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.962620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2e24f59fbb419ea9b10b81fe3cf316'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.966097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2e24f59fbb419ea9b10b81fe3cf316'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:42.995479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:42.998213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.018919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2e24f59fbb419ea9b10b81fe3cf316'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.028607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bef6-2d78-402f-af49-740e60fcac7e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:43.039725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4bb87e7a-7c3f-42e6-9dc0-50c1caa56627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2e24f59fbb419ea9b10b81fe3cf316'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.045211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:43.046139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.046488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.050402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] PATH_INFO: `/v3/projects/ae160536cac24d8097e990fd90803828` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.055889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae160536cac24d8097e990fd90803828)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:43.059410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:43.092070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3493/6947] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:42 2022] DELETE /identity/v3/users/8c2e24f59fbb419ea9b10b81fe3cf316 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:43.096631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.096631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.103108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.149906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:43.151230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.197130 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:43.268245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae160536cac24d8097e990fd90803828', 'request_id': 'req-d4ecb396-63b9-4304-b05e-8beb326755d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.280413 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3494/6948] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:43.283367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae160536cac24d8097e990fd90803828', 'request_id': 'req-d4ecb396-63b9-4304-b05e-8beb326755d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.288577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:43.294273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.384434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae160536cac24d8097e990fd90803828', 'request_id': 'req-d4ecb396-63b9-4304-b05e-8beb326755d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.388833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee250-1bf7-4490-9c6d-84a5706cf8ad None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:43.423692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] The token cache is being invalidate because project ae160536cac24d8097e990fd90803828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:43.426669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.429010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d4ecb396-63b9-4304-b05e-8beb326755d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:43.433740 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3455/6949] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:42 2022] DELETE /identity/v3/projects/ae160536cac24d8097e990fd90803828 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:43.436572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880b42-62aa-49d3-8559-b887ff02f8a4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.436849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880b42-62aa-49d3-8559-b887ff02f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.437126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63880b42-62aa-49d3-8559-b887ff02f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.506978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-63880b42-62aa-49d3-8559-b887ff02f8a4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:43.508188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-63880b42-62aa-49d3-8559-b887ff02f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.569606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:43.572621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.572621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.572621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.576544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.655993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3456/6950] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:43.668379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.668668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.668949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.719625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:43.721246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:43.726923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:43.732237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:43.745870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3495/6951] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:43.765027 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3457/6952] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:43.767975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:43.786002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979792b-886d-4a53-8570-6de57251aef1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:43.794411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:43.795507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.795507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.795888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.796756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:43.797192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:43.799803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:43.835620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3496/6953] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:43.839846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:43.852578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880dd74-5620-4863-84de-7384d4b9574e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:43.885631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:43.886277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:43.886563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:43.886845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:43.887497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:43.889705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.066878 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3458/6954] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:43 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:44.068067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.084721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d37628-f94c-4607-8041-e37372e398c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:44.221920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:44.226230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.226230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.226230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.226230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:44.226620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.258851 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:44.339211 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3497/6955] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:44 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:46:44.343449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.360049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aed5-e182-4f2d-b3aa-938edbea0d65 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:44.369071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:44.369799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.370113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.370351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.371006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:44.376596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.400036 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3459/6956] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:44.404357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.417303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a581b-29f1-4b45-8887-9c2e33364f63 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:44.428769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:44.429289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.429622 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.429896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.430604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:44.440915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.452236 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3498/6957] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:44.456481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.471393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291d06f-08dc-4326-ac70-73faf1a8ae64 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:44.477394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:44.478198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.478553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.479152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] PATH_INFO: `/v3/projects/6c7af8a6f58048fba4989d3f09a4b8c3/users/ee5d1da3e23b4ff5a7bf0cb44540617d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.494528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.500766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:44.522656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81979ff-7446-4ddc-855e-5e302f8e15f1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:44.534368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7af8a6f58048fba4989d3f09a4b8c3, user_id=ee5d1da3e23b4ff5a7bf0cb44540617d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:44.541450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7d5ef-87a2-46d1-b58a-4ad45bf50728 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.543348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:44.543996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.544271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.544539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] PATH_INFO: `/v3/projects/4413038faa4e48f7b49b37c31bb63da2` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.547207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4413038faa4e48f7b49b37c31bb63da2)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:44.552033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:44.633420 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3460/6958] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:44 2022] PUT /identity/v3/projects/6c7af8a6f58048fba4989d3f09a4b8c3/users/ee5d1da3e23b4ff5a7bf0cb44540617d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:44.644546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.644863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.645101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:44.712532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] MFA Rules not processed for user `ee5d1da3e23b4ff5a7bf0cb44540617d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:44.715224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:44.729271 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:44.778113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4413038faa4e48f7b49b37c31bb63da2', 'request_id': 'req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:44.874460 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3461/6959] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:44.889115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:44.890976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:44.898493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4413038faa4e48f7b49b37c31bb63da2', 'request_id': 'req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:44.901922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4413038faa4e48f7b49b37c31bb63da2', 'request_id': 'req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:44.928572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] The token cache is being invalidate because project 4413038faa4e48f7b49b37c31bb63da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:44.928880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:44.931273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-aa9f011a-d3c9-44f2-ba53-abadc0c92fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:44.938241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3499/6960] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:44 2022] DELETE /identity/v3/projects/4413038faa4e48f7b49b37c31bb63da2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:44.943087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a4ae-bdc5-4ccd-aa29-1f2e8ef735ab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:44.943341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a4ae-bdc5-4ccd-aa29-1f2e8ef735ab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:44.943627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725a4ae-bdc5-4ccd-aa29-1f2e8ef735ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.007666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4725a4ae-bdc5-4ccd-aa29-1f2e8ef735ab None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:45.009293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4725a4ae-bdc5-4ccd-aa29-1f2e8ef735ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:45.015064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aea01a-9c1d-44a4-ba02-a1c700b54ecd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:45.100733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:45.103682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.104591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.105040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.110880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:45.140563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3500/6961] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:45.142184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.142548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.142884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.180095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] MFA Rules not processed for user `9c53d510d75542a283b7f851a58d3dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:45.181851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:45.208731 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:45.251402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:45.254003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4906e-7efc-4e94-afaa-68f9555cccab service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:45.284433 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3462/6962] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:45.287099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.289171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.289488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.322760 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3501/6963] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:45.353511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:45.355260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:45.367558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:45.369298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:45.418728 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3463/6964] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:45.418728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:45.418903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dcfd4-307b-4a0a-ac4f-92937d736973 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:45.418903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:45.418903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.418903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.419217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] PATH_INFO: `/v3/users/ee5d1da3e23b4ff5a7bf0cb44540617d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.419217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5d1da3e23b4ff5a7bf0cb44540617d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:45.419217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:45.419434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ef076-2e19-4088-b11c-464b9c729777 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:45.426028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:45.426598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.427585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.427938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.428853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:45.428979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:45.434170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:45.447418 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:45.463425 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3464/6965] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:45.482671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:45.508460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739ddb-f4ec-4117-a365-341c812dbf51 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:45.524939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:45.525658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.525942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.526220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.526899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:45.528974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:45.735247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3465/6966] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:45 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:45.737183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:45.787914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5d1da3e23b4ff5a7bf0cb44540617d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:45.927645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5d1da3e23b4ff5a7bf0cb44540617d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:45.928331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5d1da3e23b4ff5a7bf0cb44540617d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:45.935208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ec12-be90-474c-b13a-980b2487a621 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:45.945632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5d1da3e23b4ff5a7bf0cb44540617d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:45.948954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:45.950716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.951006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.951280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:45.952435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:45.956556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:45.961730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3e7cf18-d27a-44ef-9745-705d951cfafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5d1da3e23b4ff5a7bf0cb44540617d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:45.979326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3502/6967] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:45 2022] DELETE /identity/v3/users/ee5d1da3e23b4ff5a7bf0cb44540617d => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:45.982377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:45.982669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:45.982944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.015835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:46.019169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:46.049059 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3466/6968] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:45 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:46.054377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.057893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:46.091468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d8744-1a96-4214-bd96-57de2af36e44 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.141074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3503/6969] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:46:46.152679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.154418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:46.218195 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:46.220194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.220936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.221324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.221735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.222572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.225519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:46.240461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3467/6970] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:46.242843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469ff52-c8f5-4987-861c-9167bc8d3897 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.244254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.247230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.247862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.248146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.248463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.255302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3ec19-40e7-4205-a654-c4a0dc558646 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.259765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.260160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.260783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.261065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.261261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:46.261439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.262036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.263727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b84db-f292-4ed2-a6a8-1f9cb82455ba admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:46.273385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3504/6971] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:46:46.281870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3468/6972] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:46.283035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.295113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a32884-81af-4c48-a4be-8bc293bf9d8d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.318600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.320639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.321208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.322070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] PATH_INFO: `/v3/projects/767edc5f9e7a4c81929df4fa8a12d94b/users/cb21ecdda88d49b59e11a30b0f3afc72/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.351380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767edc5f9e7a4c81929df4fa8a12d94b, user_id=cb21ecdda88d49b59e11a30b0f3afc72, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.356451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:46.467628 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3505/6973] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:46 2022] PUT /identity/v3/projects/767edc5f9e7a4c81929df4fa8a12d94b/users/cb21ecdda88d49b59e11a30b0f3afc72/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:46.473311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.473694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.473974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.516579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:46.519446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:46.606531 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:46.629480 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3469/6974] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:46.642117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.742122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c228a-35d9-405b-83d1-4e37d8752c66 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.747665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.748359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.748649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.748921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.765184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.766767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d64c81-8af1-4fd8-912a-ec10b101b21d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:46.785567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3506/6975] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:46.872987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:46.875328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:46.917191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7625fb-f37b-450a-8cea-e3582284cb96 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:46.931969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:46.931969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:46.931969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:46.937742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] PATH_INFO: `/v3/projects/6c7af8a6f58048fba4989d3f09a4b8c3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:46.943726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7af8a6f58048fba4989d3f09a4b8c3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:46.945704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:47.143767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7af8a6f58048fba4989d3f09a4b8c3', 'request_id': 'req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:47.156306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7af8a6f58048fba4989d3f09a4b8c3', 'request_id': 'req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:47.304025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7af8a6f58048fba4989d3f09a4b8c3', 'request_id': 'req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:47.325253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] The token cache is being invalidate because project 6c7af8a6f58048fba4989d3f09a4b8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:47.325931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:47.326776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e63fa8dc-d3d1-4fa0-b0da-51380889e8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:47.335417 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3470/6976] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:46 2022] DELETE /identity/v3/projects/6c7af8a6f58048fba4989d3f09a4b8c3 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:47.350050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:47.350050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:47.350050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:47.460248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:47.461543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:47.615190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3507/6977] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:47.618290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:47.618580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:47.618917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:47.663733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:47.665434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:47.699519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3471/6978] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:47.704041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:47.731343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0b012-e54d-426e-84fe-864d175a809d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:47.737016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:47.737825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:47.738109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:47.738400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:47.739113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:47.739414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:47.741082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:47.807894 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3508/6979] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:47.812668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:47.826615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f4a4-9c92-4662-9c8b-bbcceaa3ac07 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:47.839576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:47.840642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:47.841588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:47.841970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:47.846042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:47.848164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.011499 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3472/6980] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:48.015680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:48.040853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da223e2-44bd-4db2-92d8-27e67a950c6f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:48.137403 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:48.186407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:48.187215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.187604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.187980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.188727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:48.190990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.323368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3509/6981] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:48 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:48.325004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:48.377518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2370-d268-4c44-8fe2-b90e4ee1be98 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:48.393513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:48.394627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.397770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.398295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.399470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:48.401363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.430223 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3473/6982] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:48.434313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:48.449603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5504e-8740-4ae7-bfca-c02331029506 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:48.464150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:48.464775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.465060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.465365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.466038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:48.467661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb7df5-8a31-4ee5-9618-922a49edea76 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.492014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3510/6983] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:46:48.496394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:48.515299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22f34-150e-48c2-92b4-d46ff24e4c8d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:48.524641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:48.525715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.526262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.526766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] PATH_INFO: `/v3/projects/a93c37d1f6ae49c7bc9546a65fe8b061/users/428329d37aff42f6b44adb9146984700/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.544662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93c37d1f6ae49c7bc9546a65fe8b061, user_id=428329d37aff42f6b44adb9146984700, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:48.547776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.637763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3474/6984] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:48 2022] PUT /identity/v3/projects/a93c37d1f6ae49c7bc9546a65fe8b061/users/428329d37aff42f6b44adb9146984700/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:48.649579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01828ee-d6da-41cf-86f0-0261ee4d4f2a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.649886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01828ee-d6da-41cf-86f0-0261ee4d4f2a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.650159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01828ee-d6da-41cf-86f0-0261ee4d4f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.684336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d01828ee-d6da-41cf-86f0-0261ee4d4f2a None None] MFA Rules not processed for user `428329d37aff42f6b44adb9146984700`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:48.687100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d01828ee-d6da-41cf-86f0-0261ee4d4f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:48.827553 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3511/6985] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:48.837253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:48.839362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:48.935744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551d137-e7e7-454f-9083-7712d86fe21b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:48.939636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:48.940250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:48.940531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:48.940810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:48.950577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:48.952145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:48.963855 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3475/6986] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:49.313068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:49.313630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:49.314014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:49.430900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] MFA Rules not processed for user `cb21ecdda88d49b59e11a30b0f3afc72`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:49.433108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:49.652307 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3512/6987] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:49.663994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:49.665540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:49.668874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:49.674080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:49.706480 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:49.835402 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:49.858555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae684a-ae1f-43ed-9005-0b61b75198a9 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:49.873029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:49.873696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:49.873982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:49.874263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:49.922358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:49.923854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:49.960781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3476/6988] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:49.986928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7feb23-afa4-4651-9918-fe6edfa1c2ba None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:49.996449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:49.997234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:49.997572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:49.997859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:50.000889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:50.020037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:50.022523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8f89-f113-4ca8-8f9b-5a1813f7ab9f service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:50.042604 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3513/6989] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:50.351946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:50.453080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3709b8f-ce81-4622-8703-55206cfcaed1 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:50.458742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:50.459372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:50.459782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:50.460063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] PATH_INFO: `/v3/users/428329d37aff42f6b44adb9146984700` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:50.461202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] RBAC: Authorizing `identity:delete_user(user_id=428329d37aff42f6b44adb9146984700)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:50.463273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:50.742978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428329d37aff42f6b44adb9146984700'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:50.743803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428329d37aff42f6b44adb9146984700'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:50.766747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428329d37aff42f6b44adb9146984700'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:50.767904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428329d37aff42f6b44adb9146984700'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:50.847710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428329d37aff42f6b44adb9146984700'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:50.891347 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3477/6990] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:46:50 2022] DELETE /identity/v3/users/428329d37aff42f6b44adb9146984700 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:50.896589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2f8e-cab8-4606-b36c-401278ca3c16 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:50.897080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2f8e-cab8-4606-b36c-401278ca3c16 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:50.897196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2f8e-cab8-4606-b36c-401278ca3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:50.937430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4f2d2f8e-cab8-4606-b36c-401278ca3c16 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:50.939408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4f2d2f8e-cab8-4606-b36c-401278ca3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:51.079249 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3514/6991] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:51.091017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:51.092000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:51.136598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c14f-f83a-453a-9c99-6d17191c5f19 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:51.136912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c14f-f83a-453a-9c99-6d17191c5f19 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:51.145058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c14f-f83a-453a-9c99-6d17191c5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:51.148229 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:51.173066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6e70c14f-f83a-453a-9c99-6d17191c5f19 None None] MFA Rules not processed for user `157c0ef579434726810bb3775388b944`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:51.174781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e70c14f-f83a-453a-9c99-6d17191c5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:51.183629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605e3-4b91-4cda-a7f2-960919c2179a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:51.189050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:51.190003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:51.190474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:51.190997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:51.208384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:51.212084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:51.227690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3478/6992] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:46:51.242854 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3515/6993] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:51.685278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:51.686965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:51.712227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08b1fb-0890-4b37-acff-479cbd917be3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:51.729552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:51.729552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:51.729552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:51.729552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] PATH_INFO: `/v3/projects/a93c37d1f6ae49c7bc9546a65fe8b061` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:51.732114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93c37d1f6ae49c7bc9546a65fe8b061)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:51.734353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:51.896682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93c37d1f6ae49c7bc9546a65fe8b061', 'request_id': 'req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:51.906076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93c37d1f6ae49c7bc9546a65fe8b061', 'request_id': 'req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:52.048479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93c37d1f6ae49c7bc9546a65fe8b061', 'request_id': 'req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:52.067662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] The token cache is being invalidate because project a93c37d1f6ae49c7bc9546a65fe8b061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:46:52.068371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:52.071803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-006a75f0-dc00-4a88-84f1-5249aa9dd4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:46:52.074442 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3479/6994] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:46:51 2022] DELETE /identity/v3/projects/a93c37d1f6ae49c7bc9546a65fe8b061 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:46:52.080425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.080924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.081555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.154752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:52.154752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:52.385484 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3516/6995] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:52.396489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.396789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.397357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.434913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:52.436093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:52.444803 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3480/6996] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:52.449101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.472572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940be5-33bb-444b-8811-b21d14a4eda8 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.472572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.472572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.472572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.472940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.472940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:46:52.472940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:52.472940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:52.472940 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:46:52.483282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3517/6997] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:46:52.487401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.499640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a4210-250f-4c87-8f29-d71bfeeef5af None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.504944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.506170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.506170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.506170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.506817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:52.509018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:52.611385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3481/6998] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:52.615479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.631989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6736ce-5ee1-46a0-af19-3f11d8f03fe6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.693565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.694228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.694509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.694781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.695923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:52.697592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:52.802040 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3518/6999] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:46:52 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:46:52.806278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.816876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb11a0-d3e9-4e1b-b883-40dd4cc25a63 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.822143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.822743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.823025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.823301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.823946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:52.825644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:52.839596 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3482/7000] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:52.852275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.874443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfbd17-fbb0-4a57-8689-710165160a03 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.880357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.880975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.881259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.881578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:52.882322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:52.884013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd7b3b-6bfe-4a76-a1c3-ae9c07e80739 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:52.934698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:52.935120 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3519/7001] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:46:52.951250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de082-9e6f-49c9-ba25-3c5bc4bb08a3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:52.971612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:52.972712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:52.973601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:52.974084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] PATH_INFO: `/v3/projects/47072c155d22483b8ff032b0bed320bc/users/b99aebfb14f843b28c4c50bbdbcd6442/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:53.008942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47072c155d22483b8ff032b0bed320bc, user_id=b99aebfb14f843b28c4c50bbdbcd6442, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:53.011985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:53.102248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3483/7002] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:46:52 2022] PUT /identity/v3/projects/47072c155d22483b8ff032b0bed320bc/users/b99aebfb14f843b28c4c50bbdbcd6442/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:46:53.114830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:53.115430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:53.115430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:53.147096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] MFA Rules not processed for user `b99aebfb14f843b28c4c50bbdbcd6442`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:46:53.148508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:53.244704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3520/7003] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:46:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:46:53.254686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:46:53.256423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:46:53.341799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374ef8-4e16-495c-b691-9bfaab503c39 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:46:53.347057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:46:53.347946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:46:53.348988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:46:53.349622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:46:53.366624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:46:53.370808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57d8c0-92b2-4dab-9bb1-a4e7caa4cea7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:46:53.382549 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3484/7004] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:46:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:03.098241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:03.216838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5c79e-a6d2-442f-b09b-4107adba4528 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:03.221587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:03.222224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:03.222501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:03.222809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] PATH_INFO: `/v3/users/b99aebfb14f843b28c4c50bbdbcd6442` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:03.223932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99aebfb14f843b28c4c50bbdbcd6442)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:03.226096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:03.233139 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:03.375864 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:03.454773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99aebfb14f843b28c4c50bbdbcd6442'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:03.527175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99aebfb14f843b28c4c50bbdbcd6442'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:03.528149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99aebfb14f843b28c4c50bbdbcd6442'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:03.542953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99aebfb14f843b28c4c50bbdbcd6442'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:03.556733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99aebfb14f843b28c4c50bbdbcd6442'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:03.568801 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3521/7005] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:03 2022] DELETE /identity/v3/users/b99aebfb14f843b28c4c50bbdbcd6442 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:03.577286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:03.577286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:03.577286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:03.604107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:03.604107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:03.734159 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3485/7006] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:47:03.745058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:03.749809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:03.826176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ee0e-882b-4d9d-8d75-4d6b575fb680 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:03.829889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:03.830501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:03.830781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:03.831057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:03.841371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:03.842829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b1d3-8ee4-4cb4-8e79-b6a5d6bb2a41 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:03.856626 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3522/7007] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:04.230740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:04.230740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:04.253249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa74def-a16d-4f0d-8442-797b36152f91 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:04.265197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:04.265884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:04.266157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:04.266438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] PATH_INFO: `/v3/projects/47072c155d22483b8ff032b0bed320bc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:04.267625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47072c155d22483b8ff032b0bed320bc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:04.269709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:04.490864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47072c155d22483b8ff032b0bed320bc', 'request_id': 'req-1fe6bc83-851d-4a65-8b82-5972142f6ae7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:04.499360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47072c155d22483b8ff032b0bed320bc', 'request_id': 'req-1fe6bc83-851d-4a65-8b82-5972142f6ae7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:04.573057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47072c155d22483b8ff032b0bed320bc', 'request_id': 'req-1fe6bc83-851d-4a65-8b82-5972142f6ae7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:04.609480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] The token cache is being invalidate because project 47072c155d22483b8ff032b0bed320bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:04.610423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:04.613600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1fe6bc83-851d-4a65-8b82-5972142f6ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:04.620650 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3486/7008] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:04 2022] DELETE /identity/v3/projects/47072c155d22483b8ff032b0bed320bc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:04.625613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:04.626746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:04.627255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:04.670786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:04.672279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:04.780222 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3523/7009] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:04.788529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:04.788819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:04.789220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:04.827420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:04.828832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:04.850364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:04.854158 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3487/7010] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:04.861469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7e13-9e9f-4636-9650-fadf7c7dfdf0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:04.936045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:04.936685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:04.936965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:04.937230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:04.937922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:04.938223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:04.939837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:04.973990 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3524/7011] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:47:04.977996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:05.011191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dcf75-cb88-4160-90d6-b2f6d96b3cac None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:05.048081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:05.048963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.049553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.050045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.050945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:05.055774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:05.220253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:05.231138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3488/7012] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:04 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:47:05.235580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1397a1-3a16-438c-b5d2-269e81357aa4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:05.271612 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:05.473321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:05.476710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.477032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.477386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.478867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:05.481553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:05.610953 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3525/7013] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:05 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:05.615140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:05.645824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ef5d-63d1-4698-ae18-101cb39134b0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:05.657667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:05.658536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.658666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.658888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.659539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:05.662310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:05.677381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3489/7014] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:05.679153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:05.704855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8866f4e-c80f-44d4-921a-a3e9052bb0d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:05.715278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:05.715278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.715278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.715278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.715667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:05.718937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df6565-2f07-4dee-9b28-9b0b73dee35d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:05.741654 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3526/7015] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:05.745792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:05.758128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d96244-ed5c-4758-8297-997c6098c064 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:05.765037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:05.765868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.766175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.766805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] PATH_INFO: `/v3/projects/8972b4fb24d84171b9961038d69ed939/users/cf16ea2b22584788a4eff6f00a587b36/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.787032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8972b4fb24d84171b9961038d69ed939, user_id=cf16ea2b22584788a4eff6f00a587b36, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:05.791665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:05.916794 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3490/7016] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:05 2022] PUT /identity/v3/projects/8972b4fb24d84171b9961038d69ed939/users/cf16ea2b22584788a4eff6f00a587b36/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:47:05.928818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:05.929100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:05.929496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:05.974674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] MFA Rules not processed for user `cf16ea2b22584788a4eff6f00a587b36`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:05.976198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:06.127347 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3527/7017] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:06.145079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:06.146880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:06.185546 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:06.280720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0af32b-b094-417e-878e-6dc43ae2a9e4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:06.290537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:06.291567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:06.292018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:06.292515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:06.309537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:06.311088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30d52-a758-419a-877c-38aff2383086 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:06.341287 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3491/7018] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:09.642764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:09.644768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:09.801970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b34364-da24-4417-a4ca-166bfaebaf2b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:09.808217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:09.809099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:09.813257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:09.814044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] PATH_INFO: `/v3/users/7aa6ab881c0c48d49ed398c520911413` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:09.815457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa6ab881c0c48d49ed398c520911413)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:09.817830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:09.872468 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:10.190233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa6ab881c0c48d49ed398c520911413'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:10.337561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa6ab881c0c48d49ed398c520911413'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:10.338194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa6ab881c0c48d49ed398c520911413'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:10.358286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa6ab881c0c48d49ed398c520911413'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:10.371750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa6ab881c0c48d49ed398c520911413'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:10.381909 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3528/7019] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:09 2022] DELETE /identity/v3/users/7aa6ab881c0c48d49ed398c520911413 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:10.386423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:10.386978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:10.387100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:10.413636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:10.415168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:10.508289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3492/7020] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:10.525244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:10.527013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:10.632023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e2341-d91c-4a85-8aa5-308668f4fc74 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:10.635932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:10.636807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:10.637197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:10.637582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:10.648701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:10.650306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:10.660862 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3529/7021] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:11.359262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:11.365255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:11.387438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240f80-ab9b-4c0c-90ca-d73b6915fa1c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:11.403235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:11.404133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:11.410660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:11.410660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] PATH_INFO: `/v3/projects/bef7978eace3493b816ddb0f4e67bcbb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:11.410660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef7978eace3493b816ddb0f4e67bcbb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:11.411677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:11.574335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef7978eace3493b816ddb0f4e67bcbb', 'request_id': 'req-9804d4d4-baa1-48c9-a549-a37e53792b67'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:11.590918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef7978eace3493b816ddb0f4e67bcbb', 'request_id': 'req-9804d4d4-baa1-48c9-a549-a37e53792b67'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:11.688559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef7978eace3493b816ddb0f4e67bcbb', 'request_id': 'req-9804d4d4-baa1-48c9-a549-a37e53792b67'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:11.710299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] The token cache is being invalidate because project bef7978eace3493b816ddb0f4e67bcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:11.710961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:11.717691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:11.723160 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3493/7022] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:11 2022] DELETE /identity/v3/projects/bef7978eace3493b816ddb0f4e67bcbb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:11.726828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:11.743387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdadfbf-3ae4-4abc-82a7-5f19d7b440a9 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:11.937469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:11.938436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:11.939076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:11.939526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] PATH_INFO: `/v3/users/3133110b7d664dc28dcf2d43b2f3af8a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:11.940907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3133110b7d664dc28dcf2d43b2f3af8a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:11.943618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:12.285753 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:12.303171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3133110b7d664dc28dcf2d43b2f3af8a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:12.423694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3133110b7d664dc28dcf2d43b2f3af8a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:12.424410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3133110b7d664dc28dcf2d43b2f3af8a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:12.475747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3133110b7d664dc28dcf2d43b2f3af8a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:12.498393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-807bd37c-b79b-4024-ac08-e6d5814031b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3133110b7d664dc28dcf2d43b2f3af8a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:12.519802 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3530/7023] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:11 2022] DELETE /identity/v3/users/3133110b7d664dc28dcf2d43b2f3af8a => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:47:13.798630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:13.807644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:13.845033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d4d4-baa1-48c9-a549-a37e53792b67 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:13.979257 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:14.031313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:14.031544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.036063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.036487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] PATH_INFO: `/v3/projects/086505747861465b865478287d106a22` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.045828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=086505747861465b865478287d106a22)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:14.051736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:14.100584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa7d4-4640-48e2-92c5-5d54c9dab4d3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.101071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa7d4-4640-48e2-92c5-5d54c9dab4d3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.101179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99baa7d4-4640-48e2-92c5-5d54c9dab4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.134753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-99baa7d4-4640-48e2-92c5-5d54c9dab4d3 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:14.135985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-99baa7d4-4640-48e2-92c5-5d54c9dab4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:14.264440 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3531/7024] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:47:14.305055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086505747861465b865478287d106a22', 'request_id': 'req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:14.320236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086505747861465b865478287d106a22', 'request_id': 'req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:14.476055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086505747861465b865478287d106a22', 'request_id': 'req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:14.493240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] The token cache is being invalidate because project 086505747861465b865478287d106a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:14.493627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:14.496971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:14.502861 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3494/7025] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:13 2022] DELETE /identity/v3/projects/086505747861465b865478287d106a22 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:14.509545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1f6f-793d-4dc0-8494-e4ce00c69149 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.510009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1f6f-793d-4dc0-8494-e4ce00c69149 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.513205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1f6f-793d-4dc0-8494-e4ce00c69149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.558769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:14.560127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:14.560541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e83b1f6f-793d-4dc0-8494-e4ce00c69149 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:14.565032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e83b1f6f-793d-4dc0-8494-e4ce00c69149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:14.753270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3532/7026] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:14.757800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.758504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.759285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.789918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c176-8a8d-43cc-bef3-cab034ccaf1f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:14.791190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:14.792607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:14.805406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:14.809516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.810288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.813071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.817900 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3533/7027] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:14.818097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:14.819561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:14.866151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c72583-bd63-447d-ae4d-f85d799aed23 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:14.891655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:14.897604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:14.897604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:14.897604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:14.901829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:14.908868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:14.910875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:14.965799 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3534/7028] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:47:14.965799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:14.994267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cbf6f-2eb1-4568-9c32-53c64a4b531f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:15.012632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:15.012855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:15.015320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:15.015697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:15.016383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.018434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:15.114653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.118708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:15.164834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3495/7029] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:47:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 01:47:15.207118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3535/7030] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:14 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:47:15.211732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:15.234949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee28c3f-43ec-48e3-8bc8-2a6bf531fdb2 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:15.406155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:15.406962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:15.407414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:15.408161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:15.410900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.413126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:15.568935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3496/7031] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:15 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:15.574497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:15.609956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206d9f-d8a4-405b-8dd9-b464e2b45ce0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:15.629817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:15.633384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:15.633384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:15.636204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:15.640641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.651142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:15.699955 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3536/7032] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:15.704503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:15.725166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b433-1805-40d7-b1ff-229d59a3eb31 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:15.764210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:15.777429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:15.777429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:15.777429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:15.777429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.782386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972994f-73b1-4164-9b58-6747617af8b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:15.843786 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3497/7033] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:15.848320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:15.867980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1642c-8282-4f68-b7b9-7aaf1d8d9e42 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:15.880783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:15.882339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:15.886999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:15.887327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] PATH_INFO: `/v3/projects/0860665294a94f47a945958b27f873cb/users/b1f820289e80422cba920049f8e14442/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:15.904617 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:15.943328 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:15.954944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0860665294a94f47a945958b27f873cb, user_id=b1f820289e80422cba920049f8e14442, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:15.962778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:16.113018 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3537/7034] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:15 2022] PUT /identity/v3/projects/0860665294a94f47a945958b27f873cb/users/b1f820289e80422cba920049f8e14442/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:16.125427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:16.125698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:16.126038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:16.204915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] MFA Rules not processed for user `b1f820289e80422cba920049f8e14442`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:16.206187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:16.435817 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3498/7035] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:16.445490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:16.603233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816169b-88ba-4b86-a01c-3ed9fc39a62e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:16.612225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:16.614138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:16.614662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:16.615283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:16.616384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:16.618643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:16.783517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:16.791120 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3538/7036] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:16 2022] POST /identity/v3/projects => generated 365 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:16.805388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c90969-1a87-4cc4-a9ed-960f95f6448e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:16.978823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:16.979681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:16.979981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:16.981017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:16.981933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:16.984108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:17.130838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3499/7037] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:16 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:17.132028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:17.152589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0112d-d7e7-412f-a5cf-66e8b66eee92 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:17.182656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:17.183445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:17.183727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:17.183994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:17.185569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:17.187692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:17.237245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3539/7038] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:17.238573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:17.262995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f464b-0239-4917-9725-feb8b5759837 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:17.286961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:17.287885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:17.288269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:17.288701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] PATH_INFO: `/v3/projects/b3b4846b914e40eb8b806c17918f129f/users/4425cdd8be7a4280bd58bce51b05d620/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:17.333472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4846b914e40eb8b806c17918f129f, user_id=4425cdd8be7a4280bd58bce51b05d620, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:17.339444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:17.497082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:17.497883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3500/7039] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:17 2022] PUT /identity/v3/projects/b3b4846b914e40eb8b806c17918f129f/users/4425cdd8be7a4280bd58bce51b05d620/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:17.512257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9566-44ff-47e3-89b1-9f4a4d647649 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:17.642370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:17.644769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:17.645258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:17.647910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:17.648822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:17.655189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c568e-6b09-412a-8119-096291b86bfe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:17.695538 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3540/7040] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:17.703882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:17.728851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150f749-f61f-467d-97a1-88f055f27120 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:17.738827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:17.739823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:17.740285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:17.740744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] PATH_INFO: `/v3/projects/b3b4846b914e40eb8b806c17918f129f/users/4425cdd8be7a4280bd58bce51b05d620/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:17.743550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b4846b914e40eb8b806c17918f129f, user_id=4425cdd8be7a4280bd58bce51b05d620, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:17.747337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:17.812939 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3501/7041] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:17 2022] PUT /identity/v3/projects/b3b4846b914e40eb8b806c17918f129f/users/4425cdd8be7a4280bd58bce51b05d620/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:17.819405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:17.819405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:17.819405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:17.911644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] MFA Rules not processed for user `4425cdd8be7a4280bd58bce51b05d620`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:17.912943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:18.181988 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3541/7042] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:18.203639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:18.205693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:18.402479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d154c5-1f79-45c0-8c7e-15cf6ed87b92 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:18.422932 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:18.442640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:18.442640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:18.442640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:18.442640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:18.465638 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:18.474685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:18.479360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:18.543164 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3502/7043] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:19.033174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:19.063004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3750b2-1d04-4639-ba2b-21546dedf361 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:19.078898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:19.080482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:19.082055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:19.082460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:19.287447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:19.296654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2590fa-75eb-4683-aca4-50007ccc4fc0 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:19.321474 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3542/7044] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:29.048379 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=34,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:29.301012 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=34 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:32.433988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:32.603908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde09205-38fc-411c-9cbb-e5f146ab8c73 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:32.610226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:32.611253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:32.611730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:32.612219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:32.615134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:32.786859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:32.794538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:32.811093 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3503/7045] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:47:37.652601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e9e9-a57a-4585-b6cb-6df17c4f5944 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:37.658480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e9e9-a57a-4585-b6cb-6df17c4f5944 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:37.658480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875e9e9-a57a-4585-b6cb-6df17c4f5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:37.705908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5875e9e9-a57a-4585-b6cb-6df17c4f5944 None None] MFA Rules not processed for user `dcb021152c684983b31e5db439518921`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:37.719120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5875e9e9-a57a-4585-b6cb-6df17c4f5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:37.834074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3543/7046] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:42.193577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:42.196218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:42.351544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a429fc-3bb7-408d-902f-fb2436e9ed35 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:42.368121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:42.368929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:42.369198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:42.369517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] PATH_INFO: `/v3/users/9c53d510d75542a283b7f851a58d3dbf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:42.370820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c53d510d75542a283b7f851a58d3dbf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:42.379261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:42.623047 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:42.634453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c53d510d75542a283b7f851a58d3dbf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:42.638055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c53d510d75542a283b7f851a58d3dbf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:42.664958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c53d510d75542a283b7f851a58d3dbf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:42.667816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c53d510d75542a283b7f851a58d3dbf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:42.761174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c53d510d75542a283b7f851a58d3dbf'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:42.798620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3504/7047] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:42 2022] DELETE /identity/v3/users/9c53d510d75542a283b7f851a58d3dbf => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:42.805747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:42.805747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:42.805747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:42.840498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:42.842241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:42.954010 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3544/7048] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:42.962186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:42.963578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:43.034321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6450-6170-4238-89cc-54a31882b814 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:43.039184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:43.044093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:43.044093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:43.044093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:43.058704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:43.061705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:43.072836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3505/7049] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:44.206597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:44.209609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:44.232234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2ff8-8e74-43f0-98c5-4ce3493a028d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:44.240801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:44.241893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:44.242448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:44.247185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] PATH_INFO: `/v3/projects/73f4af2d7cc742b98447e28e3c204c11` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:44.251780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f4af2d7cc742b98447e28e3c204c11)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:44.262426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:44.446218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f4af2d7cc742b98447e28e3c204c11', 'request_id': 'req-609a8f6f-f28f-48dd-80ff-36d28d122f55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.531116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f4af2d7cc742b98447e28e3c204c11', 'request_id': 'req-609a8f6f-f28f-48dd-80ff-36d28d122f55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.540591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f4af2d7cc742b98447e28e3c204c11', 'request_id': 'req-609a8f6f-f28f-48dd-80ff-36d28d122f55'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.552910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] The token cache is being invalidate because project 73f4af2d7cc742b98447e28e3c204c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:44.553437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.554122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.555635 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3545/7050] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:44 2022] DELETE /identity/v3/projects/73f4af2d7cc742b98447e28e3c204c11 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:44.559788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:44.570584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7edc79-cc4c-4fcf-8ca0-692fc4a2802c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:44.657614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:44.659040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:44.670600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:44.670955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] PATH_INFO: `/v3/users/acae2ccb9fea4b7e8c28e3b758bd89f4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:44.672561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acae2ccb9fea4b7e8c28e3b758bd89f4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:44.675127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:44.932110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acae2ccb9fea4b7e8c28e3b758bd89f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.932851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acae2ccb9fea4b7e8c28e3b758bd89f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.948711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acae2ccb9fea4b7e8c28e3b758bd89f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:44.949938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acae2ccb9fea4b7e8c28e3b758bd89f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.018150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acae2ccb9fea4b7e8c28e3b758bd89f4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.022641 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:45.056830 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3506/7051] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:44 2022] DELETE /identity/v3/users/acae2ccb9fea4b7e8c28e3b758bd89f4 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:45.288772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:45.291490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:45.311242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a8f6f-f28f-48dd-80ff-36d28d122f55 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:45.371413 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:45.421189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:45.422331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:45.423145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:45.423727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] PATH_INFO: `/v3/users/cf16ea2b22584788a4eff6f00a587b36` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:45.427134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf16ea2b22584788a4eff6f00a587b36)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:45.429355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:45.770684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf16ea2b22584788a4eff6f00a587b36'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.856829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:45.862951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:45.870803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf16ea2b22584788a4eff6f00a587b36'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.871740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf16ea2b22584788a4eff6f00a587b36'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.919103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf16ea2b22584788a4eff6f00a587b36'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.921476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9e829-c518-4023-aa11-b3f986453f5f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:45.930245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:45.930975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:45.931256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:45.931526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] PATH_INFO: `/v3/projects/5b1d124bd197495a8ae5c2b090250f18` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:45.933393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39bb83d2-032e-4c31-a157-fad603e3a7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf16ea2b22584788a4eff6f00a587b36'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:45.934072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1d124bd197495a8ae5c2b090250f18)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:45.936081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:45.948572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3546/7052] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:45 2022] DELETE /identity/v3/users/cf16ea2b22584788a4eff6f00a587b36 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:45.950503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:45.951020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:45.951523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:45.976764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:45.978615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:46.106245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3547/7053] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:46.120791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:46.122273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:46.160828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1d124bd197495a8ae5c2b090250f18', 'request_id': 'req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:46.170935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1d124bd197495a8ae5c2b090250f18', 'request_id': 'req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:46.223033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbf646-6684-4a9b-b0cf-70587def623f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:46.290561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:46.291249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:46.291513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:46.291697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:46.326501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1d124bd197495a8ae5c2b090250f18', 'request_id': 'req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:46.351065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] The token cache is being invalidate because project 5b1d124bd197495a8ae5c2b090250f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:46.351361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:46.352523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:46.354183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3507/7054] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:45 2022] DELETE /identity/v3/projects/5b1d124bd197495a8ae5c2b090250f18 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:46.364818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:46.369640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:46.407982 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:46.413935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:46.416669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:46.449152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3548/7055] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:47:46.515682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:46.518805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:46.639586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c7d5-07e7-4117-9bfb-120b18bc2de7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:46.649220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:46.650215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:46.651031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:46.651512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] PATH_INFO: `/v3/users/1f554dd68cd34d3ab176e931874c7a95` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:46.652966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f554dd68cd34d3ab176e931874c7a95)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:46.655491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:46.724123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbeaa4-aefc-4136-b320-e8fc031e5f52 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:46.730918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:46.731539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:46.731816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:46.732982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:46.749191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:46.768878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:46.777502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:46.792806 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3549/7056] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:46.971436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:46.974120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:47.009300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f554dd68cd34d3ab176e931874c7a95'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.021519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f554dd68cd34d3ab176e931874c7a95'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.031291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15094b26-4c26-49b7-9659-5910ce92894b service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:47.040231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:47.041678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.042124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.042578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] PATH_INFO: `/v3/projects/8972b4fb24d84171b9961038d69ed939` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.044107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8972b4fb24d84171b9961038d69ed939)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:47.048728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:47.063256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f554dd68cd34d3ab176e931874c7a95'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.064046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f554dd68cd34d3ab176e931874c7a95'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.158848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e90dd165-80b3-42e6-8ed3-ce32cb8c9a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f554dd68cd34d3ab176e931874c7a95'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.162752 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:47.189980 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3508/7057] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:46 2022] DELETE /identity/v3/users/1f554dd68cd34d3ab176e931874c7a95 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:47.425484 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:47.459495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8972b4fb24d84171b9961038d69ed939', 'request_id': 'req-983fdfaa-2760-470b-8718-872605dbe543'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.605748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8972b4fb24d84171b9961038d69ed939', 'request_id': 'req-983fdfaa-2760-470b-8718-872605dbe543'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.615397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8972b4fb24d84171b9961038d69ed939', 'request_id': 'req-983fdfaa-2760-470b-8718-872605dbe543'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.628870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] The token cache is being invalidate because project 8972b4fb24d84171b9961038d69ed939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:47.633326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.634331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:47.636526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3550/7058] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:46 2022] DELETE /identity/v3/projects/8972b4fb24d84171b9961038d69ed939 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:47.641279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54e34-0a6b-4f27-a9d2-572d14e1afc2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.641629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54e34-0a6b-4f27-a9d2-572d14e1afc2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.641908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba54e34-0a6b-4f27-a9d2-572d14e1afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.667280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:47.669091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:47.678485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ba54e34-0a6b-4f27-a9d2-572d14e1afc2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:47.679935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ba54e34-0a6b-4f27-a9d2-572d14e1afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:47.808598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fdfaa-2760-470b-8718-872605dbe543 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:47.814782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3509/7059] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:47.816336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:47.817254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.817734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.818234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] PATH_INFO: `/v3/projects/bda61968f18e489894903191b2e15dac` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.820045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda61968f18e489894903191b2e15dac)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:47.822458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:47.822801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.823226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.823748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.849190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:47.851288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:47.869949 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3510/7060] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:47.871572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:47.884115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9b9d-c5e3-4ea9-a22c-fe18a05a8146 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:47.891416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:47.892124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.892762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.893308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.894242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:47.894791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:47.896993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:47.927844 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3511/7061] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:47:47.928844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:47.947199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98796164-1a2f-4b2a-aea5-e5c5b98904fb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:47.956005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:47.957002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:47.957594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:47.958121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:47.959013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:47.961712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.007636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda61968f18e489894903191b2e15dac', 'request_id': 'req-e3c801bb-80e2-4af7-8c22-7fe98c102078'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:48.108077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda61968f18e489894903191b2e15dac', 'request_id': 'req-e3c801bb-80e2-4af7-8c22-7fe98c102078'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:48.121857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda61968f18e489894903191b2e15dac', 'request_id': 'req-e3c801bb-80e2-4af7-8c22-7fe98c102078'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:48.139237 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3512/7062] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:47 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:48.144478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.167718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] The token cache is being invalidate because project bda61968f18e489894903191b2e15dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:48.168135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:48.186609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e3c801bb-80e2-4af7-8c22-7fe98c102078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:48.189461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3551/7063] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:47 2022] DELETE /identity/v3/projects/bda61968f18e489894903191b2e15dac => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:48.190975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7489-b7c7-43af-80f1-8a54f01ac669 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.191267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7489-b7c7-43af-80f1-8a54f01ac669 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.191657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d7489-b7c7-43af-80f1-8a54f01ac669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.235022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1b8d7489-b7c7-43af-80f1-8a54f01ac669 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:48.240355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1b8d7489-b7c7-43af-80f1-8a54f01ac669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:48.298303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c40c0d-0208-422d-b10a-f73b69fe78df admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.307042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.308192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.309024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.310555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.311408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.314007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.338466 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:48.344175 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3552/7064] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:48.352633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.354294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.354600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.381318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:48.382777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:48.404245 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3553/7065] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:48.404991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.456393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d6ac-846a-4e49-9231-6aedd92d712b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.463991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.464855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.465397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.468560 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3513/7066] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/users => generated 286 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:48.469136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.470016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.472377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:48.473260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.474398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:48.479075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.492082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fadb0b-18a8-4867-919b-8a78db822d5a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.499155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.499774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.500052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.500322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.500973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.502804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.523008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3554/7067] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:47:48.524435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.527977 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3514/7068] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:47:48.541260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.544586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78795eb0-19a5-4dc4-a438-dcb17789598b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.550705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.551317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.551594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.552894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.552894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.555715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.584685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1c94a-7d07-44c9-801e-51b286e3937e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.601555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.603032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.603947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.604977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.607840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.611824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.640263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3515/7069] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:48.640263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.669835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7978b0-36b8-4b2a-be5b-1000b8c9e189 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.675892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.676845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.677228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.677469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] PATH_INFO: `/v3/projects/86e1b7adbf7e48f2bbb3357a7a5983c6/users/fceca2e8716e449e997ea2c1993610a1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.688837 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:48.704467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3555/7070] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:48.704689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e1b7adbf7e48f2bbb3357a7a5983c6, user_id=fceca2e8716e449e997ea2c1993610a1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.706291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:48.708022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695a7d6-ee0a-4525-9651-4ff993a4a474 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:48.832943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90328e-764f-4346-ada4-b1508723be53 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:48.840390 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3516/7071] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:48 2022] PUT /identity/v3/projects/86e1b7adbf7e48f2bbb3357a7a5983c6/users/fceca2e8716e449e997ea2c1993610a1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:48.852731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.853001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.853267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.929740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] MFA Rules not processed for user `fceca2e8716e449e997ea2c1993610a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:48.930925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:48.964360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:48.969500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:48.969500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:48.969500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:48.969500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:48.972737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.054220 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3517/7072] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:49.066506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:49.074946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:49.076441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3556/7073] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:48 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:49.081935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:49.093212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9d536-2f49-4587-8d77-31507a7a76d9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:49.099278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:49.100103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.100480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.100842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.101605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:49.103820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.118290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3557/7074] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:49.119278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:49.132934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535a7af-620e-4262-a195-2ef9ac831e5d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:49.138632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:49.139308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.139669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.140012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.140713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:49.142460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.147345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f931-7e6e-4b3c-b7b0-dfa1c9bfc318 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:49.151842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:49.152457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.152788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.153069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.154241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3558/7075] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:49.158588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:49.169244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec6fa3-9eaa-4b2c-ae53-362c36ab16b7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:49.183031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:49.185351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250142e4-8672-484f-9756-c666ed463b6e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.194435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:49.194435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.194435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.194435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] PATH_INFO: `/v3/projects/96f00019b8a440b994269dce91d83768/users/44d699d4b51d4dc8ac1d8ff5aee36290/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.197654 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3518/7076] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:49.219957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f00019b8a440b994269dce91d83768, user_id=44d699d4b51d4dc8ac1d8ff5aee36290, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:49.226732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.366442 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3559/7077] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:49 2022] PUT /identity/v3/projects/96f00019b8a440b994269dce91d83768/users/44d699d4b51d4dc8ac1d8ff5aee36290/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:47:49.372435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.372435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.372435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.395514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:49.400411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:49.492270 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3519/7078] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:49.498704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:49.520834 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:49.585168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a53b-b1f4-4f2e-9e28-679454758018 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:49.589799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:49.590478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:49.590759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:49.591023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:49.610645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:49.613169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7230474-a62f-4414-b5ea-bf5d37176bb8 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:49.651692 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3560/7079] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:47:50.337543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:50.349508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cf2cd-7f1b-4d1b-986d-e28b1a20a291 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:50.356481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:50.357541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:50.358021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:50.358475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] PATH_INFO: `/v3/users/fceca2e8716e449e997ea2c1993610a1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:50.362683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceca2e8716e449e997ea2c1993610a1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:50.367552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:50.394510 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:50.616422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceca2e8716e449e997ea2c1993610a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:50.617434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceca2e8716e449e997ea2c1993610a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:50.625364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceca2e8716e449e997ea2c1993610a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:50.626358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceca2e8716e449e997ea2c1993610a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:50.713843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceca2e8716e449e997ea2c1993610a1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:50.739859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3520/7080] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:50 2022] DELETE /identity/v3/users/fceca2e8716e449e997ea2c1993610a1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:50.744972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341864d3-cef7-4d4a-8533-dc55ad5d6f25 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:50.745588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341864d3-cef7-4d4a-8533-dc55ad5d6f25 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:50.745747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341864d3-cef7-4d4a-8533-dc55ad5d6f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:50.910812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-341864d3-cef7-4d4a-8533-dc55ad5d6f25 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:50.913275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-341864d3-cef7-4d4a-8533-dc55ad5d6f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:51.009397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3561/7081] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:51.020309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:51.021820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:51.102296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14af359-3f8a-4390-b713-965e6dee17f8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:51.109308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:51.109308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:51.109308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:51.109308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:51.117738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:51.119170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:51.130493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3521/7082] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:51.585679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:51.586008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:51.586365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:51.650156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] MFA Rules not processed for user `44d699d4b51d4dc8ac1d8ff5aee36290`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:51.653606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:51.725015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:51.727210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:51.745075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d9516-98bc-4b8c-9e1f-278beae661c7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:51.760542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:51.770302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:51.770302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:51.770302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] PATH_INFO: `/v3/projects/86e1b7adbf7e48f2bbb3357a7a5983c6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:51.770302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e1b7adbf7e48f2bbb3357a7a5983c6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:51.770302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:51.802168 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3562/7083] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:51.807229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:51.809655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:51.824965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce76b2-a322-4721-9bc3-ecd6fbb7cd9a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:51.829699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:51.830300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:51.830577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:51.830932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:51.831559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:51.833507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:51.918426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e1b7adbf7e48f2bbb3357a7a5983c6', 'request_id': 'req-791dc448-ad81-46a0-9612-d5261d3376f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:51.925661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e1b7adbf7e48f2bbb3357a7a5983c6', 'request_id': 'req-791dc448-ad81-46a0-9612-d5261d3376f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:51.978804 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3563/7084] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:51 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:51.980292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:51.993400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e1b7adbf7e48f2bbb3357a7a5983c6', 'request_id': 'req-791dc448-ad81-46a0-9612-d5261d3376f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:52.005292 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:52.008084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] The token cache is being invalidate because project 86e1b7adbf7e48f2bbb3357a7a5983c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:52.008611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:52.009605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-791dc448-ad81-46a0-9612-d5261d3376f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:52.015197 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3522/7085] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:51 2022] DELETE /identity/v3/projects/86e1b7adbf7e48f2bbb3357a7a5983c6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:47:52.016762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea56d-2848-4598-9cb0-4fd745018e25 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.017425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea56d-2848-4598-9cb0-4fd745018e25 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.017954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea56d-2848-4598-9cb0-4fd745018e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.041279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f2ea56d-2848-4598-9cb0-4fd745018e25 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:52.043020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f2ea56d-2848-4598-9cb0-4fd745018e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:52.059038 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:52.087813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f3a1-8933-4e30-8544-c962a9fd317c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.094777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.096207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.096588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.097557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.099031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.101289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.121685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3523/7086] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:52.130389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.130765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.133811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.155828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:52.157481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:52.167883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3524/7087] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:47:52.171611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.182792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fef6-df3e-4776-8622-be8b1435fdf2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.187724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.188473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.193448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.193448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.193448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:52.193448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.193448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.210375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3525/7088] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:47:52.211455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.225350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af32c9-db6d-4834-b7f5-31c45f0af990 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.233204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.234845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.235203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.235552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.236289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.239014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.248319 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3564/7089] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:51 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:52.249898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.253629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:52.271283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17248e-0664-4a1f-b7d9-b0f5ee7539e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.275897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.276585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.276941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.278045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.278780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.280906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.293109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3565/7090] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:52.297023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.307944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb89c-5fb3-4178-b50a-1cb7406e5c06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.313024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.313738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.314532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.314811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] PATH_INFO: `/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49/users/99fab6afb55a4f75a19651edec80938a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.333418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bd9ec0a843467587f7b4ee0b30cf49, user_id=99fab6afb55a4f75a19651edec80938a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.336177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.388556 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3526/7091] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:52 2022] POST /identity/v3/projects => generated 353 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:52.390137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.436496 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3566/7092] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:52 2022] PUT /identity/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49/users/99fab6afb55a4f75a19651edec80938a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:52.447389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.465601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236d8f-94f9-4238-8929-1175620b26c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.560016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.562284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.564006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.565594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.568734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.570746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.572623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4aa9-8f86-4179-ac91-bac65cbb538c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.579457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.580753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.581275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.581896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.582889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.584925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.597899 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3567/7093] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:52.602420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.616427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780ccb4-8d35-4fa7-be5e-c6a016168d71 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.622615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.623486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.623769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.624393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] PATH_INFO: `/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49/users/99fab6afb55a4f75a19651edec80938a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.626415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bd9ec0a843467587f7b4ee0b30cf49, user_id=99fab6afb55a4f75a19651edec80938a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.629933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.659650 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3568/7094] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:52 2022] PUT /identity/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49/users/99fab6afb55a4f75a19651edec80938a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:52.665467 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3527/7095] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:52 2022] POST /identity/v3/users => generated 277 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:47:52.675252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.755582 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:52.761040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b0fa5-8691-4e94-bc01-83e38f1ca295 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.766111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.767009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.767545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.767912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.774488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.776972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.791379 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3569/7096] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:52.796866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.814807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c29310-1fd8-4651-9278-0f95965ea1e0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.821999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.822966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.823416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.823880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.824789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.835465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5a5f3-698d-478f-b3ec-64392e759511 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:52.860289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3528/7097] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:47:52.862553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:52.906233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c70a61-3c00-41f3-bcc8-143b1cd587ce admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:52.928751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:52.929680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:52.936422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:52.936422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] PATH_INFO: `/v3/projects/acf551dad47d462d9c8a7c20fbe5d449/users/72ff65cfd52d4174949553fb06b317a3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:52.953874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf551dad47d462d9c8a7c20fbe5d449, user_id=72ff65cfd52d4174949553fb06b317a3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:52.958146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:53.094871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3570/7098] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:52 2022] PUT /identity/v3/projects/acf551dad47d462d9c8a7c20fbe5d449/users/72ff65cfd52d4174949553fb06b317a3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:53.097070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff464e6-c1a6-4c9b-acfb-044d669c09e5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:53.097383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff464e6-c1a6-4c9b-acfb-044d669c09e5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:53.097693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff464e6-c1a6-4c9b-acfb-044d669c09e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:53.105216 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:53.145885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ff464e6-c1a6-4c9b-acfb-044d669c09e5 None None] MFA Rules not processed for user `72ff65cfd52d4174949553fb06b317a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:53.147831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ff464e6-c1a6-4c9b-acfb-044d669c09e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:53.221246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3529/7099] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:53.231285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:53.232973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:53.293935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc55c1e-4921-4feb-8196-7919acf430e3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:53.297822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:53.299058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:53.299334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:53.299597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:53.308372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:53.309863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c708a99-1d5b-49a5-9b4a-c3ff73a512d1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:53.323045 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3571/7100] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:54.442226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:54.443216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:54.443684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:54.527097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] MFA Rules not processed for user `99fab6afb55a4f75a19651edec80938a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:54.528499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:54.709719 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3530/7101] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:54.720542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:54.721086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:54.725833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:54.754859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] MFA Rules not processed for user `44d699d4b51d4dc8ac1d8ff5aee36290`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:54.756249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:54.861942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3572/7102] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:54.871162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:54.873520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:55.028724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a68737-bfcf-41bc-bc98-c6d5d7cb3f4e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:55.043012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:55.044017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:55.044652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:55.045165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:55.047694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:55.061472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:55.063349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76ae11-fc38-4895-9d23-2e84a5d6b480 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:55.102871 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3531/7103] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:56.603825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:56.754520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba6a24-6f72-4fc8-8bae-4206730ed805 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:56.758621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:56.759367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:56.759710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:56.760042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] PATH_INFO: `/v3/users/72ff65cfd52d4174949553fb06b317a3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:56.761446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ff65cfd52d4174949553fb06b317a3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:56.763627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:56.786534 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:57.161956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ff65cfd52d4174949553fb06b317a3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.251464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ff65cfd52d4174949553fb06b317a3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.252179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ff65cfd52d4174949553fb06b317a3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.271764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ff65cfd52d4174949553fb06b317a3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.280307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ff65cfd52d4174949553fb06b317a3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.287574 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3573/7104] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:56 2022] DELETE /identity/v3/users/72ff65cfd52d4174949553fb06b317a3 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:57.292110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:57.292672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:57.292672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:57.311105 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:57.327960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:57.330306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:57.411493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3532/7105] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:57.421224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:57.422690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:57.493175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2189-13aa-41c8-b9a5-87994f24c346 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:57.496899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:57.497638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:57.497997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:57.498357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:57.508767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:57.510359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef386a6-ec77-4cdf-963f-ba7abd9472a8 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:57.520996 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3574/7106] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:47:57.775834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:57.777920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:57.800190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4bf45-c0fb-4e0d-b947-1668e116b8cc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:57.806280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:57.807055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:57.807340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:57.807945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] PATH_INFO: `/v3/projects/acf551dad47d462d9c8a7c20fbe5d449` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:57.809276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf551dad47d462d9c8a7c20fbe5d449)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:57.811531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:57.966255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf551dad47d462d9c8a7c20fbe5d449', 'request_id': 'req-2b7d5bdf-b370-4d89-8e7a-100f72831a25'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:57.980735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf551dad47d462d9c8a7c20fbe5d449', 'request_id': 'req-2b7d5bdf-b370-4d89-8e7a-100f72831a25'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.053610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf551dad47d462d9c8a7c20fbe5d449', 'request_id': 'req-2b7d5bdf-b370-4d89-8e7a-100f72831a25'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.073311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] The token cache is being invalidate because project acf551dad47d462d9c8a7c20fbe5d449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:47:58.073311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.073311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.073311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3533/7107] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:47:57 2022] DELETE /identity/v3/projects/acf551dad47d462d9c8a7c20fbe5d449 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:58.078623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8df10-2299-4089-9f9a-3c735d9b43d3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.079206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8df10-2299-4089-9f9a-3c735d9b43d3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.080666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8df10-2299-4089-9f9a-3c735d9b43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.120295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e8b8df10-2299-4089-9f9a-3c735d9b43d3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:58.121542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e8b8df10-2299-4089-9f9a-3c735d9b43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:58.164581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.166242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:58.286946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3575/7108] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:58.288456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.288905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.289295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.323497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:58.328505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:58.340867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3576/7109] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:58.345199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.358099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd712b-b56c-4e1e-a7bd-0a1cf3f9497d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.364148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.364941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.365216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.365569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.366262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:47:58.366569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.368205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:58.378542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d5bdf-b370-4d89-8e7a-100f72831a25 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.387821 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3577/7110] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:47:58.388632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.390673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.391321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.391603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.391925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] PATH_INFO: `/v3/users/b1f820289e80422cba920049f8e14442` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.398114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f820289e80422cba920049f8e14442)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.400071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:58.416071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137102-500e-41c3-8ea3-9a6b94bfc126 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.430304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.430918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.431194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.431460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.432091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.436803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:58.468639 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:58.539565 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:58.577608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3578/7111] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:58 2022] POST /identity/v3/projects => generated 403 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:58.580903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.650006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f820289e80422cba920049f8e14442'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.651236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f820289e80422cba920049f8e14442'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.665202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f820289e80422cba920049f8e14442'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.667086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f820289e80422cba920049f8e14442'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.675105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038815b-259f-4682-8824-59a1ab605385 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.680250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.680871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.681203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.681515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.682153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.684310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:58.748720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35ca450d-767e-4ecc-918c-ca37db8ee513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f820289e80422cba920049f8e14442'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:47:58.788510 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3534/7112] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:47:58 2022] DELETE /identity/v3/users/b1f820289e80422cba920049f8e14442 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:58.793481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.794066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.794598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.800786 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3579/7113] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:58 2022] POST /identity/v3/users => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:58.801932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.803862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:58.820056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c3bc0-cfdf-4065-854b-54852b154367 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.847919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:58.847919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:58.949381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.950132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.950460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.950737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.951374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.953830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:58.964389 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3580/7114] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:58.968628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:58.982526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b160e8-90e1-4ad3-90b5-5202eaf0b605 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:58.988287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:58.989862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:58.990242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:58.990602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:58.991365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:58.993023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:59.001856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3535/7115] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:59.009726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:59.011628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:59.040137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3581/7116] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:47:59.044789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:59.080154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfecb2d-932c-4695-ab0d-41c7ee2cc8ac admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:59.086893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:59.087558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:59.087834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:59.088102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] PATH_INFO: `/v3/projects/dc389ac2d0f7416eb5bc69d17900afcf/users/6480f8c522a74e2abbda12c8b1cbc7d1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:59.107301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc389ac2d0f7416eb5bc69d17900afcf, user_id=6480f8c522a74e2abbda12c8b1cbc7d1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:59.110186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:59.112045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bde3d6-b259-49e9-90f2-e89ce9e18ef3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:59.116022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:59.116658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:59.117168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:59.117286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:59.126809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:59.128212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84155a-1116-45f3-86ba-1f5e19d233ae service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:59.137968 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3536/7117] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:47:59.205961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3582/7118] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:47:59 2022] PUT /identity/v3/projects/dc389ac2d0f7416eb5bc69d17900afcf/users/6480f8c522a74e2abbda12c8b1cbc7d1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:47:59.219053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:59.219352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:59.219615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:59.311112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] MFA Rules not processed for user `6480f8c522a74e2abbda12c8b1cbc7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:47:59.312452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:47:59.385467 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:59.417227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3537/7119] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:47:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:47:59.421717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:59.539212 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:47:59.558715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29537cd-8200-4a05-936f-5806d8591946 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:59.565647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:59.568901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:59.568901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:59.568901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:59.568901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:59.570040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:47:59.715888 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3583/7120] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:47:59 2022] POST /identity/v3/projects => generated 405 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:47:59.719852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:47:59.735392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfbbc4-480f-4065-b14c-d396ed995f85 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:47:59.816934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:47:59.817913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:47:59.818363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:47:59.818835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:47:59.819743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:47:59.822657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.119321 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3538/7121] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:47:59 2022] POST /identity/v3/users => generated 309 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:00.126105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.154600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601cbcf-7d16-4740-9242-6d38d0700d7c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.162694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.165895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.166446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.170206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.171551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:00.173951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.189657 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3584/7122] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:00.194094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.236859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cebdf-8782-4aa9-a428-93a12d4be9f7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.264955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.266256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.266541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.266848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] PATH_INFO: `/v3/projects/3e3e6bed7a0348249f68472ec99500fc/users/2c7734f393ff40178c282f38f0945bb1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.300322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3e6bed7a0348249f68472ec99500fc, user_id=2c7734f393ff40178c282f38f0945bb1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:00.306311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.390106 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3539/7123] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:00 2022] PUT /identity/v3/projects/3e3e6bed7a0348249f68472ec99500fc/users/2c7734f393ff40178c282f38f0945bb1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:00.394939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.407334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387695cb-1ebd-41c9-88bb-0a0980600eeb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.539200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.540031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.540483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.540761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.541443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:00.543057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.560054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3585/7124] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:00.561164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.576242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5ccc-0bec-42cd-a27b-520dd0bbec1a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.583200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.584017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.585190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.585581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] PATH_INFO: `/v3/projects/3e3e6bed7a0348249f68472ec99500fc/users/2c7734f393ff40178c282f38f0945bb1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.589117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3e6bed7a0348249f68472ec99500fc, user_id=2c7734f393ff40178c282f38f0945bb1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:00.592230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d6f0e-5e67-4d29-991e-7d11a2da7656 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.610101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3540/7125] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:00 2022] PUT /identity/v3/projects/3e3e6bed7a0348249f68472ec99500fc/users/2c7734f393ff40178c282f38f0945bb1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:00.624581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.625305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.625828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.627205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:00.627581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.645411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7138-a62a-4ca3-a2df-400f473f4316 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.701110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] MFA Rules not processed for user `2c7734f393ff40178c282f38f0945bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:00.701110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:00.795049 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3541/7126] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:00.803041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.803818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.804096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.804367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] PATH_INFO: `/v3/projects/0860665294a94f47a945958b27f873cb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:00.805561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0860665294a94f47a945958b27f873cb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:00.807450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:00.809442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:00.812404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:00.860380 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:00.939131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dae58a-a89f-4cfd-bfb0-c4897979a15d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:00.949100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:00.949771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:00.950051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:00.950324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:01.011574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:01.014378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:01.027925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0860665294a94f47a945958b27f873cb', 'request_id': 'req-5e975980-b13a-4067-b8ef-ac15d45f3a30'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.037238 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3542/7127] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:00 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:01.144378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0860665294a94f47a945958b27f873cb', 'request_id': 'req-5e975980-b13a-4067-b8ef-ac15d45f3a30'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.149195 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:01.162395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0860665294a94f47a945958b27f873cb', 'request_id': 'req-5e975980-b13a-4067-b8ef-ac15d45f3a30'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.187939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] The token cache is being invalidate because project 0860665294a94f47a945958b27f873cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:01.188307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.189971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.206934 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3586/7128] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:00 2022] DELETE /identity/v3/projects/0860665294a94f47a945958b27f873cb => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:01.216649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:01.235908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:01.238225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:01.243528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082a9e0-22eb-4987-b3a4-c185ebffc244 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:01.385175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:01.386013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:01.386287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975980-b13a-4067-b8ef-ac15d45f3a30 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:01.386511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:01.386887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] PATH_INFO: `/v3/users/4425cdd8be7a4280bd58bce51b05d620` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:01.388134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4425cdd8be7a4280bd58bce51b05d620)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:01.390908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:01.396880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:01.398465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:01.400440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:01.400918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] PATH_INFO: `/v3/users/6480f8c522a74e2abbda12c8b1cbc7d1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:01.403042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6480f8c522a74e2abbda12c8b1cbc7d1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:01.405075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:01.667055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6480f8c522a74e2abbda12c8b1cbc7d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.678906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4425cdd8be7a4280bd58bce51b05d620'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.693565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4425cdd8be7a4280bd58bce51b05d620'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.693565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4425cdd8be7a4280bd58bce51b05d620'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.693565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4425cdd8be7a4280bd58bce51b05d620'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.779954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6480f8c522a74e2abbda12c8b1cbc7d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.780631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6480f8c522a74e2abbda12c8b1cbc7d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.794449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6480f8c522a74e2abbda12c8b1cbc7d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.804169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-af96fb16-d302-41e7-b5a3-79f31f458299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6480f8c522a74e2abbda12c8b1cbc7d1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.815955 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3587/7129] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:01 2022] DELETE /identity/v3/users/6480f8c522a74e2abbda12c8b1cbc7d1 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:01.817422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:01.817712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:01.818017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:01.837779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:01.838975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:01.873697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4425cdd8be7a4280bd58bce51b05d620'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:01.920217 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3543/7130] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:01 2022] DELETE /identity/v3/users/4425cdd8be7a4280bd58bce51b05d620 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:01.953148 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3588/7131] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:01.977475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:01.980797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:02.045798 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:02.079641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a3a7c-d97c-480d-ac12-657cfa2f0b0d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:02.086310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:02.087550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:02.088040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:02.088900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:02.250007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:02.252102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f154a-7147-42fa-8dcc-6fe522ea5ff2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:02.264732 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3544/7132] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:02.763844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:02.766733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:02.782279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d846e-53c7-4be6-8653-9ab00ae197f5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:02.789055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:02.789654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:02.789938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:02.791325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] PATH_INFO: `/v3/projects/b3b4846b914e40eb8b806c17918f129f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:02.793745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b4846b914e40eb8b806c17918f129f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:02.799917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:02.803885 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:02.948882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b4846b914e40eb8b806c17918f129f', 'request_id': 'req-92b4921f-5b70-4443-822d-850c2a44dadf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.028301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b4846b914e40eb8b806c17918f129f', 'request_id': 'req-92b4921f-5b70-4443-822d-850c2a44dadf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.049431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b4846b914e40eb8b806c17918f129f', 'request_id': 'req-92b4921f-5b70-4443-822d-850c2a44dadf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.094187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] The token cache is being invalidate because project b3b4846b914e40eb8b806c17918f129f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:03.094498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.098145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.100497 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3589/7133] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:02 2022] DELETE /identity/v3/projects/b3b4846b914e40eb8b806c17918f129f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:03.106543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4cb-1b4d-47f6-950c-8b1bdc5a5395 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.107063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4cb-1b4d-47f6-950c-8b1bdc5a5395 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.107278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f4cb-1b4d-47f6-950c-8b1bdc5a5395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.127754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3ea1f4cb-1b4d-47f6-950c-8b1bdc5a5395 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:03.128968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3ea1f4cb-1b4d-47f6-950c-8b1bdc5a5395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:03.201838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.203567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:03.213618 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3545/7134] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:03.219123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.219553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.219674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.247031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:03.248324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:03.250532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4921f-5b70-4443-822d-850c2a44dadf admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.264195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.264195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.264195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.264195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] PATH_INFO: `/v3/projects/dc389ac2d0f7416eb5bc69d17900afcf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.270862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc389ac2d0f7416eb5bc69d17900afcf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.272316 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3546/7135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:03.273265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.276470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.284596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ada3-9726-49fb-b351-fdcde379a08e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.289873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.290490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.292080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.292080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.292080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:03.292080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.294011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.309595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3547/7136] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:03.312130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.324223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dc383-a8a8-49af-bfcc-0e7f33ad90c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.330977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.332274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.332274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.332274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.332844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.334837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.388363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc389ac2d0f7416eb5bc69d17900afcf', 'request_id': 'req-0711ebdf-360b-4609-bc1b-b868c6e13ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.463501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc389ac2d0f7416eb5bc69d17900afcf', 'request_id': 'req-0711ebdf-360b-4609-bc1b-b868c6e13ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.472274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc389ac2d0f7416eb5bc69d17900afcf', 'request_id': 'req-0711ebdf-360b-4609-bc1b-b868c6e13ec9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.486275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] The token cache is being invalidate because project dc389ac2d0f7416eb5bc69d17900afcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:03.486570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.488229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.489014 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3590/7137] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:03 2022] DELETE /identity/v3/projects/dc389ac2d0f7416eb5bc69d17900afcf => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:03.493006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.494374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:03.576619 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3548/7138] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:03 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:03.580311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.586339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:03.603421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711ebdf-360b-4609-bc1b-b868c6e13ec9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.626451 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:03.652279 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:03.674171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff626a-937d-4c4b-ac0d-c474cf7baddc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.683987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.684596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.684869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.685135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.685813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.687700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.692671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.692671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.693611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.694117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] PATH_INFO: `/v3/users/2c7734f393ff40178c282f38f0945bb1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.695889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7734f393ff40178c282f38f0945bb1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.698300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.759601 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3549/7139] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:03 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:03.763402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.774071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c1dd-41a9-4ae8-b52e-5ff7a42f05a3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.780409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.783419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.783419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.783419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.783419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.784266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.806644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3550/7140] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:03.810638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.820924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e955-7692-4b8f-aff7-88dbbdbcbf4b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.825855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.826451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.826725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.826996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.827628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.829764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.842633 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3551/7141] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:03.847401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:03.858876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe88f24-dea5-4928-83a2-5aafd547bfcd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:03.863808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:03.864456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.865944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.865944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] PATH_INFO: `/v3/projects/144c11d41b664cdca0b1efce81dc5c65/users/48cd1fa249b24fc7830719bbe34d0c31/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:03.880998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=144c11d41b664cdca0b1efce81dc5c65, user_id=48cd1fa249b24fc7830719bbe34d0c31, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:03.883886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef747de1-d479-4424-952a-d0defae0ef75 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:03.921817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7734f393ff40178c282f38f0945bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:03.982907 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3552/7142] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:03 2022] PUT /identity/v3/projects/144c11d41b664cdca0b1efce81dc5c65/users/48cd1fa249b24fc7830719bbe34d0c31/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:03.998729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:03.998729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:03.998729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.001578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7734f393ff40178c282f38f0945bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.004783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7734f393ff40178c282f38f0945bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.035833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] MFA Rules not processed for user `48cd1fa249b24fc7830719bbe34d0c31`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:04.040497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.046687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7734f393ff40178c282f38f0945bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.070953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7734f393ff40178c282f38f0945bb1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.083275 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3591/7143] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:03 2022] DELETE /identity/v3/users/2c7734f393ff40178c282f38f0945bb1 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:04.122379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3553/7144] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:04.127536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.128980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.230145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c2cf-a62f-4b9a-b44d-01fd68a71a5f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.236274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.241388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.241388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.241388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.241388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.241388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.344044 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3592/7145] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:04.348737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.443761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4087ce-5402-4ff1-b731-b1bd4211fd73 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.477938 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:04.510353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.513510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.513510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.513510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.513510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.514584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.515841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.517666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.539173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde934da-6416-4546-820d-7cf70e3aa61b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.544831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.545599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.545994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.546310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] PATH_INFO: `/v3/projects/3e3e6bed7a0348249f68472ec99500fc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.548572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3e6bed7a0348249f68472ec99500fc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.550896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.573774 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:04.588834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3554/7146] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:04.592815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.603427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a4e23-cb6b-43d7-aad0-61f84e35f312 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.608081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.608694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.609014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.609353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.610142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.611757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.621799 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3555/7147] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:04.625921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.635537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b68bc5-2e7d-409c-90e7-efc1a240eca9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.650928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3e6bed7a0348249f68472ec99500fc', 'request_id': 'req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.693160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.693837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.694786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.694786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] PATH_INFO: `/v3/projects/fa057ce06e10420b841b20f8dcdfedc6/users/8a28784b4bcb4484bb638beec6e76807/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.708343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa057ce06e10420b841b20f8dcdfedc6, user_id=8a28784b4bcb4484bb638beec6e76807, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.711010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.724577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3e6bed7a0348249f68472ec99500fc', 'request_id': 'req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.733032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3e6bed7a0348249f68472ec99500fc', 'request_id': 'req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.743581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] The token cache is being invalidate because project 3e3e6bed7a0348249f68472ec99500fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:04.743871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.744637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2f48a0b2-a4be-4d1b-a7a2-6f5a7794d426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:04.746413 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3593/7148] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:04 2022] DELETE /identity/v3/projects/3e3e6bed7a0348249f68472ec99500fc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:04.751186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97da2-35a3-4d15-978b-282eefb459e6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.751463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97da2-35a3-4d15-978b-282eefb459e6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.751756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa97da2-35a3-4d15-978b-282eefb459e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.771968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0fa97da2-35a3-4d15-978b-282eefb459e6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:04.773177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0fa97da2-35a3-4d15-978b-282eefb459e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.781135 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3594/7149] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:04.789446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.789731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.790007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.809651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:04.810868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.812801 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3556/7150] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:04 2022] PUT /identity/v3/projects/fa057ce06e10420b841b20f8dcdfedc6/users/8a28784b4bcb4484bb638beec6e76807/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:04.816893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.818535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:04.906766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fce00d-5908-4f4e-8f14-dfe7a17904bd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.912067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.912673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.912954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.913228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.913914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.914107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3595/7151] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:04.915633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.917927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.926632 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3557/7152] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:04.930690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9127a2-ef0f-45b7-8bad-b883c1e60420 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.931209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.936268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.937097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.938136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.939054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.939848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:04.940186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.941865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcab0c-01e7-456d-a2f0-ed462ce8834f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:04.942199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52fd5-3111-476f-9825-759e3b24c5ce admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.946851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:04.947488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.947772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.948093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] PATH_INFO: `/v3/projects/fa057ce06e10420b841b20f8dcdfedc6/users/8a28784b4bcb4484bb638beec6e76807/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:04.950008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa057ce06e10420b841b20f8dcdfedc6, user_id=8a28784b4bcb4484bb638beec6e76807, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:04.953897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:04.964727 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3558/7153] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:04 2022] PUT /identity/v3/projects/fa057ce06e10420b841b20f8dcdfedc6/users/8a28784b4bcb4484bb638beec6e76807/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:04.968775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3596/7154] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:04.972675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:04.979168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:04.979457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:04.979797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.013962 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:05.021250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] MFA Rules not processed for user `8a28784b4bcb4484bb638beec6e76807`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:05.022964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:05.087578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618d63f-fe70-47fc-bbe0-bc62da585c7c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.093280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.093280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.093626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.093746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.094393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.096823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.118829 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3597/7155] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:05.126950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.128421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:05.142992 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:05.190471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4e82-97e1-4b59-85d9-e7e2a5ad820b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.194422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.195100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.195544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.195772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.207077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.209361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.224331 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3559/7156] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:04 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:05.230020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.232455 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3598/7157] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:05.354901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b5c79-d110-454f-9e41-6dfebe35fbe9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.360505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.361112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.361420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.361707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.362338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.364706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.452847 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3560/7158] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:05 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:05.459517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.473629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14fbb-d0f0-4fd9-b2c6-097af483a609 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.488707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.491209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.491615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.491764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.492425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.494098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.521831 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3599/7159] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:05.523029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.546851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d682c9-d3f8-448b-81f4-ce7dbacee120 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.562189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.562924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.565672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.565963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.566628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.568289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f6c8d-b3e8-4b8d-8a14-384479b8f159 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.585372 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3561/7160] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:05.589847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.600278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761c29f-ceeb-43b9-adfb-2899dbfb6088 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.608167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.608828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.609110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.609420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] PATH_INFO: `/v3/projects/67fb0a9448ed4565aafc7914622f33ea/users/9473c82bb5994d4b9b833e2b5a3bfec1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.626722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fb0a9448ed4565aafc7914622f33ea, user_id=9473c82bb5994d4b9b833e2b5a3bfec1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:05.629597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:05.722869 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3600/7161] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:05 2022] PUT /identity/v3/projects/67fb0a9448ed4565aafc7914622f33ea/users/9473c82bb5994d4b9b833e2b5a3bfec1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:05.734963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.735313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.735619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:05.773609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] MFA Rules not processed for user `9473c82bb5994d4b9b833e2b5a3bfec1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:05.774855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:05.869437 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3562/7162] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:05.874512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.926840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:05.933756 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:05.988722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21483464-2666-477c-be67-e6db95a1b0f5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:05.998607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:05.999343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:05.999776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:05.999951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.000708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.002642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.040400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297691a-306e-4913-8bee-534f27e914f1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.046095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.046700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.047016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.048449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] PATH_INFO: `/v3/users/48cd1fa249b24fc7830719bbe34d0c31` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.049204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cd1fa249b24fc7830719bbe34d0c31)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.051679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.128524 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3601/7163] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:05 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:06.136892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.234180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cd1fa249b24fc7830719bbe34d0c31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:06.234800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cd1fa249b24fc7830719bbe34d0c31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:06.237085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b447d2f-d608-4be7-ad69-f324330dba9f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.247289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.253110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.253110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.253110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.253110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.253110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.258343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cd1fa249b24fc7830719bbe34d0c31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:06.259786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cd1fa249b24fc7830719bbe34d0c31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:06.265068 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:06.343280 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3602/7164] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:06 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:06.352093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.354419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:06.367238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2d2589b5-f001-4b81-abfa-e3dcd2e059ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cd1fa249b24fc7830719bbe34d0c31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:06.375503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25a0cd-a372-4b40-b9df-6c5d162656af admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.389710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.390432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.390842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.391303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.392309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.394636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.410134 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3563/7165] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:05 2022] DELETE /identity/v3/users/48cd1fa249b24fc7830719bbe34d0c31 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:06.411777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.412058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.412327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.418803 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3603/7166] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:06.419814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.434475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1454a3-2019-4a00-8029-bb198fb373d4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.469472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:06.471518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:06.574432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.575182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.575470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.576445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] PATH_INFO: `/v3/projects/635ed26dd1c041cfb75069e739494480/users/0608009284124c21a1b4136b1a22ced0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.599169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3564/7167] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:06.601753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635ed26dd1c041cfb75069e739494480, user_id=0608009284124c21a1b4136b1a22ced0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.601753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.611685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.613081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:06.641474 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:06.670472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3604/7168] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:06 2022] PUT /identity/v3/projects/635ed26dd1c041cfb75069e739494480/users/0608009284124c21a1b4136b1a22ced0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:06.682376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cc637-bd1b-4679-ad6b-19e761b0bdb3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.686819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.753015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.754457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.754457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.754457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.787699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92cb1-6cd4-4fa2-a19a-0f8106afeb69 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.793543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.806405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.806405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.806405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.806405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.806405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.813287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3605/7169] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:06.818327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:06.830686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.833232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f9b40-97c1-4a8c-8db2-f7b2be3bc17e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.834395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96d371-86ee-4631-81b7-aea159981c11 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:06.841466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:06.842178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.842454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.842727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] PATH_INFO: `/v3/projects/635ed26dd1c041cfb75069e739494480/users/0608009284124c21a1b4136b1a22ced0/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.849853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=635ed26dd1c041cfb75069e739494480, user_id=0608009284124c21a1b4136b1a22ced0, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:06.850115 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3565/7170] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:06.853665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:06.871329 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3606/7171] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:06 2022] PUT /identity/v3/projects/635ed26dd1c041cfb75069e739494480/users/0608009284124c21a1b4136b1a22ced0/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:06.884811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:06.885365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:06.885717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:06.924098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] MFA Rules not processed for user `0608009284124c21a1b4136b1a22ced0`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:06.925442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.022056 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3566/7172] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:07.033538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:07.035270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.102991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f027eb-6e58-4ce3-bece-21a19a5428ac admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:07.107371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:07.108030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.108314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.109142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.121415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:07.123541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:07.129182 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:07.142142 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3607/7173] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:07.331426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:07.361006 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:07.407857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5837e-3684-4f82-af0d-b83ff7cd25f8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:07.412568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:07.413201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.413507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.413775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] PATH_INFO: `/v3/users/9473c82bb5994d4b9b833e2b5a3bfec1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.414941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9473c82bb5994d4b9b833e2b5a3bfec1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:07.416867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:07.490822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:07.492232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.509519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d389-38ef-4979-990c-38704625e5a2 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:07.517835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:07.518975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.519591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.520479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] PATH_INFO: `/v3/projects/144c11d41b664cdca0b1efce81dc5c65` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.522276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=144c11d41b664cdca0b1efce81dc5c65)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:07.525215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:07.607773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9473c82bb5994d4b9b833e2b5a3bfec1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.608501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9473c82bb5994d4b9b833e2b5a3bfec1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.615840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9473c82bb5994d4b9b833e2b5a3bfec1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.616799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9473c82bb5994d4b9b833e2b5a3bfec1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.638816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144c11d41b664cdca0b1efce81dc5c65', 'request_id': 'req-44323cac-be44-45b9-9995-5eec2190e9f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.737972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b3989816-db67-4e89-b057-973536f80331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9473c82bb5994d4b9b833e2b5a3bfec1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.760232 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3567/7174] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:07 2022] DELETE /identity/v3/users/9473c82bb5994d4b9b833e2b5a3bfec1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:07.764627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.764902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.765179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.785505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:07.786726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.805043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144c11d41b664cdca0b1efce81dc5c65', 'request_id': 'req-44323cac-be44-45b9-9995-5eec2190e9f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.812280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144c11d41b664cdca0b1efce81dc5c65', 'request_id': 'req-44323cac-be44-45b9-9995-5eec2190e9f3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.823919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] The token cache is being invalidate because project 144c11d41b664cdca0b1efce81dc5c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:07.824241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.824925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:07.826585 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3608/7175] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:07 2022] DELETE /identity/v3/projects/144c11d41b664cdca0b1efce81dc5c65 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:07.831527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:07.832860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.848427 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3568/7176] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:07.860017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:07.861430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:07.907196 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:07.910816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44323cac-be44-45b9-9995-5eec2190e9f3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:07.916230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:07.916990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.917463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.917608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] PATH_INFO: `/v3/users/8a28784b4bcb4484bb638beec6e76807` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.918684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a28784b4bcb4484bb638beec6e76807)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:07.920788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:07.929608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298515-b392-4d11-80cd-db7749d0c318 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:07.934862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:07.937551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:07.937551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:07.937551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:07.946644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:07.948095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:07.961368 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3569/7177] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:08.192334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a28784b4bcb4484bb638beec6e76807'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.278711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a28784b4bcb4484bb638beec6e76807'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.282231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a28784b4bcb4484bb638beec6e76807'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.293280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a28784b4bcb4484bb638beec6e76807'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.299783 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:08.301641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a28784b4bcb4484bb638beec6e76807'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.309401 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3609/7178] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:07 2022] DELETE /identity/v3/users/8a28784b4bcb4484bb638beec6e76807 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:08.454157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:08.456112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:08.474092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c58f5-097a-4c41-8b60-862376202f64 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:08.610936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:08.611605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:08.611890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:08.612220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] PATH_INFO: `/v3/projects/67fb0a9448ed4565aafc7914622f33ea` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:08.616703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fb0a9448ed4565aafc7914622f33ea)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:08.618965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:08.804677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fb0a9448ed4565aafc7914622f33ea', 'request_id': 'req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:08.820927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fb0a9448ed4565aafc7914622f33ea', 'request_id': 'req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.050604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fb0a9448ed4565aafc7914622f33ea', 'request_id': 'req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.064976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] The token cache is being invalidate because project 67fb0a9448ed4565aafc7914622f33ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:09.065443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.066350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.068126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3570/7179] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:08 2022] DELETE /identity/v3/projects/67fb0a9448ed4565aafc7914622f33ea => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:09.072372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:09.073854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:09.092477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b44a6b-50ab-4e74-b958-34b2d799f206 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:09.122835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:09.124287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:09.164443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:09.165083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.165384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.165666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] PATH_INFO: `/v3/users/0608009284124c21a1b4136b1a22ced0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.166794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0608009284124c21a1b4136b1a22ced0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:09.168925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:09.197002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b3d-2e13-4675-b6aa-f0ca7c9330cd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:09.202357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:09.202988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.203269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.203577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] PATH_INFO: `/v3/projects/fa057ce06e10420b841b20f8dcdfedc6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.204739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa057ce06e10420b841b20f8dcdfedc6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:09.206678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:09.217367 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:09.459530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa057ce06e10420b841b20f8dcdfedc6', 'request_id': 'req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.460244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0608009284124c21a1b4136b1a22ced0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.465976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa057ce06e10420b841b20f8dcdfedc6', 'request_id': 'req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.558952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0608009284124c21a1b4136b1a22ced0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.559690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0608009284124c21a1b4136b1a22ced0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.572157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0608009284124c21a1b4136b1a22ced0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.578975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9c92ce91-39b8-4d59-9d9c-2af15a3a5827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0608009284124c21a1b4136b1a22ced0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.584753 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3610/7180] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:09 2022] DELETE /identity/v3/users/0608009284124c21a1b4136b1a22ced0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:09.633473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa057ce06e10420b841b20f8dcdfedc6', 'request_id': 'req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.649861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] The token cache is being invalidate because project fa057ce06e10420b841b20f8dcdfedc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:09.650154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.650816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d52cedc5-4a8a-45b9-a45d-f8d5923e876c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:09.655788 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3571/7181] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:09 2022] DELETE /identity/v3/projects/fa057ce06e10420b841b20f8dcdfedc6 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:09.657913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.661208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.661208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.683305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:09.687351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:09.754867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3611/7182] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:09.762802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.763277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.763631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.798818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:09.801074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:09.821155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:09.844474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3572/7183] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:09.848954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff753e-fbb1-44a5-8384-2c90575cee3e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:09.855832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:09.856467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.856983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.857264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.857965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:09.858261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:09.859870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:09.876591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3612/7184] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:09.882007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:09.897054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccf5b5-7a1a-4479-b39f-6a6259bc6906 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:09.903032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:09.904074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:09.904507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:09.904782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:09.918152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:09.925565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.104825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3573/7185] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:09 2022] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:10.109272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.115597 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:10.121689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528688e-4f59-4d30-83ad-bce9ac90e10c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.169615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.171641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:10.278621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.280263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.280698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.281117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.282095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.285049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.297611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9403-0c02-4d1b-8416-839bde577578 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.316644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.317294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.317649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.320132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] PATH_INFO: `/v3/projects/635ed26dd1c041cfb75069e739494480` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.320132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=635ed26dd1c041cfb75069e739494480)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.320948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.371823 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3613/7186] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:10.376373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.389760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1adf8-e99b-40a1-b47b-45220d86471c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.395173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.395778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.396053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.396321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.396952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.398898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.413239 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3614/7187] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:10.414476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.425445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b77b4b-f730-4951-80f5-4b1731330905 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.430118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.430744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.431025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.431297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.431927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.433562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.444219 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3615/7188] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:10.448502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.459010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f1537-840f-4f43-9956-b3255e05e558 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.464302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635ed26dd1c041cfb75069e739494480', 'request_id': 'req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:10.473503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635ed26dd1c041cfb75069e739494480', 'request_id': 'req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:10.523250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.523919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.524202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.524481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] PATH_INFO: `/v3/projects/c7f136933de5465f8590e9b153955d04/users/b7978c02b2bf413b81e1d14350af13b4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.541669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f136933de5465f8590e9b153955d04, user_id=b7978c02b2bf413b81e1d14350af13b4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.544415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f856ea8-9b7a-4d19-9ac9-5c6d19e9a9f0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.589384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635ed26dd1c041cfb75069e739494480', 'request_id': 'req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:10.603261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] The token cache is being invalidate because project 635ed26dd1c041cfb75069e739494480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:10.603558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:10.604267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-efdcd7d9-3fd1-435c-83c7-18f2a218ab7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:10.611144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3574/7189] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:10 2022] DELETE /identity/v3/projects/635ed26dd1c041cfb75069e739494480 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:10.612832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a89-7657-4c22-ac24-cb06ee5798cc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.613660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a89-7657-4c22-ac24-cb06ee5798cc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.615327 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:10.615870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a49a89-7657-4c22-ac24-cb06ee5798cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.619665 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3616/7190] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:10 2022] PUT /identity/v3/projects/c7f136933de5465f8590e9b153955d04/users/b7978c02b2bf413b81e1d14350af13b4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:10.631326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.631655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.631937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.638578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-31a49a89-7657-4c22-ac24-cb06ee5798cc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:10.639855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-31a49a89-7657-4c22-ac24-cb06ee5798cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:10.652495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:10.653717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:10.706394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3575/7191] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:10.714329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.714972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.715249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.726732 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3617/7192] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:10.736577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.738167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:10.738701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:10.739947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:10.748211 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3576/7193] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:10.752317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.762110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6da636-0ba1-428a-9073-7dec2a6b1f03 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.770650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.771274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.771548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.771810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.772442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:10.772734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.774746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.788806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3577/7194] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:48:10.792662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.803854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e801c1c-3fb1-4fcc-bf8e-901b8cd37be0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.807275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f7fdb-80ab-4a51-a4f7-ff3c7ecf9a24 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:10.808991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.809612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.810005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.810276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.810959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.811082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:10.811669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:10.811980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:10.812252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:10.812798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.823360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:10.824768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:10.834575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3618/7195] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:10.973094 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3578/7196] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:10.977322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:10.988650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164987e5-ab10-44f6-bc35-fc2336e7ec56 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.046236 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:11.075135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.075840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.076303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.076544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.077250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.079281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.151925 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3619/7197] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:10 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:11.152432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.164263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523946a-4135-421f-97d2-8d975c4ca0cd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.169841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.170522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.170876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.171488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.172053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.174450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.189365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.192189 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3579/7198] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:11.202794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f336-f9c2-45a4-81c2-b98d8b69ac76 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.209364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.213178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.213178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.213178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.213178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.214109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155278-722e-49db-86f3-507b360e92f2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.225373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3620/7199] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:11.229879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.240783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bffa68-d12b-45dd-8f97-727389b29ba3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.245935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.246594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.246881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.247162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] PATH_INFO: `/v3/projects/a1af0c0242b643369a92f0504d56b5c0/users/32085ced84944989b0291cac5a75e238/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.262473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1af0c0242b643369a92f0504d56b5c0, user_id=32085ced84944989b0291cac5a75e238, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.265230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.342444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3580/7200] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:11 2022] PUT /identity/v3/projects/a1af0c0242b643369a92f0504d56b5c0/users/32085ced84944989b0291cac5a75e238/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:11.354473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.354774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.355050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.395362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] MFA Rules not processed for user `32085ced84944989b0291cac5a75e238`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:11.397187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:11.481254 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3621/7201] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:11.485474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.560832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803645-24f3-47f8-a7f0-9f7e23535eb4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.566309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.567094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.567378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.567654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.568680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.570414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.690300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3581/7202] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:11 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:11.694317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.703792 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:11.713219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb835-71d9-4c04-be97-eaba8562f29d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.802759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.803939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.804283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.804653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.806337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.809005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.916137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3622/7203] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:11 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:11.920028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.932455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06186972-554b-4aa8-a27b-ba014559ce0e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.939596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.940494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.940780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.941217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:11.942184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:11.948342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:11.948342 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:11.958724 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3582/7204] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:11.962339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:11.975243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff1f9a-5cd3-400d-99a3-581685c35ce8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:11.984487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:11.986319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:11.989026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:11.989363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] PATH_INFO: `/v3/projects/5f624c9e18054b7e8cc666e0180b6650/users/cffdad3d3c85494fbb6ffe2862070309/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.014908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f624c9e18054b7e8cc666e0180b6650, user_id=cffdad3d3c85494fbb6ffe2862070309, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.018374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.079600 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3623/7205] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:11 2022] PUT /identity/v3/projects/5f624c9e18054b7e8cc666e0180b6650/users/cffdad3d3c85494fbb6ffe2862070309/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:12.083486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.093659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de431f-82ba-4b08-910a-ba17150aa6e9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.152661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.153262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.153580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.153856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.154489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.156072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618835f-a0d9-4ce1-809c-a24255d451e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.169463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3583/7206] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:12.173325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.187714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8675de-07f2-43dc-aeb3-10ed55281882 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.193681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.194282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.195022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.195022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] PATH_INFO: `/v3/projects/5f624c9e18054b7e8cc666e0180b6650/users/cffdad3d3c85494fbb6ffe2862070309/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.197023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f624c9e18054b7e8cc666e0180b6650, user_id=cffdad3d3c85494fbb6ffe2862070309, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.200112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f91de-50df-46cb-b10b-d25e6cd0efae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.213532 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3624/7207] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:12 2022] PUT /identity/v3/projects/5f624c9e18054b7e8cc666e0180b6650/users/cffdad3d3c85494fbb6ffe2862070309/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:12.224755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.225089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.225393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.276183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.276465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.276932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.285297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] MFA Rules not processed for user `cffdad3d3c85494fbb6ffe2862070309`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:12.288923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:12.321218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] MFA Rules not processed for user `b7978c02b2bf413b81e1d14350af13b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:12.322911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:12.398098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3584/7208] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:12.411332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.412725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:12.421017 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3625/7209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:12.425352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.429535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:12.487954 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:12.510596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493be99-21a1-49a5-b9a4-00375c13f446 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.512787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48479-ca7f-49b0-802a-285b053856f5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.517097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.517786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.517926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.518056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.518336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.518601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.518970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.519108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.519556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.520877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.531598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.533225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.543707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3585/7210] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:12.614534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3626/7211] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:12 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:12.618883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.642151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a739a0-bcb7-4578-8f03-01cc17c094f3 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.674848 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:12.723635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.724321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.724608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.724883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.725650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.728496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.853348 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3586/7212] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:12 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:12.857290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.868504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad67e6f-4c73-4955-b248-81fd0ca7e072 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.878626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.878626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.878626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.878626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.879022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.879022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:12.890067 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3627/7213] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:12.894712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:12.905383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5a9b1-192a-4daf-a24a-9524cba358f3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:12.910729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:12.911379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:12.911663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:12.912291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] PATH_INFO: `/v3/projects/a14d2327c6f74693a2363bc408c5f6b7/users/a1b74d8542624fb3a3f28cb7c0c765ba/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:12.927427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14d2327c6f74693a2363bc408c5f6b7, user_id=a1b74d8542624fb3a3f28cb7c0c765ba, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:12.930112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:13.039577 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3587/7214] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:12 2022] PUT /identity/v3/projects/a14d2327c6f74693a2363bc408c5f6b7/users/a1b74d8542624fb3a3f28cb7c0c765ba/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:13.043685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:13.057019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e3ba-3a43-4a7a-a587-7eba1830bbea admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:13.132911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:13.135895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:13.135895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:13.135895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:13.135895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:13.138799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f95b2b-34c7-475f-8cc2-c3ed5144b046 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:13.173700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3628/7215] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:13.177792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:13.193273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe273-7633-4da8-866b-605bf5f36ad5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:13.200190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:13.201045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:13.201587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:13.202073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] PATH_INFO: `/v3/projects/a14d2327c6f74693a2363bc408c5f6b7/users/a1b74d8542624fb3a3f28cb7c0c765ba/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:13.205403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14d2327c6f74693a2363bc408c5f6b7, user_id=a1b74d8542624fb3a3f28cb7c0c765ba, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:13.209807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:13.221590 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3588/7216] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:13 2022] PUT /identity/v3/projects/a14d2327c6f74693a2363bc408c5f6b7/users/a1b74d8542624fb3a3f28cb7c0c765ba/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:13.439009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:13.439009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:13.439009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:13.465047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:13.466792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:13.557516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3629/7217] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 01:48:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:13.565007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:13.567092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:13.652528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655291b2-aa92-4229-b2a7-e50808207b4e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:13.662584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:13.662584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:13.662584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:13.662584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:13.669423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:13.671434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82be8e4-91c4-486d-a5f4-f7b5c4bce1ca service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:13.680278 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3589/7218] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:48:13.925844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:14.004957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41572c5-0951-450d-b59e-dab90bae5752 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:14.009795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:14.010715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:14.011001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:14.011278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] PATH_INFO: `/v3/users/32085ced84944989b0291cac5a75e238` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:14.012449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32085ced84944989b0291cac5a75e238)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:14.014523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:14.017609 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:14.245177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32085ced84944989b0291cac5a75e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:14.323931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32085ced84944989b0291cac5a75e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:14.323931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32085ced84944989b0291cac5a75e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:14.340249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32085ced84944989b0291cac5a75e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:14.351263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32085ced84944989b0291cac5a75e238'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:14.362665 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3630/7219] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:13 2022] DELETE /identity/v3/users/32085ced84944989b0291cac5a75e238 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:14.368319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfc44-694a-4c0b-b91e-90be90e336ed None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:14.373564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfc44-694a-4c0b-b91e-90be90e336ed None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:14.374144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfc44-694a-4c0b-b91e-90be90e336ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:14.405227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-27edfc44-694a-4c0b-b91e-90be90e336ed None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:14.406626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-27edfc44-694a-4c0b-b91e-90be90e336ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:14.490748 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3590/7220] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:14.500969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:14.502977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:14.574576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1775-ef86-4925-9d13-e7feef9ac243 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:14.579321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:14.579932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:14.580212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:14.580484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:14.590337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:14.593889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39d73-d83c-48d4-a10f-575f4965e75e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:14.617952 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3631/7221] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:14.805973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:14.806509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:14.806509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:14.817176 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:14.838048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] MFA Rules not processed for user `a1b74d8542624fb3a3f28cb7c0c765ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:14.839264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:14.961383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3591/7222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:14.964986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:14.965475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:14.965971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:14.996583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] MFA Rules not processed for user `b7978c02b2bf413b81e1d14350af13b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:14.999655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:15.070399 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3632/7223] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:15.083491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:15.085363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:15.187526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3b7f4-9ed0-40bf-a742-40e02ffad101 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:15.194249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:15.194886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:15.195281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:15.195478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:15.197356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:15.209168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:15.210808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:15.228756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3592/7224] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:15.261794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:15.261794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:15.278025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449469e2-1e97-40ff-a3ad-80fa82a61520 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:15.283258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:15.284213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:15.284567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:15.284904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] PATH_INFO: `/v3/projects/a1af0c0242b643369a92f0504d56b5c0` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:15.286782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1af0c0242b643369a92f0504d56b5c0)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:15.289679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:15.329429 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:15.424161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1af0c0242b643369a92f0504d56b5c0', 'request_id': 'req-eb5e3992-7260-457a-9948-5012b2dbf589'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.553011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1af0c0242b643369a92f0504d56b5c0', 'request_id': 'req-eb5e3992-7260-457a-9948-5012b2dbf589'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.560199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1af0c0242b643369a92f0504d56b5c0', 'request_id': 'req-eb5e3992-7260-457a-9948-5012b2dbf589'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.570905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] The token cache is being invalidate because project a1af0c0242b643369a92f0504d56b5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:15.571189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.571838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.573309 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3633/7225] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:15 2022] DELETE /identity/v3/projects/a1af0c0242b643369a92f0504d56b5c0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:15.577254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:15.588373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e60d95-9521-498e-a6b4-b9d00fd3ac53 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:15.655386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:15.656269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:15.657134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:15.657641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] PATH_INFO: `/v3/users/cffdad3d3c85494fbb6ffe2862070309` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:15.658791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffdad3d3c85494fbb6ffe2862070309)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:15.661242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:15.680205 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:15.872104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffdad3d3c85494fbb6ffe2862070309'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.878893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffdad3d3c85494fbb6ffe2862070309'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.912969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffdad3d3c85494fbb6ffe2862070309'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.913738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffdad3d3c85494fbb6ffe2862070309'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:15.981163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffdad3d3c85494fbb6ffe2862070309'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:16.001796 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3593/7226] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:15 2022] DELETE /identity/v3/users/cffdad3d3c85494fbb6ffe2862070309 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:16.510912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:16.512187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:16.622725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e3992-7260-457a-9948-5012b2dbf589 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:16.653605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:16.655623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:16.749382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:16.751176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:16.751722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:16.751854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:16.757755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:16.771755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:16.773840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbe5cf-dd1b-4cc6-a20f-b17af55e18e7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:16.774296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11dbf-fba4-42ec-8f53-832cb5dded57 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:16.779241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:16.779870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:16.780743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:16.780743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] PATH_INFO: `/v3/projects/5f624c9e18054b7e8cc666e0180b6650` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:16.781773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f624c9e18054b7e8cc666e0180b6650)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:16.783939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:16.792509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3634/7227] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:16.905665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f624c9e18054b7e8cc666e0180b6650', 'request_id': 'req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:16.913696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f624c9e18054b7e8cc666e0180b6650', 'request_id': 'req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:17.016971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f624c9e18054b7e8cc666e0180b6650', 'request_id': 'req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:17.032405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] The token cache is being invalidate because project 5f624c9e18054b7e8cc666e0180b6650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:17.032893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:17.033553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a64349a1-9bb4-45e9-96c9-625a3bb1c4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:17.035557 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3594/7228] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:16 2022] DELETE /identity/v3/projects/5f624c9e18054b7e8cc666e0180b6650 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:17.040530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.040815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.041122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.063547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:17.064837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:17.122825 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:17.143499 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3635/7229] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:17.152324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.152605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.152877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.175729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:17.177132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:17.206528 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3595/7230] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:17.210854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.224051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f929e8-88e3-4e87-a379-7f98a81fa7dc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.229601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.230458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.230738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.231006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.231972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:17.232824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.235829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.282794 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3636/7231] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:17.287178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.300676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f3023-5938-400c-9ece-59e764dd3fb4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.310119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.310119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.310119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.310119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.310541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.311575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.329418 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:17.486713 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3596/7232] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:17 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:17.491158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.503312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29710ba1-16de-458b-982e-c7e67f7be063 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.567781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.568513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.568671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.568941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.569623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.571562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.662354 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3637/7233] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:17 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:17.666463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.677676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39be3e-b499-4db7-b162-3038bb2c6741 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.682356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.682943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.683220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.683488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.684144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.685766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.701501 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3597/7234] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:17.705367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.715635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9d268-645e-4646-911a-004555d75e83 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.722671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.723334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.723620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.723942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.724624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.726600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e763227-530f-47b3-984d-87aeef478650 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.741057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3638/7235] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:17.742814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:17.753556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449654-1c6c-4000-8d8e-8371ec957fe5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:17.760285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:17.760948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.761226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.761532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] PATH_INFO: `/v3/projects/c923371fbda543d38a85bea4a8655690/users/33db174bfef34338ac23f82e50840b98/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.778212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c923371fbda543d38a85bea4a8655690, user_id=33db174bfef34338ac23f82e50840b98, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:17.784633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:17.903834 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3598/7236] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:17 2022] PUT /identity/v3/projects/c923371fbda543d38a85bea4a8655690/users/33db174bfef34338ac23f82e50840b98/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:17.915821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:17.916116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:17.916439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:17.946485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] MFA Rules not processed for user `33db174bfef34338ac23f82e50840b98`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:17.947703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:18.011700 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3639/7237] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:18.016369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.079241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72350806-6468-4026-b6c5-d16f0beeaa63 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.083938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.084541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.084818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.085090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.085781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.087660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:18.228361 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3599/7238] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:18 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:18.232692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.244924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1653-cd70-4ed9-a782-4bfc77395a84 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.294238 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:18.315329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.315936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.316275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.316728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.317493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.319810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:18.628634 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3640/7239] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:18 2022] POST /identity/v3/users => generated 297 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:18.632486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.648000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7647-4bcd-4205-a436-89dd49b28e79 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.652952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.653791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.654071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.654468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.655112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.657573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:18.671344 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3600/7240] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:18.675629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.689156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24552838-770b-4d02-bb4c-403d0723b10a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.694079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.695019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.699550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.699550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] PATH_INFO: `/v3/projects/624a28101f934a53971eb0d33c073b1a/users/74192572806e43e785f3ff2721601c96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.725031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624a28101f934a53971eb0d33c073b1a, user_id=74192572806e43e785f3ff2721601c96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.725031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:18.817914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3641/7241] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:18 2022] PUT /identity/v3/projects/624a28101f934a53971eb0d33c073b1a/users/74192572806e43e785f3ff2721601c96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:18.821894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.833168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c104-da74-4713-8a02-5cce3e5b97a9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.933697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.935187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.935684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.936143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.937481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.942760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d2931-7393-4d88-a979-c5a2f91586ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:18.969824 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3601/7242] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:18.971927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:18.983159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8904fa-d1b6-445c-ba5e-63040ab0d9e4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:18.993574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:18.993574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:18.993574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:18.993574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] PATH_INFO: `/v3/projects/624a28101f934a53971eb0d33c073b1a/users/74192572806e43e785f3ff2721601c96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:18.994132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=624a28101f934a53971eb0d33c073b1a, user_id=74192572806e43e785f3ff2721601c96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:18.996890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:19.009021 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3642/7243] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:18 2022] PUT /identity/v3/projects/624a28101f934a53971eb0d33c073b1a/users/74192572806e43e785f3ff2721601c96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:19.019514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:19.019987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:19.020093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:19.064414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] MFA Rules not processed for user `74192572806e43e785f3ff2721601c96`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:19.066198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:19.090175 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:19.169175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3602/7244] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:19.184029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:19.186417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:19.303969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76208b5-ca0a-477f-9210-1fca70398ecd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:19.308778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:19.309612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:19.310072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:19.310653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:19.321589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:19.323267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:19.336742 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3643/7245] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:19.551622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:19.567867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df6b87-5b54-4f2b-8ca1-cce0252e5f06 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:19.572438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:19.573858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:19.574329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:19.574973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:19.655961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:19.658477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cb665-875b-4a3c-9693-249ba94ded12 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:19.684247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3603/7246] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:20.696107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:20.820239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896aed9-7e63-4b7a-a287-0ba8d07b3c48 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:20.831559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:20.832532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:20.833002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:20.833620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] PATH_INFO: `/v3/users/33db174bfef34338ac23f82e50840b98` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:20.847537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33db174bfef34338ac23f82e50840b98)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:20.847537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:21.166051 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:21.177224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33db174bfef34338ac23f82e50840b98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:21.249805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33db174bfef34338ac23f82e50840b98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:21.251069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33db174bfef34338ac23f82e50840b98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:21.264058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33db174bfef34338ac23f82e50840b98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:21.271578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33db174bfef34338ac23f82e50840b98'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:21.278201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3644/7247] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:20 2022] DELETE /identity/v3/users/33db174bfef34338ac23f82e50840b98 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:21.287567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:21.287567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:21.287567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:21.308664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:21.309897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:21.388002 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3604/7248] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:21.399059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:21.401163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:21.504363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c0434-3918-41f6-800e-00c1e46f1704 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:21.510595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:21.511605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:21.517244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:21.517244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:21.525485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:21.527281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:21.541632 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3645/7249] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:22.196492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:22.197567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:22.213083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223e5c-894e-4fda-bce0-0343210cc2db None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:22.218696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:22.219868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:22.220144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:22.220433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] PATH_INFO: `/v3/projects/c923371fbda543d38a85bea4a8655690` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:22.221671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c923371fbda543d38a85bea4a8655690)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:22.223572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:22.326363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c923371fbda543d38a85bea4a8655690', 'request_id': 'req-f0f08f7e-88a8-4307-a8c5-682335de4f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.327503 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:22.332644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c923371fbda543d38a85bea4a8655690', 'request_id': 'req-f0f08f7e-88a8-4307-a8c5-682335de4f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.411289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c923371fbda543d38a85bea4a8655690', 'request_id': 'req-f0f08f7e-88a8-4307-a8c5-682335de4f00'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.448565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] The token cache is being invalidate because project c923371fbda543d38a85bea4a8655690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:22.448565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.448565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.448565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3605/7250] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:22 2022] DELETE /identity/v3/projects/c923371fbda543d38a85bea4a8655690 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:22.449065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:22.465946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83a192-b9d6-445d-ba0b-9b1a54b2a657 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:22.562094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:22.562972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:22.563250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:22.563573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] PATH_INFO: `/v3/users/74192572806e43e785f3ff2721601c96` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:22.564753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74192572806e43e785f3ff2721601c96)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:22.566790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:22.743363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74192572806e43e785f3ff2721601c96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.867417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74192572806e43e785f3ff2721601c96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.871855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74192572806e43e785f3ff2721601c96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.874339 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:22.891943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74192572806e43e785f3ff2721601c96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.916414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6950cbc7-c97e-46e3-bca3-cf257608aed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74192572806e43e785f3ff2721601c96'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:22.928076 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3646/7251] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:22 2022] DELETE /identity/v3/users/74192572806e43e785f3ff2721601c96 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:23.458524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:23.460098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:23.478739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f08f7e-88a8-4307-a8c5-682335de4f00 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:23.549469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:23.550101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:23.550387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:23.550662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] PATH_INFO: `/v3/projects/624a28101f934a53971eb0d33c073b1a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:23.551941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624a28101f934a53971eb0d33c073b1a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:23.553871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:23.658654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624a28101f934a53971eb0d33c073b1a', 'request_id': 'req-0cfd4a77-c812-4902-bb83-31497622fee7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:23.664282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624a28101f934a53971eb0d33c073b1a', 'request_id': 'req-0cfd4a77-c812-4902-bb83-31497622fee7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:23.752527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624a28101f934a53971eb0d33c073b1a', 'request_id': 'req-0cfd4a77-c812-4902-bb83-31497622fee7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:23.766558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] The token cache is being invalidate because project 624a28101f934a53971eb0d33c073b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:23.766873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:23.767687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0cfd4a77-c812-4902-bb83-31497622fee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:23.772603 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3606/7252] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:23 2022] DELETE /identity/v3/projects/624a28101f934a53971eb0d33c073b1a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:23.774516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:23.775045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:23.775483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:23.798497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:23.803178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:23.866655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3647/7253] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:23.967273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:23.967552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:23.967817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:23.989540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:23.990735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:23.998925 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3607/7254] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:24.002978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.014888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba12f85-20c4-4a1d-aede-7d1a18c84433 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.019820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.020564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.020847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.021119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.021807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:24.022108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.023693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.040563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3648/7255] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:24.041684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.052039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db155c-5839-49a8-aab1-04cc3db00a62 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.057406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.058027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.058301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.058569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.059261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.061142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.175509 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3608/7256] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:24 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:24.179384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.192478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2ec45-405d-48f5-bf93-80acd9717f8a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.261669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.262277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.262559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.262831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.263468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.265393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.370147 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3649/7257] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:24 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:24.374249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.384520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a04c5-43c4-480e-8429-fe55894c7379 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.389139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.389775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.390051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.390328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.391461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.393038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.405707 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3609/7258] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:24.407851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.418555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e9c01-d1ef-4478-93b2-f4fcd60e45c7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.423508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.424109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.427422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.427422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.427422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.427422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1213-5679-4f1a-a220-6e3c21ee7adf admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.438582 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3650/7259] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:24.442594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.453112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20af22-0e5a-4de5-bda0-b675afdba397 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.461271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.462036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.462257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.462534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] PATH_INFO: `/v3/projects/4358557e712740819503bbebc3aae282/users/53c1133fd1874254b7ae13204f5c1866/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.478065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4358557e712740819503bbebc3aae282, user_id=53c1133fd1874254b7ae13204f5c1866, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.480718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.561565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3610/7260] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:24 2022] PUT /identity/v3/projects/4358557e712740819503bbebc3aae282/users/53c1133fd1874254b7ae13204f5c1866/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:24.569925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.570777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.570777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.599965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] MFA Rules not processed for user `53c1133fd1874254b7ae13204f5c1866`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:24.601464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:24.631531 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:24.666126 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3651/7261] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:48:24.678292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:24.680313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:24.686955 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:24.743387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a943e-7b7f-4056-ae6f-de1e0cc54647 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:24.747103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:24.747732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:24.748008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:24.748277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:24.762776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:24.762776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:24.769018 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3611/7262] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:48:32.072779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:32.074458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:32.170215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:32.172488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:32.191857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebbd47-bef9-4c2a-968d-69ebbc3d775c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:32.204267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:32.205830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:32.206910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:32.208912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:32.214808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:32.254700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:32.257866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:32.280645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3652/7263] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:32.328647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230c99c-6a18-4e23-83cd-3f57ca788637 service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:32.342436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:32.344982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:32.349488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:32.349924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] PATH_INFO: `/v3/users/44d699d4b51d4dc8ac1d8ff5aee36290` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:32.357526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d699d4b51d4dc8ac1d8ff5aee36290)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:32.363124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:32.570513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d699d4b51d4dc8ac1d8ff5aee36290'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:32.571300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d699d4b51d4dc8ac1d8ff5aee36290'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:32.584590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d699d4b51d4dc8ac1d8ff5aee36290'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:32.584590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d699d4b51d4dc8ac1d8ff5aee36290'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:32.661248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d699d4b51d4dc8ac1d8ff5aee36290'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:32.685952 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3612/7264] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:32 2022] DELETE /identity/v3/users/44d699d4b51d4dc8ac1d8ff5aee36290 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:33.036138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:33.074953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf625ef-fe74-4c1d-9b9f-2a5f332214f4 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:33.222782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:33.223803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:33.224289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:33.224786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] PATH_INFO: `/v3/projects/96f00019b8a440b994269dce91d83768` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:33.228283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f00019b8a440b994269dce91d83768)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:33.231700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:33.420353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f00019b8a440b994269dce91d83768', 'request_id': 'req-71e53b99-0836-412f-93c2-005e4b33699e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.497358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f00019b8a440b994269dce91d83768', 'request_id': 'req-71e53b99-0836-412f-93c2-005e4b33699e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.510262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f00019b8a440b994269dce91d83768', 'request_id': 'req-71e53b99-0836-412f-93c2-005e4b33699e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.514660 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:33.532934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] The token cache is being invalidate because project 96f00019b8a440b994269dce91d83768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:33.537850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.537850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.541414 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3653/7265] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:33 2022] DELETE /identity/v3/projects/96f00019b8a440b994269dce91d83768 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:33.543859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:33.545460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:33.562559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69862-bc78-4c56-beac-c082e6b730e8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:33.601665 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:33.634658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:33.635968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:33.636346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:33.636659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] PATH_INFO: `/v3/users/99fab6afb55a4f75a19651edec80938a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:33.638312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fab6afb55a4f75a19651edec80938a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:33.641320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:33.917158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fab6afb55a4f75a19651edec80938a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.918435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fab6afb55a4f75a19651edec80938a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.930784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fab6afb55a4f75a19651edec80938a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:33.943090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fab6afb55a4f75a19651edec80938a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.084095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fab6afb55a4f75a19651edec80938a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.115545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3613/7266] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:33 2022] DELETE /identity/v3/users/99fab6afb55a4f75a19651edec80938a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:34.571838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:34.574230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:34.595250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e53b99-0836-412f-93c2-005e4b33699e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:34.683079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:34.683835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:34.684214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:34.684581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] PATH_INFO: `/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:34.685826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bd9ec0a843467587f7b4ee0b30cf49)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:34.691158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:34.850008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bd9ec0a843467587f7b4ee0b30cf49', 'request_id': 'req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.953357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bd9ec0a843467587f7b4ee0b30cf49', 'request_id': 'req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.963912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bd9ec0a843467587f7b4ee0b30cf49', 'request_id': 'req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.976947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] The token cache is being invalidate because project 65bd9ec0a843467587f7b4ee0b30cf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:34.977238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.978301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:34.979863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3654/7267] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:34 2022] DELETE /identity/v3/projects/65bd9ec0a843467587f7b4ee0b30cf49 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:37.285545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:37.287300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:37.363157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b7afc-29eb-4f03-9069-1e366bb4c3e4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:37.443136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:37.444436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:37.444920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:37.445550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:37.447609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:37.477372 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:37.552643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:37.554405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:37.567281 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3614/7268] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:40.664226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:40.664226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:40.738055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc416b9-08d6-4738-ac5b-7be89a94dcb8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:40.743206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:40.743817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:40.744098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:40.744372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:40.746280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:40.789546 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:40.823067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:40.824506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:40.837052 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3655/7269] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:41.139937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:41.141624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:41.276623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f23e0-dac2-4939-99c1-45a590edff70 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:41.284473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:41.285310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:41.285743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:41.286021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:41.287854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:41.431329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:41.435017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8e05-dafb-474c-920f-3868882ad90d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:41.486726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3615/7270] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:42.618345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:42.621276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:42.646689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9793f75-ed16-4801-ae52-fd106248ec2a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:42.650517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:42.651140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:42.651422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:42.651697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:42.653596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:42.672029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:42.673897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:42.696534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3656/7271] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:45.717300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:45.718792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:45.719296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:45.741744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] MFA Rules not processed for user `cb21ecdda88d49b59e11a30b0f3afc72`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:45.743393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:45.849364 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:45.928988 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3616/7272] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:46.388232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:46.402553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f11c09-ad1b-4072-b02b-fe58e4610675 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:46.413761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:46.414447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:46.423755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:46.423755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:46.423755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:46.452911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:46.452911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:46.469368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3657/7273] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:46.981463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:46.983304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:47.007789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ab125-3a5d-433f-92ac-829d6d0ebae2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:47.018903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:47.020984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:47.021274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:47.022864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] PATH_INFO: `/v3/users/157c0ef579434726810bb3775388b944` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:47.025045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=157c0ef579434726810bb3775388b944)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:47.027914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:47.260733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157c0ef579434726810bb3775388b944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:47.262929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157c0ef579434726810bb3775388b944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:47.319220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157c0ef579434726810bb3775388b944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:47.321756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157c0ef579434726810bb3775388b944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:47.410708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35771bdb-17d3-4d8d-a339-cbc931d66cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157c0ef579434726810bb3775388b944'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:47.444678 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3617/7274] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:46 2022] DELETE /identity/v3/users/157c0ef579434726810bb3775388b944 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:47.772946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:47.784841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdded5d-8bd7-465b-81ec-ee7a7c58cf23 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:47.850747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:47.851378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:47.851651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:47.860381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] PATH_INFO: `/v3/projects/9f9d0d541cc3496ebf8dc71af4254506` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:47.860381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9d0d541cc3496ebf8dc71af4254506)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:47.860381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.013084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9d0d541cc3496ebf8dc71af4254506', 'request_id': 'req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:48.106136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9d0d541cc3496ebf8dc71af4254506', 'request_id': 'req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:48.117082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9d0d541cc3496ebf8dc71af4254506', 'request_id': 'req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:48.133267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] The token cache is being invalidate because project 9f9d0d541cc3496ebf8dc71af4254506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:48.133613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:48.134356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c2142e1-cfd2-4f40-a270-71fd46eaf9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:48.136506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3658/7275] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:47 2022] DELETE /identity/v3/projects/9f9d0d541cc3496ebf8dc71af4254506 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:48.141884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.143013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.143549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.178658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:48.180191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:48.266182 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3618/7276] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:48.278481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.279997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.280502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.336603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:48.338146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:48.349751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3659/7277] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:48.352803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.367408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6bf94-97f4-4c72-b335-71b76b84c50d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.372746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.373904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.375087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.375562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.376403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:48.377023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.379376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.393907 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3619/7278] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:48.398451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.422471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9cc7d-f2b9-4d01-8f18-6d57516f764a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.436407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.436407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:48.444972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.446746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.447567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.448840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.451254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.468073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.496444 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:48.509619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b09392-fd87-492e-abd0-60587cfdb958 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.513455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.514260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.514665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.515034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.517160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:48.531921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.533430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.544436 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3620/7279] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:48.576743 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3660/7280] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:48 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:48.581255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.593220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58730ad3-f814-4256-9b11-8fb89f39053b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.656270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.656968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.657321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.657679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.658372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.660390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.780939 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3621/7281] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:48 2022] POST /identity/v3/users => generated 280 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:48:48.785251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.797769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83c2aa-1f02-42ea-91fb-5f04015a71cd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.803307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.803929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.804426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.804702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.805373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.807170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.808919 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:48.819948 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3661/7282] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:48:48.825149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.837303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496925d-7478-4dbf-a75f-b013c2fd0bbb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.849442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.849442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.849442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.849442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.850440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.850440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeba31d-bbfb-42ce-a163-415ddd87cda6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:48.862308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3622/7283] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:48.866323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:48.880887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2560d-94aa-40aa-9fcd-ae837df21975 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:48.895887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:48.895887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:48.895887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:48.895887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] PATH_INFO: `/v3/projects/beb94281f1914279aa720f8f1d962a43/users/525cb79e2760449ca54659f827206daf/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:48.910396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb94281f1914279aa720f8f1d962a43, user_id=525cb79e2760449ca54659f827206daf, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:48.913836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:49.010231 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3662/7284] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:48 2022] PUT /identity/v3/projects/beb94281f1914279aa720f8f1d962a43/users/525cb79e2760449ca54659f827206daf/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:49.025573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a32d83-53d2-4d08-93b3-f47cd207f246 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:49.026241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a32d83-53d2-4d08-93b3-f47cd207f246 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:49.026795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a32d83-53d2-4d08-93b3-f47cd207f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:49.086110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c5a32d83-53d2-4d08-93b3-f47cd207f246 None None] MFA Rules not processed for user `525cb79e2760449ca54659f827206daf`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:49.087716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c5a32d83-53d2-4d08-93b3-f47cd207f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:49.221551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3623/7285] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:49.264527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:49.386969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c93dd2-46bf-40b2-bdd2-505e56778df4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:49.393613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:49.394559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:49.395056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:49.395538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] PATH_INFO: `/v3/users/525cb79e2760449ca54659f827206daf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:49.397055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525cb79e2760449ca54659f827206daf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:49.400248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:49.607377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525cb79e2760449ca54659f827206daf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:49.689366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525cb79e2760449ca54659f827206daf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:49.690011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525cb79e2760449ca54659f827206daf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:49.707586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525cb79e2760449ca54659f827206daf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:49.715787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525cb79e2760449ca54659f827206daf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:49.730554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:49.730844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:49.731127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:49.734578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3663/7286] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:48:49 2022] DELETE /identity/v3/users/525cb79e2760449ca54659f827206daf => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:49.755495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:49.756381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:49.857923 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:49.910058 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3624/7287] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:49.920967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:49.922484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:50.025831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7106-4e1b-460f-b798-2f3cf092fe06 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:50.029766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:50.030400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:50.030679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:50.031217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:50.037985 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:50.043126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:50.044748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:50.057626 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3664/7288] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:51.912148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:51.914053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:51.955868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da633-3d7c-4f23-b731-f7c6d133435b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:51.972671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:51.973814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:51.973966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:51.974419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:51.974419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] PATH_INFO: `/v3/projects/beb94281f1914279aa720f8f1d962a43` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:51.978507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb94281f1914279aa720f8f1d962a43)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:51.982550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:51.993196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa53ad5-2d3d-4b5f-b0ab-88e145237911 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:52.009817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:52.010475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:52.017854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:52.018322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:52.026343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:52.222183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:52.223811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22f80b-cd83-475c-b7ec-b0f1adf54560 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:52.256463 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3665/7289] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:48:52.282125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb94281f1914279aa720f8f1d962a43', 'request_id': 'req-24cb7dbe-4791-4f90-9575-529ff88f72fa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:52.306499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb94281f1914279aa720f8f1d962a43', 'request_id': 'req-24cb7dbe-4791-4f90-9575-529ff88f72fa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:52.445839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb94281f1914279aa720f8f1d962a43', 'request_id': 'req-24cb7dbe-4791-4f90-9575-529ff88f72fa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:52.473310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] The token cache is being invalidate because project beb94281f1914279aa720f8f1d962a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:48:52.473695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:52.476562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-24cb7dbe-4791-4f90-9575-529ff88f72fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:48:52.480125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3625/7290] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:48:51 2022] DELETE /identity/v3/projects/beb94281f1914279aa720f8f1d962a43 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:48:52.485879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:52.486289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:52.486634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:52.513848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:52.515238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:52.655648 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3666/7291] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:52.662540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:52.662873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:52.663160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:52.696944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:52.698750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:52.711971 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3626/7292] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:52.716778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:52.732166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8dae-86fc-45f3-97c1-0e72219b0afe None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:52.741177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:52.741851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:52.742100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:52.742369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:52.743187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:48:52.743494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:52.745095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:52.777747 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3667/7293] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:48:52.782562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:52.799965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955bd9c-bb33-41ad-93aa-173e37edd500 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:52.815135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:52.816158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:52.817464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:52.818048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:52.818944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:52.824797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:52.951730 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3627/7294] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:48:52 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:52.957824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:52.976657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faeba42-0008-431b-8a4a-35aa32c876c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:53.121281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:53.124210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:53.124667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:53.125129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:53.126657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:53.135170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:53.165949 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:48:53.295621 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3668/7295] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:48:52 2022] POST /identity/v3/users => generated 284 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:48:53.300421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:53.324091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ebaba-ef82-4e32-b3b9-1680cd3a2ce1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:53.348044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:53.348674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:53.351599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:53.352332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:53.353241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:53.356171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:53.384177 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3628/7296] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:53.390281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:53.403102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed8b6-bc35-4d3b-b109-11613d77fa15 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:53.412433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:53.413381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:53.414183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:53.414467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:53.415347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:53.419185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79925b48-727b-48f6-9702-792d228b2e01 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:53.432549 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3669/7297] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:48:53.436593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:53.460966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacbac-6750-4a98-8207-b6ee1250c58a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:53.468107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:53.470025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:53.470266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:53.471077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] PATH_INFO: `/v3/projects/53cfe66b10ea4cff9f2a981142ef9290/users/3b1089acc7a741a48ef4137f60be7eef/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:53.496702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cfe66b10ea4cff9f2a981142ef9290, user_id=3b1089acc7a741a48ef4137f60be7eef, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:53.499942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:53.645377 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3629/7298] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:48:53 2022] PUT /identity/v3/projects/53cfe66b10ea4cff9f2a981142ef9290/users/3b1089acc7a741a48ef4137f60be7eef/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:48:53.657548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:53.657863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:53.658099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:53.742593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] MFA Rules not processed for user `3b1089acc7a741a48ef4137f60be7eef`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:48:53.743839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:53.875825 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3670/7299] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:48:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:48:54.129107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:48:54.133104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:48:54.231168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e087d6d-879a-4391-9808-fe095d69126e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:48:54.236676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:48:54.237304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:48:54.237614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:48:54.237889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:48:54.247874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:48:54.250150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:48:54.283756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3630/7300] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:48:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:01.481138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:01.483581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:01.686700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409fba6-f178-4d81-b0e6-7d78748e10bf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:01.714105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:01.714758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:01.715043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:01.715312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] PATH_INFO: `/v3/users/759025c4133f4074ba59beb1a08c7a21` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:01.719871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759025c4133f4074ba59beb1a08c7a21)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:01.721906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:02.002630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759025c4133f4074ba59beb1a08c7a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.091288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759025c4133f4074ba59beb1a08c7a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.092183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759025c4133f4074ba59beb1a08c7a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.113304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759025c4133f4074ba59beb1a08c7a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.130055 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:02.140309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759025c4133f4074ba59beb1a08c7a21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.156115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3671/7301] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:01 2022] DELETE /identity/v3/users/759025c4133f4074ba59beb1a08c7a21 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:02.572064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:02.586716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dcab2-6650-42f3-bdfe-d399fe189e36 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:02.611277 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:02.707370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:02.708033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:02.708314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:02.708590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] PATH_INFO: `/v3/projects/8d68930ed61745eea8adfda72f3d139f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:02.709875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d68930ed61745eea8adfda72f3d139f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:02.713014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:02.937513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d68930ed61745eea8adfda72f3d139f', 'request_id': 'req-b5510f91-cfdc-4fff-ad32-73662fb99f47'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:02.957930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d68930ed61745eea8adfda72f3d139f', 'request_id': 'req-b5510f91-cfdc-4fff-ad32-73662fb99f47'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.036933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d68930ed61745eea8adfda72f3d139f', 'request_id': 'req-b5510f91-cfdc-4fff-ad32-73662fb99f47'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.063512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] The token cache is being invalidate because project 8d68930ed61745eea8adfda72f3d139f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:03.065757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.066674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.070091 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3631/7302] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:02 2022] DELETE /identity/v3/projects/8d68930ed61745eea8adfda72f3d139f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:03.075932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:03.078038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:03.109873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a6390-1bd1-4046-b218-8b1460d49297 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:03.258019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:03.258913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:03.259368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:03.259823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] PATH_INFO: `/v3/users/b518f0cfeb024924b4181145412d3703` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:03.261149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b518f0cfeb024924b4181145412d3703)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:03.266286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:03.525275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b518f0cfeb024924b4181145412d3703'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.672018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b518f0cfeb024924b4181145412d3703'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.672700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b518f0cfeb024924b4181145412d3703'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.688866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b518f0cfeb024924b4181145412d3703'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.697168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b518f0cfeb024924b4181145412d3703'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:03.709861 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3672/7303] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:03 2022] DELETE /identity/v3/users/b518f0cfeb024924b4181145412d3703 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:04.045603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:04.047460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:04.065700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5510f91-cfdc-4fff-ad32-73662fb99f47 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:04.149117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:04.149957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:04.150236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:04.150509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] PATH_INFO: `/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:04.151953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0c005a5fbf4b48a378f2b0948b1e49)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:04.156701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:04.307883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0c005a5fbf4b48a378f2b0948b1e49', 'request_id': 'req-4f54a623-f6c4-4545-b154-e4aebf30eb81'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:04.309458 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:04.316950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0c005a5fbf4b48a378f2b0948b1e49', 'request_id': 'req-4f54a623-f6c4-4545-b154-e4aebf30eb81'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:04.410874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0c005a5fbf4b48a378f2b0948b1e49', 'request_id': 'req-4f54a623-f6c4-4545-b154-e4aebf30eb81'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:04.428964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] The token cache is being invalidate because project 0b0c005a5fbf4b48a378f2b0948b1e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:04.429636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:04.430599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4f54a623-f6c4-4545-b154-e4aebf30eb81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:04.445444 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3632/7304] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:04 2022] DELETE /identity/v3/projects/0b0c005a5fbf4b48a378f2b0948b1e49 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:05.453849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:05.455893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:05.484369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6c21-0eb9-4773-8f6b-196f8f028896 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:05.559853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:05.561437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:05.561895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:05.562369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] PATH_INFO: `/v3/users/53c1133fd1874254b7ae13204f5c1866` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:05.564019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c1133fd1874254b7ae13204f5c1866)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:05.566779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:05.584400 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:05.787793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c1133fd1874254b7ae13204f5c1866'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:05.883318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c1133fd1874254b7ae13204f5c1866'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:05.885837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c1133fd1874254b7ae13204f5c1866'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:05.916526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c1133fd1874254b7ae13204f5c1866'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:05.933240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c1133fd1874254b7ae13204f5c1866'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:05.967445 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3673/7305] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:05 2022] DELETE /identity/v3/users/53c1133fd1874254b7ae13204f5c1866 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:05.974237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:05.975068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:05.975068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:06.005905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:06.007130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:06.139581 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3633/7306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:06.150666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:06.152180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:06.240263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449c63e-4cfd-4128-a4bb-8edd9afe7549 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:06.245956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:06.247033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:06.247314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:06.247607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:06.258709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:06.260427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37172626-ef58-4ea4-b63c-80bed83e893a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:06.273374 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3674/7307] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:07.086643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:07.088250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:07.111792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8543d1d-98e7-47b0-98bf-08938e502688 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:07.125590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:07.126539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:07.126928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:07.127304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] PATH_INFO: `/v3/projects/4358557e712740819503bbebc3aae282` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:07.128894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4358557e712740819503bbebc3aae282)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:07.130978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:07.258272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4358557e712740819503bbebc3aae282', 'request_id': 'req-73f5ae55-af76-4c44-a647-b57257d74d19'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:07.266503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4358557e712740819503bbebc3aae282', 'request_id': 'req-73f5ae55-af76-4c44-a647-b57257d74d19'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:07.351802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4358557e712740819503bbebc3aae282', 'request_id': 'req-73f5ae55-af76-4c44-a647-b57257d74d19'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:07.368141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] The token cache is being invalidate because project 4358557e712740819503bbebc3aae282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:07.368825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:07.369962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-73f5ae55-af76-4c44-a647-b57257d74d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:07.373101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3634/7308] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:07 2022] DELETE /identity/v3/projects/4358557e712740819503bbebc3aae282 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:07.377607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:07.378097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:07.378419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:07.422128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:07.425245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:07.513372 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3675/7309] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:07.522324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:07.522804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:07.523151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:07.554643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:07.564970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:07.574520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3635/7310] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:07.578202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:07.593465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffc52c-6c7c-44f6-a357-2488216055cf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:07.596660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:07.597484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:07.597861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:07.598306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:07.599069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:07.599732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:07.601518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:07.621655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3676/7311] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:07.626114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:07.642423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a0904-8a19-4cf1-89ef-955b05505075 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:07.661988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:07.667536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:07.667536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:07.667536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:07.667536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:07.667536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:07.831122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3636/7312] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:07 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:07.835277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:07.847586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511be5e-2b8e-47ee-a8d3-d319b555b8d7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:07.918090 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:08.009564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:08.011087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.012429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.012878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.015967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:08.020387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:08.157236 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3677/7313] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:07 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:08.162002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:08.184191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d8da-143e-45a1-8e5e-b81ae573c77f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:08.197396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:08.198490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.198992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.199438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.200308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:08.203452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:08.216056 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3637/7314] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:08.220263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:08.235633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9fb9-ea76-4d59-aab1-257e521ebc93 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:08.250084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:08.250710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.250988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.251265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.251914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:08.253591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492f36e-04fa-4d10-90a1-5b275a5caa06 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:08.275046 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3678/7315] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:08.280998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:08.302436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9b81f-8b11-4c46-9c2c-a7f72b487e44 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:08.312934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:08.315339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.317611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.318954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] PATH_INFO: `/v3/projects/4893597530f44424afb924ef222c54bc/users/edf889fe45b3488c82d32578dd1e6e3b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.356828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4893597530f44424afb924ef222c54bc, user_id=edf889fe45b3488c82d32578dd1e6e3b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:08.362361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:08.443848 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:08.450841 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3638/7316] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:08 2022] PUT /identity/v3/projects/4893597530f44424afb924ef222c54bc/users/edf889fe45b3488c82d32578dd1e6e3b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:08.461871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b6-3d16-4b5a-be89-f5bcc72e8dc5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.462982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b6-3d16-4b5a-be89-f5bcc72e8dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.463572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b6-3d16-4b5a-be89-f5bcc72e8dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.543318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3a2998b6-3d16-4b5a-be89-f5bcc72e8dc5 None None] MFA Rules not processed for user `edf889fe45b3488c82d32578dd1e6e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:08.545379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a2998b6-3d16-4b5a-be89-f5bcc72e8dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:08.725127 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3679/7317] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:08.728191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:08.802843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.803445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.803901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.812921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe762c1-a2ad-48d7-8813-0c98ace02e46 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:08.818577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:08.819180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:08.819483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:08.819751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:08.820379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:08.822316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:08.834819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] MFA Rules not processed for user `dcb021152c684983b31e5db439518921`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:08.836694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:08.916085 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3680/7318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:08.966254 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3639/7319] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:08 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:08.969477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:08.985886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e22ac6-69a7-444d-bbef-ebab6c649843 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:09.036436 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:09.069682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:09.070301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.070587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.070984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.071627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:09.073811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:09.180219 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3681/7320] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:08 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:09.183698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:09.197214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59654-e1cf-45f2-aa36-8f180a19533b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:09.203275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:09.204157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.210891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.211536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.212447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:09.214331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:09.234806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3640/7321] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:09.238845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:09.251015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d29c3-1396-40da-a545-dd13c6450a8d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:09.256084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:09.256740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.257024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.257293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.258340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:09.259852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c67b8-01a3-4894-b7be-59ffc10dfc34 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:09.274262 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3682/7322] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:09.277655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:09.287526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb3db-0580-42a6-a857-91b85e46cafe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:09.293655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:09.295300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.295485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.295911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] PATH_INFO: `/v3/projects/31eb97f694a5453193e6a1938253cd17/users/b6c451df8dc04533b48348a70ec6488a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.322376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31eb97f694a5453193e6a1938253cd17, user_id=b6c451df8dc04533b48348a70ec6488a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:09.328971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:09.415290 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3641/7323] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:09 2022] PUT /identity/v3/projects/31eb97f694a5453193e6a1938253cd17/users/b6c451df8dc04533b48348a70ec6488a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:09.425850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.426132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.426413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.456768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] MFA Rules not processed for user `b6c451df8dc04533b48348a70ec6488a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:09.458859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:09.576791 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3683/7324] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:09.582529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:09.744589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823d51-c75b-457f-8f84-4a74f594169a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:09.750840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:09.752102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:09.752552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:09.753377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:09.754428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:09.756720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:09.858039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3642/7325] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:09 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:09.862109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:09.888220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4739680-7790-4f94-ac8b-c013ea006a4c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.047607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.048321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.048715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.049222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.049976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.051990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.151214 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3684/7326] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:09 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:10.151959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:10.168362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b6aa-2894-4230-a65b-5910e222a62d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.184120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.184811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.185006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.185301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.186467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.188059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.205369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3643/7327] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:10.209143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:10.219989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872aabad-fec9-4843-8809-57c5a517d4c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.226401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.230940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.230940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.230940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] PATH_INFO: `/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05/users/3ad34c963b61426985039f7963a25cc8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.244577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b0cbe3019c4043ab57d7d30aee9f05, user_id=3ad34c963b61426985039f7963a25cc8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.247311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.331283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3685/7328] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:10 2022] PUT /identity/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05/users/3ad34c963b61426985039f7963a25cc8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:10.335337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:10.356173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6c035-5568-48a1-9a5d-a4e10b3b2936 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.384925 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:10.459834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.461354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.462096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.462568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.464024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.469816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a093b3-5d08-458b-bcc3-b1b47713c1b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.488718 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3644/7329] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:10.494946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:10.516672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c561b-8a37-450a-ad12-b91018eedbfb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.522429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.523547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.523988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.524268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] PATH_INFO: `/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05/users/3ad34c963b61426985039f7963a25cc8/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.527584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b0cbe3019c4043ab57d7d30aee9f05, user_id=3ad34c963b61426985039f7963a25cc8, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.532088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.537214 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:10.551421 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3686/7330] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:10 2022] PUT /identity/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05/users/3ad34c963b61426985039f7963a25cc8/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:10.566335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.566613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.567207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.611160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] MFA Rules not processed for user `3ad34c963b61426985039f7963a25cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:10.612896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:10.712859 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3645/7331] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:10.726458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:10.728340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:10.833021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b9cb7-9931-47a1-81fb-349bdd623395 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:10.838404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:10.841569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:10.841569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:10.841569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:10.919073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:10.921270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:10.939287 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3687/7332] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:14.383820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:14.401647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:14.472391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:14.490529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87cf9-85af-4387-9404-d11e1bb5f196 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:14.499826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f74a8-395b-4f11-8d2c-20cd10951c36 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:14.500367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:14.502976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:14.502976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:14.502976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:14.524050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:14.528259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:14.532053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:14.534369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:14.540038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:14.575993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:14.584012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:14.620488 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3646/7333] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:14.638162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:14.641800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:14.658246 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3688/7334] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:16.532136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:16.551203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690b62c-d67d-4ebc-944a-b451424601b4 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:16.554210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:16.555093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:16.555438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:16.555645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:16.568920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:16.571240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2793d-23ea-4933-bf0f-b2a4882ee4f0 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:16.584885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3647/7335] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:16.831629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:16.833053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:16.967469 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:17.002325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf91569-8ac1-4716-90b5-c94267ac1c5c service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:17.008102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:17.009135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:17.009635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:17.010105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] PATH_INFO: `/v3/users/3b1089acc7a741a48ef4137f60be7eef` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:17.011529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1089acc7a741a48ef4137f60be7eef)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:17.013883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:17.238261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1089acc7a741a48ef4137f60be7eef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:17.299727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1089acc7a741a48ef4137f60be7eef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:17.300406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1089acc7a741a48ef4137f60be7eef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:17.322176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1089acc7a741a48ef4137f60be7eef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:17.334652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1089acc7a741a48ef4137f60be7eef'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:17.346771 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3689/7336] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:16 2022] DELETE /identity/v3/users/3b1089acc7a741a48ef4137f60be7eef => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:17.351132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:17.351583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:17.364517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:17.403114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:17.403114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:17.450090 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:17.511272 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3648/7337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:17.522815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:17.524352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:17.600714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f480649-8873-4b10-a5dd-018b169511a8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:17.604591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:17.605351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:17.605730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:17.606099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:17.616047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:17.618190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06923c1a-307b-4b90-ae1a-e9bd2fafa6a1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:17.629579 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3690/7338] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:18.249554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:18.251169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:18.297414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e4ca-38b0-4589-adf3-132112ed56ed None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:18.307239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:18.307239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:18.307239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:18.307531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] PATH_INFO: `/v3/projects/53cfe66b10ea4cff9f2a981142ef9290` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:18.309129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cfe66b10ea4cff9f2a981142ef9290)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:18.311740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:18.485546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cfe66b10ea4cff9f2a981142ef9290', 'request_id': 'req-5782e1c1-b401-4839-9ca1-76ae7530e93b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:18.491469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cfe66b10ea4cff9f2a981142ef9290', 'request_id': 'req-5782e1c1-b401-4839-9ca1-76ae7530e93b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:18.545661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cfe66b10ea4cff9f2a981142ef9290', 'request_id': 'req-5782e1c1-b401-4839-9ca1-76ae7530e93b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:18.567496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] The token cache is being invalidate because project 53cfe66b10ea4cff9f2a981142ef9290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:18.569276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:18.571423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5782e1c1-b401-4839-9ca1-76ae7530e93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:18.574283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3649/7339] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:18 2022] DELETE /identity/v3/projects/53cfe66b10ea4cff9f2a981142ef9290 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:18.580362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:18.580848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:18.580996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:18.608614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:18.609809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:18.717029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3691/7340] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:18.724851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:18.726046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:18.726438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:18.769544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:18.771114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:18.781799 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3650/7341] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:18.785760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:18.800297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182bd5-f476-413e-b52b-8078fc1c9f4f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:18.807009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:18.807945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:18.808701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:18.809191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:18.810595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:18.811753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:18.813503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:18.821314 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:18.829720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3692/7342] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:18.833217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:18.844983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e5d0-ef11-4bfb-b972-716a59bdd71c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:18.850496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:18.851109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:18.851390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:18.851662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:18.852622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:18.857677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:18.944167 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3651/7343] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:18 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:18.948424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:18.961361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60338f8-6c22-4229-b8fa-551122979580 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.064807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.065543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.066094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.066428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.067154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.069574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.164072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3693/7344] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:18 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:19.170447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:19.186429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa3a6-27be-4d3a-a3d9-8096a9d02a9e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.192349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.193696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.194198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.194671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.195681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.198851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.220076 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3652/7345] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:19.223349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:19.235524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99cb65-4341-4c21-980c-6a0c7201c01c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.241650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.245291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.245922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.246421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.247318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.250263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2c50-1b49-46d4-86df-1a6bfcc85ca2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.266104 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3694/7346] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:19.270368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:19.286198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4286f11-cac9-40e0-b442-68947aa3ed32 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.302705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.303673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.303953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.304226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] PATH_INFO: `/v3/projects/592c32ea5d6145548d89940e4de4230b/users/742a373f2c0a47ccb37b4deb0f594dc9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.339296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592c32ea5d6145548d89940e4de4230b, user_id=742a373f2c0a47ccb37b4deb0f594dc9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.343559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.425379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3653/7347] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:19 2022] PUT /identity/v3/projects/592c32ea5d6145548d89940e4de4230b/users/742a373f2c0a47ccb37b4deb0f594dc9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:19.434224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.435517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.436426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.484061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] MFA Rules not processed for user `742a373f2c0a47ccb37b4deb0f594dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:19.486485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:19.593778 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3695/7348] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:19.598095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:19.680768 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:19.691906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913a5b4-495f-4668-9caf-bad8faaf5116 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.697236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.697998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.698587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.698898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.699588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.702752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.807439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3654/7349] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:19 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:19.808859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:19.823996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400971-8d1a-440a-8b62-313575772a5b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:19.965159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:19.965893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:19.966317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:19.966649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:19.967349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:19.969496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:19.985693 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:20.200540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3696/7350] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:19 2022] POST /identity/v3/users => generated 295 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:20.204671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.217717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617c9f-fcd4-4b26-b0b4-b8ae49dd85f5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:20.222547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:20.223168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.223448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.223720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.224609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:20.226230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:20.242474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.243989 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3655/7351] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:20.254509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c7e6b-dc28-4eb9-9418-1379d40b98da admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:20.263157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:20.263827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.264102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.264370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] PATH_INFO: `/v3/projects/68e716cbb0fd49888171d13d6429ab2c/users/dba6a96b6a424d0184b3f6c50013266a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.296780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e716cbb0fd49888171d13d6429ab2c, user_id=dba6a96b6a424d0184b3f6c50013266a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:20.299301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:20.359036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3697/7352] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:20 2022] PUT /identity/v3/projects/68e716cbb0fd49888171d13d6429ab2c/users/dba6a96b6a424d0184b3f6c50013266a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:20.363385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.381531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13870b1-0957-4c28-898e-9d5e214b32a4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:20.462925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:20.463550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.463837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.464117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.464753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:20.467072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b94156-e84f-4cc4-b4af-6917b7bc68a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:20.483045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3656/7353] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:20.483519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.849271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac62a-04a9-4d30-9021-742ff381f737 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:20.849271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:20.849271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.849271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.852525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] PATH_INFO: `/v3/projects/68e716cbb0fd49888171d13d6429ab2c/users/dba6a96b6a424d0184b3f6c50013266a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.852525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e716cbb0fd49888171d13d6429ab2c, user_id=dba6a96b6a424d0184b3f6c50013266a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:20.852525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:20.852525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3698/7354] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:20 2022] PUT /identity/v3/projects/68e716cbb0fd49888171d13d6429ab2c/users/dba6a96b6a424d0184b3f6c50013266a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] MFA Rules not processed for user `dba6a96b6a424d0184b3f6c50013266a`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:20.853209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3657/7355] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:20.853987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.853987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834f5-1733-4b85-9395-e6537ff9aff1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:20.853987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:20.854343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:20.854343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:20.854343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:20.854343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:20.854343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:20.979376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3699/7356] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:49:20 2022] POST /identity/v3/domains => generated 245 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:20.983748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:20.998313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebed043-6528-4306-83b1-5fc038cd6f49 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:21.099600 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:21.119285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:21.119285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.119285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.120229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.120229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:21.120752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:21.295325 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3658/7357] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:20 2022] POST /identity/v3/projects => generated 408 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:21.299594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:21.311240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f1e2b-5c55-4df3-b421-0fe5e3e40f52 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:21.467388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:21.468208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.472204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.472204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.472204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:21.472204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:21.569098 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3700/7358] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:21 2022] POST /identity/v3/users => generated 348 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:21.573326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:21.587656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c14262-c54f-4614-874e-0ef61a77f3bd tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:21.592178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:21.592793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.593105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.593416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.594062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:21.595763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212989d-f5f4-4c67-ad5c-ca9208f81717 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:21.606876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3659/7359] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:21.610718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:21.622107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4923702-76d7-42de-b0b5-9a528ef35b8b tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:21.629454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:21.630087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.630365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.630641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/projects/764d8686596c48de81190d48d28cb56f/users/05098d88062a42b1976fc72ac350fa69/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.649378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:create_grant(project_id=764d8686596c48de81190d48d28cb56f, user_id=05098d88062a42b1976fc72ac350fa69, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:21.652373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63553bb0-4a3b-49d4-b4d6-934ca2a8fe43 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:21.712864 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3701/7360] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:21 2022] PUT /identity/v3/projects/764d8686596c48de81190d48d28cb56f/users/05098d88062a42b1976fc72ac350fa69/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:21.717674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.718069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.718456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.841705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] MFA Rules not processed for user `05098d88062a42b1976fc72ac350fa69`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:21.843184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:21.862024 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3660/7361] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:21.871908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.873115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.873115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.897636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] MFA Rules not processed for user `05098d88062a42b1976fc72ac350fa69`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:21.898947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:21.907051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3702/7362] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:21.911339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:21.922013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f64c-7c15-45a4-925c-f1d39d3785d6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:21.926835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05098d88062a42b1976fc72ac350fa69', 'user_domain_id': '703c6567dd704407aca7bc809f4aac40', 'system_scope': None, 'project_id': '764d8686596c48de81190d48d28cb56f', 'project_domain_id': '703c6567dd704407aca7bc809f4aac40', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:21.927437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:21.927714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:21.930159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:21.937524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:21.940113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:21.952599 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3661/7363] 10.222.0.13 () {56 vars in 1284 bytes} [Sun Oct 30 01:49:21 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:21.957090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:22.030032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd8986-e958-43b0-bd95-62aaa687c550 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:22.036949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:22.038512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:22.039134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:22.039472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/users/05098d88062a42b1976fc72ac350fa69` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:22.041057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:delete_user(user_id=05098d88062a42b1976fc72ac350fa69)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:22.043107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:22.050150 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:22.255697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05098d88062a42b1976fc72ac350fa69'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:22.339844 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05098d88062a42b1976fc72ac350fa69'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:22.341196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05098d88062a42b1976fc72ac350fa69'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:22.380148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05098d88062a42b1976fc72ac350fa69'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:22.416414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05098d88062a42b1976fc72ac350fa69'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:22.439377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3703/7364] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:21 2022] DELETE /identity/v3/users/05098d88062a42b1976fc72ac350fa69 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:22.442454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:22.459817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae0598-072e-45e2-b7e0-be34f6a031d5 tempest-test_project-876179034 tempest-user-1379752609] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:22.616183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:22.617301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:22.618128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:22.618578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/projects/764d8686596c48de81190d48d28cb56f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:22.620696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=764d8686596c48de81190d48d28cb56f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:22.622773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:22.637150 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:23.182018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764d8686596c48de81190d48d28cb56f', 'request_id': 'req-478b8af4-70da-4cab-b5e8-c7aa945524f3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.202302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764d8686596c48de81190d48d28cb56f', 'request_id': 'req-478b8af4-70da-4cab-b5e8-c7aa945524f3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.331266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764d8686596c48de81190d48d28cb56f', 'request_id': 'req-478b8af4-70da-4cab-b5e8-c7aa945524f3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.364895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] The token cache is being invalidate because project 764d8686596c48de81190d48d28cb56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:23.365499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.366208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.369705 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3662/7365] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:22 2022] DELETE /identity/v3/projects/764d8686596c48de81190d48d28cb56f => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:23.375164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:23.376795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:23.393409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4de6c-e490-48fa-8ed5-354d8e3c7c59 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:23.479473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:23.480418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:23.480865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:23.489257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/domains/703c6567dd704407aca7bc809f4aac40` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:23.489257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=703c6567dd704407aca7bc809f4aac40)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:23.489257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:23.509523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.510625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.605524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.606726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.613504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:23.615305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:23.625316 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3704/7366] 10.222.0.13 () {60 vars in 1249 bytes} [Sun Oct 30 01:49:23 2022] PATCH /identity/v3/domains/703c6567dd704407aca7bc809f4aac40 => generated 246 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:23.635289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8af4-70da-4cab-b5e8-c7aa945524f3 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:23.732027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dba6a96b6a424d0184b3f6c50013266a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68e716cbb0fd49888171d13d6429ab2c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:23.733317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:23.733633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:23.733930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] PATH_INFO: `/v3/domains/703c6567dd704407aca7bc809f4aac40` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:23.750201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=703c6567dd704407aca7bc809f4aac40)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:23.752365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:23.779427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.786760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '703c6567dd704407aca7bc809f4aac40'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.949102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:23.957879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.117218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.127170 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:24.132249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] The token cache is being invalidate because project 703c6567dd704407aca7bc809f4aac40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:24.132548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.133227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.142702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.148512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.148656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5cb7640b-5da2-4828-b42f-eb602bd31372 tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '703c6567dd704407aca7bc809f4aac40', 'request_id': 'req-5cb7640b-5da2-4828-b42f-eb602bd31372'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.158930 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3663/7367] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:49:23 2022] DELETE /identity/v3/domains/703c6567dd704407aca7bc809f4aac40 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:24.160714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:24.162280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:24.259517 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:24.300581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e7a8e-09c5-4c94-81fc-33e8321c462f tempest-TestDefaultProjectId-1074964364 tempest-TestDefaultProjectId-1074964364-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:24.374077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:24.374648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:24.374920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:24.375189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] PATH_INFO: `/v3/users/742a373f2c0a47ccb37b4deb0f594dc9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:24.376473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742a373f2c0a47ccb37b4deb0f594dc9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:24.379402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:24.592988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742a373f2c0a47ccb37b4deb0f594dc9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.659343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742a373f2c0a47ccb37b4deb0f594dc9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.660025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742a373f2c0a47ccb37b4deb0f594dc9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.678431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742a373f2c0a47ccb37b4deb0f594dc9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.688272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742a373f2c0a47ccb37b4deb0f594dc9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:24.710933 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3705/7368] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:24 2022] DELETE /identity/v3/users/742a373f2c0a47ccb37b4deb0f594dc9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:24.713251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:24.713731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:24.713810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:24.752046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:24.755079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:24.858775 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3664/7369] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:24.868524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:24.870179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:24.962278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a51c8-7b8a-4c24-9dde-ef4649b55ee2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:24.966525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:24.967136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:24.967407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:24.967672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:24.978410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:24.980161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:25.008376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3706/7370] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:25.657500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:25.659341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:25.680122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2f7a8-5f41-4f3e-907e-9d4812a5e2e6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:25.702309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:25.704468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:25.704820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:25.705172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] PATH_INFO: `/v3/projects/592c32ea5d6145548d89940e4de4230b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:25.707379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=592c32ea5d6145548d89940e4de4230b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:25.709308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:25.845528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592c32ea5d6145548d89940e4de4230b', 'request_id': 'req-1c29eca4-e3c2-4b32-883d-ddab11289bbd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:25.853464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592c32ea5d6145548d89940e4de4230b', 'request_id': 'req-1c29eca4-e3c2-4b32-883d-ddab11289bbd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:25.945156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592c32ea5d6145548d89940e4de4230b', 'request_id': 'req-1c29eca4-e3c2-4b32-883d-ddab11289bbd'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:25.959816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] The token cache is being invalidate because project 592c32ea5d6145548d89940e4de4230b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:25.960098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:25.962075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:25.964574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3665/7371] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:25 2022] DELETE /identity/v3/projects/592c32ea5d6145548d89940e4de4230b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:25.968340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:25.979507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877253-4e01-4cff-9996-2e69b28fa556 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:25.996425 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:26.069841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:26.071103 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:26.072249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:26.073494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] PATH_INFO: `/v3/users/dba6a96b6a424d0184b3f6c50013266a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:26.075811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba6a96b6a424d0184b3f6c50013266a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:26.077969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:26.349885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba6a96b6a424d0184b3f6c50013266a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:26.414379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba6a96b6a424d0184b3f6c50013266a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:26.417533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba6a96b6a424d0184b3f6c50013266a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:26.445561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba6a96b6a424d0184b3f6c50013266a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:26.461270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba6a96b6a424d0184b3f6c50013266a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:26.483265 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3707/7372] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:25 2022] DELETE /identity/v3/users/dba6a96b6a424d0184b3f6c50013266a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:27.699147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:27.702667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:27.746089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29eca4-e3c2-4b32-883d-ddab11289bbd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:27.843429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:27.844072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:27.844352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:27.844750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] PATH_INFO: `/v3/users/edf889fe45b3488c82d32578dd1e6e3b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:27.845916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf889fe45b3488c82d32578dd1e6e3b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:27.847851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:27.850751 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:28.158884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:28.160394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.195381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab084db-fd60-43e7-b7f3-d1b59bc2fe19 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:28.205776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:28.210358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.210358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.210358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] PATH_INFO: `/v3/projects/68e716cbb0fd49888171d13d6429ab2c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.210592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e716cbb0fd49888171d13d6429ab2c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:28.228113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:28.276332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf889fe45b3488c82d32578dd1e6e3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.276332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf889fe45b3488c82d32578dd1e6e3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.283460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf889fe45b3488c82d32578dd1e6e3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.287398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf889fe45b3488c82d32578dd1e6e3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.379716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-12f56498-f6b9-479a-852a-f606c16535ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf889fe45b3488c82d32578dd1e6e3b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.410362 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3666/7373] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:27 2022] DELETE /identity/v3/users/edf889fe45b3488c82d32578dd1e6e3b => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:28.414193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e716cbb0fd49888171d13d6429ab2c', 'request_id': 'req-73c4dda7-287f-4021-a64e-4e46cc246518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.424307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.424307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.424307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.438180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:28.439563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.505861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e716cbb0fd49888171d13d6429ab2c', 'request_id': 'req-73c4dda7-287f-4021-a64e-4e46cc246518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.519474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e716cbb0fd49888171d13d6429ab2c', 'request_id': 'req-73c4dda7-287f-4021-a64e-4e46cc246518'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.551402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3667/7374] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:28.554782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:28.556221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.563097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] The token cache is being invalidate because project 68e716cbb0fd49888171d13d6429ab2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:28.563383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.564082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73c4dda7-287f-4021-a64e-4e46cc246518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:28.565866 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3708/7375] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:28 2022] DELETE /identity/v3/projects/68e716cbb0fd49888171d13d6429ab2c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:28.570487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6292ec-875d-498a-8406-a63278c462be None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.571458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6292ec-875d-498a-8406-a63278c462be None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.571858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6292ec-875d-498a-8406-a63278c462be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.631400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4c6292ec-875d-498a-8406-a63278c462be None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:28.632919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4c6292ec-875d-498a-8406-a63278c462be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.653827 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3709/7376] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:28.654799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2922cb-c6da-45a4-b5da-4ecbfed47919 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:28.661774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.662053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.662325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.672844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:28.674361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.683036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.683563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.693045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.702402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:28.705799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:28.722164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:28.724570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:28.733375 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3710/7377] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:28.734506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:28.752647 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3668/7378] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:28.752830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70865f38-8c36-414a-8743-eecf188aee8f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:28.767775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:28.768464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.768754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.769030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.769731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:28.770034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:28.771674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:28.773601 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:28.807184 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3711/7379] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:49:28.808252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:28.827102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5269-9215-4d08-b92f-fadebcea35c1 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:28.839633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:28.840263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:28.840538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:28.840806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:28.841475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:28.843491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.007414 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3669/7380] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:28 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:29.011624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.028333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75105a-5c98-46ef-aa3a-e979e88a91ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.105187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.107213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.108766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.108766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.109425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.111679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.247974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3712/7381] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:29 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:29.250097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.252395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.254505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.259811 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:29.270855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb525248-1768-4cd0-b76f-bd032d652078 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.271738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5311-26bd-449e-b69c-9fc8abeabb8b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.275728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.276499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.276782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.277112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.277229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] PATH_INFO: `/v3/users/b7978c02b2bf413b81e1d14350af13b4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.277940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.278871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7978c02b2bf413b81e1d14350af13b4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.278981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.279357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.280132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.281005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.282191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.295131 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3670/7382] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:29.299453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.310624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d228-2a08-4f4d-9687-daf82a93c95a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.315524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.316197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.316550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.316892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.317732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.321199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.333401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3671/7383] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:29.334744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.359145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bd268-ece0-4c91-8abe-f5e74c3ce29e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.359145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.359145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.359145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.359705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] PATH_INFO: `/v3/projects/fff24ddb243f426e99145916501782a8/users/e113e333c55942ca89d9b229c3a6d4ee/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.369438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff24ddb243f426e99145916501782a8, user_id=e113e333c55942ca89d9b229c3a6d4ee, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.374420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.434689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7978c02b2bf413b81e1d14350af13b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.437747 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3672/7384] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:29 2022] PUT /identity/v3/projects/fff24ddb243f426e99145916501782a8/users/e113e333c55942ca89d9b229c3a6d4ee/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:29.439329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.441781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.484874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7978c02b2bf413b81e1d14350af13b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.487385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7978c02b2bf413b81e1d14350af13b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.509893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7978c02b2bf413b81e1d14350af13b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.526291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7a465e4a-180f-4425-a0f7-e5da048f9b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7978c02b2bf413b81e1d14350af13b4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.528815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f1357-9861-4fd2-b02d-048f70c48c12 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.534251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.535177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.535692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.535843 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3713/7385] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:29 2022] DELETE /identity/v3/users/b7978c02b2bf413b81e1d14350af13b4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:29.536509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] PATH_INFO: `/v3/projects/4893597530f44424afb924ef222c54bc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.537090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.537475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.537879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.538515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4893597530f44424afb924ef222c54bc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.543343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.573053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] MFA Rules not processed for user `e113e333c55942ca89d9b229c3a6d4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:29.574759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.628122 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:29.661476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3714/7386] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:29.666191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.668249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.669010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4893597530f44424afb924ef222c54bc', 'request_id': 'req-3fac21e0-6451-4265-82fe-89e3d7dc4efb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.676474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4893597530f44424afb924ef222c54bc', 'request_id': 'req-3fac21e0-6451-4265-82fe-89e3d7dc4efb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.747826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edbc47-0770-4d6d-b639-d682099aa9e2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.756558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4893597530f44424afb924ef222c54bc', 'request_id': 'req-3fac21e0-6451-4265-82fe-89e3d7dc4efb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.771253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] The token cache is being invalidate because project 4893597530f44424afb924ef222c54bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:29.774349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.774349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:29.774349 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3673/7387] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:29 2022] DELETE /identity/v3/projects/4893597530f44424afb924ef222c54bc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:29.778243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.779137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.812286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.813079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.813473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.813777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.814383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.816603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.858800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac21e0-6451-4265-82fe-89e3d7dc4efb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:29.863792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:29.864762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:29.865042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:29.865313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] PATH_INFO: `/v3/users/b6c451df8dc04533b48348a70ec6488a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:29.866490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c451df8dc04533b48348a70ec6488a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:29.868407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:29.924105 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3715/7388] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:29 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:29.928209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:29.929847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:29.996485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb288f-3568-4ac4-a8b9-ac6a2b00a54a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.001904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.002557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.008558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.008558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] PATH_INFO: `/v3/projects/c7f136933de5465f8590e9b153955d04` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.008558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f136933de5465f8590e9b153955d04)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.008558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.037950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c451df8dc04533b48348a70ec6488a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.038594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c451df8dc04533b48348a70ec6488a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.046163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c451df8dc04533b48348a70ec6488a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.046888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c451df8dc04533b48348a70ec6488a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.082134 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:30.099278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c451df8dc04533b48348a70ec6488a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.119763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f136933de5465f8590e9b153955d04', 'request_id': 'req-4c08e680-883e-4f23-a31b-6c3f91dfeed5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.123931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3674/7389] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:29 2022] DELETE /identity/v3/users/b6c451df8dc04533b48348a70ec6488a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:30.128285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.128285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.190413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f136933de5465f8590e9b153955d04', 'request_id': 'req-4c08e680-883e-4f23-a31b-6c3f91dfeed5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.199145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f136933de5465f8590e9b153955d04', 'request_id': 'req-4c08e680-883e-4f23-a31b-6c3f91dfeed5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.215141 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:30.237568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f02d5-a3ac-49fa-b1b8-3f67565ef491 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.237777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] The token cache is being invalidate because project c7f136933de5465f8590e9b153955d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:30.237777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.238752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.241370 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3716/7390] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:29 2022] DELETE /identity/v3/projects/c7f136933de5465f8590e9b153955d04 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:30.245021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.245719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.246001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.250196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.250196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.250196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.251384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.253091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.321959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08e680-883e-4f23-a31b-6c3f91dfeed5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.329637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.330278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.330772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.331111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] PATH_INFO: `/v3/users/a1b74d8542624fb3a3f28cb7c0c765ba` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.333319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b74d8542624fb3a3f28cb7c0c765ba)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.335385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.338678 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3675/7391] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:30 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:30.339638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.342684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.384598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060876b-90c5-42ae-98a6-a93c962fe66c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.390933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.391681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.392069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.392450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.393194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.395174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.408992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3676/7392] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:30.413148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.426900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca992-7ba8-4dcd-8a29-b66daa3c95a6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.435959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.436790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.437075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.437929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] PATH_INFO: `/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73/users/baa1c029b9f44f63b562db108275234f/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.456843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19f73fa80334f1ca3f2d2af4b067d73, user_id=baa1c029b9f44f63b562db108275234f, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.462679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.545864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3677/7393] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:30 2022] PUT /identity/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73/users/baa1c029b9f44f63b562db108275234f/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:30.549546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.576917 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:30.589202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b74d8542624fb3a3f28cb7c0c765ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.620186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6657d-70b2-4817-85f8-01e237dc84d5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.626566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.627286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.627580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.627877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.628531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.630205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.642295 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3678/7394] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:30.643249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.645398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.645551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b74d8542624fb3a3f28cb7c0c765ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.646263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b74d8542624fb3a3f28cb7c0c765ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.659750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b74d8542624fb3a3f28cb7c0c765ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.660846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265cd7a-72f9-4f18-980b-d45e4ad66750 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.665704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.667543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.667543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.667543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] PATH_INFO: `/v3/projects/31eb97f694a5453193e6a1938253cd17` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.667783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b74d8542624fb3a3f28cb7c0c765ba'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.668000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31eb97f694a5453193e6a1938253cd17)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.670518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.674539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3717/7395] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:30 2022] DELETE /identity/v3/users/a1b74d8542624fb3a3f28cb7c0c765ba => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:30.678404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.679830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.723148 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:30.760692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a87134-1a7a-4cb4-a160-934742794700 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.766260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.766840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.767121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.767394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] PATH_INFO: `/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73/users/baa1c029b9f44f63b562db108275234f/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.769362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19f73fa80334f1ca3f2d2af4b067d73, user_id=baa1c029b9f44f63b562db108275234f, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.772014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3d613-e437-4ff5-8e7a-7426beeafd2c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:30.783887 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3718/7396] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:30 2022] PUT /identity/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73/users/baa1c029b9f44f63b562db108275234f/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:30.793639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.795131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.795344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.817009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31eb97f694a5453193e6a1938253cd17', 'request_id': 'req-de9c4092-ee6d-460c-a8e8-6b2069befb31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.829868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31eb97f694a5453193e6a1938253cd17', 'request_id': 'req-de9c4092-ee6d-460c-a8e8-6b2069befb31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.835906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] MFA Rules not processed for user `baa1c029b9f44f63b562db108275234f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:30.837233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.904758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31eb97f694a5453193e6a1938253cd17', 'request_id': 'req-de9c4092-ee6d-460c-a8e8-6b2069befb31'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.918566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] The token cache is being invalidate because project 31eb97f694a5453193e6a1938253cd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:30.919488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.920281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:30.921966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3679/7397] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:30 2022] DELETE /identity/v3/projects/31eb97f694a5453193e6a1938253cd17 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:30.930459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.932049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:30.933390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3719/7398] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:30.937370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:30.947234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3580b-a850-4cc7-b80c-b9beca95825f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:30.952315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:30.956071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:30.956071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:30.956071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:30.956071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:30.956399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.013161 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3720/7399] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:30 2022] POST /identity/v3/services => generated 290 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:31.013161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.014483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:31.025451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c4092-ee6d-460c-a8e8-6b2069befb31 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.040228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0e41-da2c-4f46-a17d-967cb31fce80 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.042048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.042718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.042957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.043229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] PATH_INFO: `/v3/users/3ad34c963b61426985039f7963a25cc8` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.044574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad34c963b61426985039f7963a25cc8)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.045578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.046753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.046857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.047194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.048491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] PATH_INFO: `/v3/projects/a14d2327c6f74693a2363bc408c5f6b7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.049724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14d2327c6f74693a2363bc408c5f6b7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.051728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.164233 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:31.178493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad34c963b61426985039f7963a25cc8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.179142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14d2327c6f74693a2363bc408c5f6b7', 'request_id': 'req-a6354e1c-d9fb-49d5-8063-7f354633e5c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.179281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad34c963b61426985039f7963a25cc8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.187105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad34c963b61426985039f7963a25cc8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.187760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad34c963b61426985039f7963a25cc8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.236204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14d2327c6f74693a2363bc408c5f6b7', 'request_id': 'req-a6354e1c-d9fb-49d5-8063-7f354633e5c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.244391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14d2327c6f74693a2363bc408c5f6b7', 'request_id': 'req-a6354e1c-d9fb-49d5-8063-7f354633e5c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.258382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] The token cache is being invalidate because project a14d2327c6f74693a2363bc408c5f6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:31.259374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.260218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.266448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3721/7400] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:31 2022] DELETE /identity/v3/projects/a14d2327c6f74693a2363bc408c5f6b7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:31.266448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.266448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:31.276710 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:31.302677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0f20b305-a277-4c23-9f30-9d8711ccb9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad34c963b61426985039f7963a25cc8'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:31.329084 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3680/7401] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:30 2022] DELETE /identity/v3/users/3ad34c963b61426985039f7963a25cc8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:31.330730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4894-97da-4216-a225-144fa61b7178 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.331019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4894-97da-4216-a225-144fa61b7178 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.331346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4894-97da-4216-a225-144fa61b7178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.363079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e1c-d9fb-49d5-8063-7f354633e5c5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.367100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8b9b4894-97da-4216-a225-144fa61b7178 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:31.368678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8b9b4894-97da-4216-a225-144fa61b7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:31.442911 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.446253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.446253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.446253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.446253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.447279 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3681/7402] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:31.447393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.455316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: 'False' Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise error Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'False' Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.455461 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:31.456982 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'False' Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.462395 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3722/7403] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/endpoints => generated 283 bytes in 193 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:31.463269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.463269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.465133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.481503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cab4-0235-4065-b965-edc290a67e45 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.483728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:31.485023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:31.486704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.487467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.487752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.488226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.489236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.491086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.494412 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3682/7404] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:31.498869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: 'True' Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise error Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'True' Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.499983 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:31.513694 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'True' Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3723/7405] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/endpoints => generated 281 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:31.514691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.515405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165cd8-b093-4b07-a964-d637445c44b2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.519677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.520892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.520892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.521121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.521858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:31.522332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.523117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654753-af3a-4df1-b18c-24d9591a2d06 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.524621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.530131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.530836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.531193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.531611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.532593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.535133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.539977 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3683/7406] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:49:31.550504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.558386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8021e-6f84-4041-8b61-84c1e1291799 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.568964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.569723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.570190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.570548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.571271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.573508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.630210 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1679521860. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:49:31.630210 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:49:31.630210 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:49:31.695798 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3684/7407] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:31.699850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.723579 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3724/7408] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/endpoints => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:31.727939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.752882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f93e56-afce-450a-a22b-046b26ef3dc4 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.774220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cee11-bc70-4be9-9b8b-902877fe9259 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.801689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.802312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.802665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.802989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.803565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.805760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.815085 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:31.822181 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:31.829787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.830423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.830708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.830981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/regions/tempest-region-1679521860` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.831566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1679521860)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.832640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.834539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3725/7409] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:49:31 2022] GET /identity/v3/regions/tempest-region-1679521860 => generated 180 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:31.838555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.840151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:31.855161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1085ba9-f4a0-4a81-b1b1-a32d49461b34 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.860663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.861279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.861624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.861917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] PATH_INFO: `/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.863135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b0cbe3019c4043ab57d7d30aee9f05)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.865453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.900931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3685/7410] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:31 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:31.903001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.914543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d16e1-8972-43dd-9182-b17b71ad8112 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.919213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.919833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.920115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.920450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints/396c3a170186485c923a5ba8631a52ba` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.925758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=396c3a170186485c923a5ba8631a52ba)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.927351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: On instance['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: On instance['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: 'False' Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise error Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application 'False' Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.935147 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:31.936527 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application 'False' Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:31.937772 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3686/7411] 10.222.0.13 () {60 vars in 1255 bytes} [Sun Oct 30 01:49:31 2022] PATCH /identity/v3/endpoints/396c3a170186485c923a5ba8631a52ba => generated 283 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:31.938301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.950987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe62a3-1b27-41e9-bf35-56b0e2fd3387 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.955708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.956072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.956333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.956600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.957263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.959578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:31.976071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3687/7412] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:31.976071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:31.985297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a673b6-4a9e-468c-88c3-48fe4db97d09 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:31.990054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:31.990684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:31.990987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:31.991265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints/396c3a170186485c923a5ba8631a52ba` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:31.992445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=396c3a170186485c923a5ba8631a52ba)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:31.994312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.021554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b0cbe3019c4043ab57d7d30aee9f05', 'request_id': 'req-09eb7c92-e3c9-4661-82a3-c05e337a1a84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.077217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b0cbe3019c4043ab57d7d30aee9f05', 'request_id': 'req-09eb7c92-e3c9-4661-82a3-c05e337a1a84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.077628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '396c3a170186485c923a5ba8631a52ba', 'request_id': 'req-9b290882-0ca3-4add-bc96-65f5a1fadaae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.085162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b0cbe3019c4043ab57d7d30aee9f05', 'request_id': 'req-09eb7c92-e3c9-4661-82a3-c05e337a1a84'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.090146 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3688/7413] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:31 2022] DELETE /identity/v3/endpoints/396c3a170186485c923a5ba8631a52ba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:32.090905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.098518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] The token cache is being invalidate because project 92b0cbe3019c4043ab57d7d30aee9f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:32.099187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.099927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:32.101991 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3726/7414] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:31 2022] DELETE /identity/v3/projects/92b0cbe3019c4043ab57d7d30aee9f05 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:32.106820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.108564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:32.113488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b290882-0ca3-4add-bc96-65f5a1fadaae tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.176513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.177132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.177467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.177747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.178533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.180340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d62d50-6fad-40b5-bac2-415a6c79cd3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.183975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7c92-e3c9-4661-82a3-c05e337a1a84 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.191663 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3689/7415] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:32.193026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.193319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.193638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.205849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.206601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.206982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.207413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/regions/tempest-region-1679521860` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.208102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1679521860)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.210636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdd7b-08ba-4995-a36d-1362b3e63bda tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.215789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:32.217005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:32.226587 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3690/7416] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:32.232859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.232859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:32.242036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8439735-7017-4384-b42a-5b1fc5f9ac46 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.247555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.248231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.248513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.248783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] PATH_INFO: `/v3/projects/4856da35f10e449eb3037015d6454107/users/ea290cfe7c1544188e5aad17c7c2b592/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.264535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4856da35f10e449eb3037015d6454107, user_id=ea290cfe7c1544188e5aad17c7c2b592, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.267208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.282970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3727/7417] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:49:32 2022] DELETE /identity/v3/regions/tempest-region-1679521860 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:32.287494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.287494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.287494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.307451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:32.325873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:32.329768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3728/7418] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:32.334752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.361387 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3691/7419] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:32 2022] PUT /identity/v3/projects/4856da35f10e449eb3037015d6454107/users/ea290cfe7c1544188e5aad17c7c2b592/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:32.361387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.377087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8ee54-1024-477d-8400-f67a74a03756 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.409597 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:32.438584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.438946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf6e4-7bc0-4ed7-b9ff-f3e1588e311d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.439358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.439735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.440069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.440811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.442554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.444238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.444910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.445265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.445627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.446602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:32.447007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.448704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d691d-43c9-47d2-a01d-5531ca46ccd7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.458447 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:32.461762 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3692/7420] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:32.463114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.463474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.463845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.497179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] MFA Rules not processed for user `ea290cfe7c1544188e5aad17c7c2b592`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:32.498938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:32.522292 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1407569121. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:49:32.522292 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:49:32.522292 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:49:32.580469 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3693/7421] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3396 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:32.581474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.603365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e60d3-b2b5-4d89-a54b-89b335496614 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.603543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3729/7422] 10.222.0.13 () {60 vars in 1156 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/endpoints => generated 360 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:32.604488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.621995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.622604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.622882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.623151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.623768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.626058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.630125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de186b-fc2c-4a5c-b4b6-de45ca5c9e31 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.635124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.635797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.636362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.636512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.637150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.639795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.702060 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3694/7423] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:32.703026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.727270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3730/7424] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:32.727270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.783798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309b54e-b565-4406-9e58-d887fcba3b27 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.800038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca345c09-62dd-4aa8-bb1f-53f1e3805528 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.805229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.806211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.806729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.807179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.807985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.810638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.838258 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:32.850907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.851543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.851916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.852172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/regions/tempest-region-1407569121` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.852745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1407569121)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.853939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.861864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3695/7425] 10.222.0.13 () {58 vars in 1206 bytes} [Sun Oct 30 01:49:32 2022] GET /identity/v3/regions/tempest-region-1407569121 => generated 180 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:32.861864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.869655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd115b-8742-48ac-b65b-5a8fee749455 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.875118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.878404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.878404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.878404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.878404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.879793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.900450 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3731/7426] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:32.901268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.914430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4942eb-2299-4680-9a22-be848bb8c2f2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.919951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.920562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.920847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.921117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints/8f2c705aa7d4462b8408ac36008786e9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.926620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=8f2c705aa7d4462b8408ac36008786e9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.927632 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:32.927632 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:49:32.927632 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:49:32.928529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: On instance['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: 'True' Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise error Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'True' Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.936326 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:32.937879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['enabled']: Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application 'True' Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:32.938835 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3732/7427] 10.222.0.13 () {60 vars in 1255 bytes} [Sun Oct 30 01:49:32 2022] PATCH /identity/v3/endpoints/8f2c705aa7d4462b8408ac36008786e9 => generated 281 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:32.939326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.950645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342736e-cfdc-459f-9575-db6345808698 tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.955254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.955810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.956088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.956359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.957101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.958702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:32.968886 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3733/7428] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:32.972152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:32.982323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b911ba2-63b6-44a8-99b4-e89ab67a8aaa admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:32.987446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:32.988041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:32.988323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:32.988670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/endpoints/8f2c705aa7d4462b8408ac36008786e9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:32.989774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8f2c705aa7d4462b8408ac36008786e9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:32.991331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.030589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3696/7429] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:32 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:33.030589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.042644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93c0b0-2d8b-4e7b-8cba-e36777a4e809 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.049874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.050497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.050782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.051055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.051703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.053299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.064848 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3697/7430] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:33.065896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.076318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd059a-485a-4da1-9c5a-ee969823e15e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.083977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.083977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.083977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.083977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.084329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.085594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.096325 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3698/7431] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:33.097222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.107863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812c1d-3364-4d21-9827-580466b3c214 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.113115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.113788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.114070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.114345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] PATH_INFO: `/v3/projects/7446a8e0337448619c0efc77f6856feb/users/34dab0e224694d18ae7542b524297aa9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.129967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7446a8e0337448619c0efc77f6856feb, user_id=34dab0e224694d18ae7542b524297aa9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.132648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.155818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8f2c705aa7d4462b8408ac36008786e9', 'request_id': 'req-fe365ef9-d5b8-4125-afc1-80c375b5402b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:33.166102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3734/7432] 10.222.0.13 () {58 vars in 1236 bytes} [Sun Oct 30 01:49:32 2022] DELETE /identity/v3/endpoints/8f2c705aa7d4462b8408ac36008786e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.170172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.190206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe365ef9-d5b8-4125-afc1-80c375b5402b tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.195040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.195697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.195975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.196247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] PATH_INFO: `/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b/users/34e4c373f0e94c3ea47c05a1aecdf33a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.209041 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:33.212239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a90e4b4bb845ad8e7b1bcd3e64e86b, user_id=34e4c373f0e94c3ea47c05a1aecdf33a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.214945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b3d3-5f82-4ee5-b7d3-d74719fb2450 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.300197 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3699/7433] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:33 2022] PUT /identity/v3/projects/7446a8e0337448619c0efc77f6856feb/users/34dab0e224694d18ae7542b524297aa9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.301074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.330146 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3735/7434] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:33 2022] PUT /identity/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b/users/34e4c373f0e94c3ea47c05a1aecdf33a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.332065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.344709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.344709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.362867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] MFA Rules not processed for user `34dab0e224694d18ae7542b524297aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:33.364092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:33.371495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cd340-5895-4659-864d-9b2d1bbd1483 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.439795 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3736/7435] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3380 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:33.441284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.450956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.451597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.451882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.452381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/regions/tempest-region-1407569121` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.452823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1407569121)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.454078 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:33.454078 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:49:33.454078 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:49:33.454976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.511339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85383ea9-0f44-4fab-9d9d-e51bdc792bdc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.516091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.516696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.516976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.517247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.517931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.519538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.530242 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3737/7436] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:33.535536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.535536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:33.590252 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1407569121. To ensure interoperability, identifiers should be a valid uuid. Oct 30 01:49:33.590252 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 30 01:49:33.590252 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:49:33.598448 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3700/7437] 10.222.0.13 () {58 vars in 1209 bytes} [Sun Oct 30 01:49:33 2022] DELETE /identity/v3/regions/tempest-region-1407569121 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.603396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.604271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3d036-2b1d-4ef1-b821-7519fd616f8c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.619817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.620425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.620700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.621036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.622411 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:33.627048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0cf5d-3472-4be9-8061-7d08b534629d tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.631772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.632037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.632698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.632977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.633247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ad09-e2ee-40e4-b131-b3269032bd4b service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.633380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] PATH_INFO: `/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b/users/34e4c373f0e94c3ea47c05a1aecdf33a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.635327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a90e4b4bb845ad8e7b1bcd3e64e86b, user_id=34e4c373f0e94c3ea47c05a1aecdf33a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.637997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.643027 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:33.648838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3701/7438] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:33 2022] PUT /identity/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b/users/34e4c373f0e94c3ea47c05a1aecdf33a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.654495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.659467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3738/7439] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3380 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:33.661811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.662249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.662556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.698241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] MFA Rules not processed for user `34e4c373f0e94c3ea47c05a1aecdf33a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:33.698241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:33.751441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af83c2-7d00-4260-ad50-6228d4668735 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.757923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baa1c029b9f44f63b562db108275234f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19f73fa80334f1ca3f2d2af4b067d73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.758550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.758831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.759356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] PATH_INFO: `/v3/services/af6f81b795184ca88fb8e2b6dbcce149` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.759688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorizing `identity:delete_service(service_id=af6f81b795184ca88fb8e2b6dbcce149)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.761756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.785608 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3739/7440] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:33 2022] POST /identity/v3/auth/tokens => generated 3461 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:33.796509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.797928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:33.845215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3702/7441] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:33 2022] DELETE /identity/v3/services/af6f81b795184ca88fb8e2b6dbcce149 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:33.849618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:33.851521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:33.884493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947b5b2-0bb2-4582-ae26-2d2ebff35f8c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.906056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.906703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.907140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.907423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.946727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c770d9-b296-4ca4-bdb8-b8a8592e261a tempest-EndpointsNegativeTestJSON-2059282977 tempest-EndpointsNegativeTestJSON-2059282977-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:33.953543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:33.954233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:33.954563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:33.954933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] PATH_INFO: `/v3/users/e113e333c55942ca89d9b229c3a6d4ee` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:33.956723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e113e333c55942ca89d9b229c3a6d4ee)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.959184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.974259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:33.975956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e16644-f0e7-4e42-aa8f-7f2c8714eb85 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:33.998036 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3740/7442] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:34.160309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e113e333c55942ca89d9b229c3a6d4ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:34.161192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e113e333c55942ca89d9b229c3a6d4ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:34.169839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e113e333c55942ca89d9b229c3a6d4ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:34.170167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e113e333c55942ca89d9b229c3a6d4ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:34.171973 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:34.259217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e113e333c55942ca89d9b229c3a6d4ee'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:34.279372 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3703/7443] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:33 2022] DELETE /identity/v3/users/e113e333c55942ca89d9b229c3a6d4ee => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:34.284124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:34.284409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:34.284683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:34.299119 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:34.306117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:34.307046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:34.371540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3741/7444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:34.383299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:34.384708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:34.458041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c6c9f-6119-43c0-ba40-7e84f01ec7ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:34.462032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:34.462703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:34.463007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:34.463284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:34.473059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:34.474801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:34.484437 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3704/7445] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:35.016425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:35.017960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:35.047511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2826c1-5212-4cf8-aaa9-496f67abf561 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:35.058170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:35.058822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:35.059623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:35.059953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] PATH_INFO: `/v3/projects/fff24ddb243f426e99145916501782a8` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:35.061205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff24ddb243f426e99145916501782a8)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:35.063518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:35.227076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff24ddb243f426e99145916501782a8', 'request_id': 'req-3c25afb8-6521-4cc2-b3a8-2091de77ad02'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.316732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff24ddb243f426e99145916501782a8', 'request_id': 'req-3c25afb8-6521-4cc2-b3a8-2091de77ad02'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.324383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff24ddb243f426e99145916501782a8', 'request_id': 'req-3c25afb8-6521-4cc2-b3a8-2091de77ad02'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.336242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] The token cache is being invalidate because project fff24ddb243f426e99145916501782a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:35.336527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.337316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.339050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3742/7446] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:35 2022] DELETE /identity/v3/projects/fff24ddb243f426e99145916501782a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:35.343037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:35.353662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9973-f3f6-4885-b84d-5c552e2a94da service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:35.423456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:35.424164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:35.424634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:35.424920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] PATH_INFO: `/v3/users/baa1c029b9f44f63b562db108275234f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:35.426216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa1c029b9f44f63b562db108275234f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:35.428461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:35.631155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa1c029b9f44f63b562db108275234f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.631815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa1c029b9f44f63b562db108275234f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.640179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa1c029b9f44f63b562db108275234f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.641740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa1c029b9f44f63b562db108275234f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.733769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5516fcb-6b10-49fc-ae3e-97058deb1a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa1c029b9f44f63b562db108275234f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:35.739950 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:35.754439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3705/7447] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:35 2022] DELETE /identity/v3/users/baa1c029b9f44f63b562db108275234f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:36.255524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:36.256980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:36.280065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25afb8-6521-4cc2-b3a8-2091de77ad02 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:36.348884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:36.349633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:36.349957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:36.350273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] PATH_INFO: `/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:36.351467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19f73fa80334f1ca3f2d2af4b067d73)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:36.353695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:36.465666 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:36.478826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19f73fa80334f1ca3f2d2af4b067d73', 'request_id': 'req-143743c4-c079-4fc3-8763-6695c286a97b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:36.602051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19f73fa80334f1ca3f2d2af4b067d73', 'request_id': 'req-143743c4-c079-4fc3-8763-6695c286a97b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:36.609884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19f73fa80334f1ca3f2d2af4b067d73', 'request_id': 'req-143743c4-c079-4fc3-8763-6695c286a97b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:36.622887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] The token cache is being invalidate because project f19f73fa80334f1ca3f2d2af4b067d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:36.625319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:36.625319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-143743c4-c079-4fc3-8763-6695c286a97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:36.625703 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3743/7448] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:36 2022] DELETE /identity/v3/projects/f19f73fa80334f1ca3f2d2af4b067d73 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:36.630905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:36.631503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:36.631613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:36.655752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:36.659500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:36.729820 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3706/7449] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:36.739277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:36.739555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:36.739824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:36.760620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:36.761816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:36.771134 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3744/7450] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:36.775810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:36.790371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a82a7-7a67-4a4a-9543-7ae6515c3f45 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:36.795936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:36.796579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:36.797249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:36.797562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:36.798245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:36.798546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:36.800147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:36.813261 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3707/7451] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:36.817688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:36.828423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e3652-c89b-4db1-8abe-6c323e2dcd1e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:36.833284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:36.833916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:36.834192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:36.834465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:36.835107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:36.837353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.017108 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3745/7452] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:36 2022] POST /identity/v3/projects => generated 397 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:37.021580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.038485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3df18-cc4e-4f01-a992-dc56b73a3073 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.104176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.112933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.112933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.112933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.112933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.112933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.208416 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3708/7453] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:37 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:37.212560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.224432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97609c-d84b-4f07-a547-23a6b01c5061 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.229403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.231612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.231612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.231612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.231867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.237414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.259994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3746/7454] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:37.264781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.283607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1badc6-726a-4589-b3fc-31451df98efc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.283607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.283607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.283607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.284009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.284009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.284757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857fe5e-2feb-4125-8275-cf2532120958 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.302029 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3709/7455] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:37.303302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.315030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e168580-eb57-4c0e-970c-f989945ce33c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.321467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.322134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.322449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.322724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] PATH_INFO: `/v3/projects/484e6d80b43d4bcba3ed6d2bd3ff9136/users/5a9aece280234c5aa2b0a835bf3e94e7/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.338310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484e6d80b43d4bcba3ed6d2bd3ff9136, user_id=5a9aece280234c5aa2b0a835bf3e94e7, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.341584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.461572 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3747/7456] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:37 2022] PUT /identity/v3/projects/484e6d80b43d4bcba3ed6d2bd3ff9136/users/5a9aece280234c5aa2b0a835bf3e94e7/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:37.471922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.472213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.472484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.506110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] MFA Rules not processed for user `5a9aece280234c5aa2b0a835bf3e94e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:37.507479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:37.552595 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:37.578184 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3710/7457] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:37.585676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.658575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2834603-f32a-4fb4-ba40-fcd36f645c04 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.663545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.664150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.664430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.664703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.665361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.667277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.771482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3748/7458] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:37 2022] POST /identity/v3/projects => generated 397 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:37.775532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:37.788267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2c63-3303-4204-9e37-299fcfe62c1b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:37.851569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:37.852310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:37.852794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:37.853232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:37.857726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:37.857726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:37.980565 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3711/7459] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:37 2022] POST /identity/v3/users => generated 305 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:37.989883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.005238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160b70d-ab1b-4804-9cf9-a0fa9dc91c81 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.010643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.011256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.011538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.011817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.013040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.016761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.034101 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3749/7460] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:38.035267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.047390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fea36-ca31-4ad1-b7f1-b9b467a9fe8f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.051985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.052671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.052957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.053240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] PATH_INFO: `/v3/projects/8b3c52d0349c4fe3abc48afb63602a90/users/ed817d58d7ba4a2cbb67fb5e8bda3f65/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.070779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3c52d0349c4fe3abc48afb63602a90, user_id=ed817d58d7ba4a2cbb67fb5e8bda3f65, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.073718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.202750 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3712/7461] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:38 2022] PUT /identity/v3/projects/8b3c52d0349c4fe3abc48afb63602a90/users/ed817d58d7ba4a2cbb67fb5e8bda3f65/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:38.206787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.218093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d3b8-bd56-44d0-aae6-d5d0d604073c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.266084 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:38.296645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.297252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.297563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.297847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.298835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.300354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f27128-f099-4e0b-afb2-466dfeca19e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.313376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3750/7462] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:38.318657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.329195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ed20a-4071-4d83-8c45-42a82af7ff96 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.334136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.334800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.335085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.335359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] PATH_INFO: `/v3/projects/8b3c52d0349c4fe3abc48afb63602a90/users/ed817d58d7ba4a2cbb67fb5e8bda3f65/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.337314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3c52d0349c4fe3abc48afb63602a90, user_id=ed817d58d7ba4a2cbb67fb5e8bda3f65, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.340044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.352856 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3713/7463] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:38 2022] PUT /identity/v3/projects/8b3c52d0349c4fe3abc48afb63602a90/users/ed817d58d7ba4a2cbb67fb5e8bda3f65/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:38.366586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.366945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.367248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.397871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] MFA Rules not processed for user `ed817d58d7ba4a2cbb67fb5e8bda3f65`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:38.399117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:38.482508 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3751/7464] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:38.487705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.559702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6294cc-12cd-4053-a88e-ad513ba5aecb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.565208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9aece280234c5aa2b0a835bf3e94e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '484e6d80b43d4bcba3ed6d2bd3ff9136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.566025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.566320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.566634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.567266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 30 01:49:38.584780 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 30 01:49:38.585783 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.593497 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3714/7465] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/projects => generated 136 bytes in 99 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:49:38.593573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.602024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58c1be-ef2e-4fe8-b5cc-c005d7e8f12d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.607530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.608157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.608421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.608694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.609324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.611247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invalid input for field 'name': '' is too short Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: On instance['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: On instance['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: '' Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise error Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application '' Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.618154 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:38.619642 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application '' Oct 30 01:49:38.620693 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.625448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3752/7466] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/projects => generated 283 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:38.628688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.643298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72de941-d29d-41a7-a39a-460a6151a85d tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.650368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.651287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.651663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.654580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.654580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.655539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: On instance['name']: Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: On instance['name']: Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise error Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:49:38.662481 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:38.663639 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application On instance['name']: Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 30 01:49:38.664713 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.666162 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3715/7467] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/projects => generated 412 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 30 01:49:38.672972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.688262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bcd-a652-4ac7-83a9-66b4e02ae77d tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.695209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.695843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.696252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.696541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects/555ebe035d04435f85e8e93150e3fc86` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.705762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:delete_project(project_id=555ebe035d04435f85e8e93150e3fc86)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.707625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Could not find project: 555ebe035d04435f85e8e93150e3fc86.: keystone.exception.ProjectNotFound: Could not find project: 555ebe035d04435f85e8e93150e3fc86. Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 30 01:49:38.718886 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 555ebe035d04435f85e8e93150e3fc86. Oct 30 01:49:38.720024 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:38.721655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3753/7468] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:38 2022] DELETE /identity/v3/projects/555ebe035d04435f85e8e93150e3fc86 => generated 113 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:49:38.725895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.738923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b12d-7b63-4292-8d46-79da6eda0e09 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.743117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9aece280234c5aa2b0a835bf3e94e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '484e6d80b43d4bcba3ed6d2bd3ff9136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.746489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.746489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.746489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.746489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 30 01:49:38.751295 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self._list_projects() Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 30 01:49:38.752317 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:38.756579 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3716/7469] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:49:38 2022] GET /identity/v3/projects => generated 135 bytes in 31 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:49:38.758366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.770924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68668bf0-67ce-4ccb-b3ee-54340f1648f7 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.779855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:38.780819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:38.781100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:38.786636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:38.786636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:38.786636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:38.929204 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3754/7470] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:38.933359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:38.945273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7745a7-017a-4145-9540-fc4ee408d700 tempest-ProjectsNegativeStaticTestJSON-1306166451 tempest-ProjectsNegativeStaticTestJSON-1306166451-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:38.977179 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:39.018416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:39.023073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:39.023073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:39.023073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:39.023073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:39.023481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:39.105320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.sql.core [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1117090154' for key 'project.ixu_project_name_domain_id'") Oct 30 01:49:39.105320 n-d-master-1 devstack@keystone.service[82036]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 01:49:39.105320 n-d-master-1 devstack@keystone.service[82036]: [parameters: {'id': '75ffb0f04a9c47418ac934aaf0d2b9a8', 'name': 'tempest-project-dup-1117090154', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 01:49:39.105320 n-d-master-1 devstack@keystone.service[82036]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82036) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1117090154, project id 75ffb0f04a9c47418ac934aaf0d2b9a8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1117090154, project id 75ffb0f04a9c47418ac934aaf0d2b9a8. Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:49:39.142149 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1117090154' for key 'project.ixu_project_name_domain_id'") Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 01:49:39.146554 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application yield resource Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise self.value Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 01:49:39.147735 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application session.commit() Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.session.flush() Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application compat.raise_( Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 01:49:39.148650 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 30 01:49:39.149817 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result = self._query(query) Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application conn.query(q) Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application result.read() Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 30 01:49:39.150657 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1117090154' for key 'project.ixu_project_name_domain_id'") Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [parameters: {'id': '75ffb0f04a9c47418ac934aaf0d2b9a8', 'name': 'tempest-project-dup-1117090154', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:39.151495 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1117090154 at domain ID default. Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:39.154558 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1117090154, project id 75ffb0f04a9c47418ac934aaf0d2b9a8. Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:49:39.155634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3717/7471] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:49:38 2022] POST /identity/v3/projects => generated 285 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 30 01:49:39.156299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:39.163567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2478-e380-4906-b4a3-d37a4c3dd690 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:39.172161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed817d58d7ba4a2cbb67fb5e8bda3f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b3c52d0349c4fe3abc48afb63602a90', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:39.172916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:39.173271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:39.173644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] PATH_INFO: `/v3/projects/951340c001fb4e9ca39fbb5454fcb4b6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:39.174935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorizing `identity:delete_project(project_id=951340c001fb4e9ca39fbb5454fcb4b6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:39.177533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:39.352218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951340c001fb4e9ca39fbb5454fcb4b6', 'request_id': 'req-d720f2fc-babf-4041-9f08-32bec3822a51'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.475903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951340c001fb4e9ca39fbb5454fcb4b6', 'request_id': 'req-d720f2fc-babf-4041-9f08-32bec3822a51'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.484523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951340c001fb4e9ca39fbb5454fcb4b6', 'request_id': 'req-d720f2fc-babf-4041-9f08-32bec3822a51'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.489748 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:39.496047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] The token cache is being invalidate because project 951340c001fb4e9ca39fbb5454fcb4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:39.496331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.497704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d720f2fc-babf-4041-9f08-32bec3822a51 tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.499259 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3755/7472] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:39 2022] DELETE /identity/v3/projects/951340c001fb4e9ca39fbb5454fcb4b6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:39.504682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:39.506720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:39.579170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfb177-5bb0-4733-ae6b-8645d673e07b tempest-ProjectsNegativeStaticTestJSON-1594705123 tempest-ProjectsNegativeStaticTestJSON-1594705123-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:39.641936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:39.642496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:39.642775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:39.643048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] PATH_INFO: `/v3/users/5a9aece280234c5aa2b0a835bf3e94e7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:39.644168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9aece280234c5aa2b0a835bf3e94e7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:39.646411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:39.841208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9aece280234c5aa2b0a835bf3e94e7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.841985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9aece280234c5aa2b0a835bf3e94e7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.850635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9aece280234c5aa2b0a835bf3e94e7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.851560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9aece280234c5aa2b0a835bf3e94e7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.910681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9aece280234c5aa2b0a835bf3e94e7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:39.919693 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:39.932482 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3718/7473] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:39 2022] DELETE /identity/v3/users/5a9aece280234c5aa2b0a835bf3e94e7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:39.936960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:39.937242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:39.937605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:39.959920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:39.961487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:40.032004 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3756/7474] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:40.045640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:40.047443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:40.200715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659796b-9957-445e-b9c0-a06ab3b8e702 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:40.213965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:40.214610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:40.214892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:40.215204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:40.231852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:40.234480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:40.269876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3719/7475] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:40.746675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:40.748538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:40.768377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7062116-2ee4-4456-90fa-ca6b9bb8fa4e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:40.775977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:40.776903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:40.777305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:40.778339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] PATH_INFO: `/v3/projects/484e6d80b43d4bcba3ed6d2bd3ff9136` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:40.779694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484e6d80b43d4bcba3ed6d2bd3ff9136)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:40.781902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:40.943886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484e6d80b43d4bcba3ed6d2bd3ff9136', 'request_id': 'req-907daed4-e2c9-4f9b-a8af-4f70c9da5571'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.030859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484e6d80b43d4bcba3ed6d2bd3ff9136', 'request_id': 'req-907daed4-e2c9-4f9b-a8af-4f70c9da5571'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.038431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484e6d80b43d4bcba3ed6d2bd3ff9136', 'request_id': 'req-907daed4-e2c9-4f9b-a8af-4f70c9da5571'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.049126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] The token cache is being invalidate because project 484e6d80b43d4bcba3ed6d2bd3ff9136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:41.049448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.050163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.051675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3757/7476] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:40 2022] DELETE /identity/v3/projects/484e6d80b43d4bcba3ed6d2bd3ff9136 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:41.055613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:41.066376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd37bc-5b10-4ec2-9f42-b9ddc7d94fe2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:41.125039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:41.125826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:41.126357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:41.126667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] PATH_INFO: `/v3/users/ed817d58d7ba4a2cbb67fb5e8bda3f65` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:41.128078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed817d58d7ba4a2cbb67fb5e8bda3f65)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:41.130031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:41.325572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed817d58d7ba4a2cbb67fb5e8bda3f65'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.326379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed817d58d7ba4a2cbb67fb5e8bda3f65'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.334270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed817d58d7ba4a2cbb67fb5e8bda3f65'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.335087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed817d58d7ba4a2cbb67fb5e8bda3f65'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.436482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-5a05fb73-58bc-4a64-bf1d-e9175a71be5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed817d58d7ba4a2cbb67fb5e8bda3f65'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:41.459940 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3720/7477] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:41 2022] DELETE /identity/v3/users/ed817d58d7ba4a2cbb67fb5e8bda3f65 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:41.908167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:41.920280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:41.949751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907daed4-e2c9-4f9b-a8af-4f70c9da5571 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.058393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.058393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.058393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.058393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] PATH_INFO: `/v3/projects/8b3c52d0349c4fe3abc48afb63602a90` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.059575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3c52d0349c4fe3abc48afb63602a90)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.059575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:42.083403 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:42.190632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3c52d0349c4fe3abc48afb63602a90', 'request_id': 'req-30cb2cde-ff92-40e9-baf0-992534963426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:42.258971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3c52d0349c4fe3abc48afb63602a90', 'request_id': 'req-30cb2cde-ff92-40e9-baf0-992534963426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:42.270681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3c52d0349c4fe3abc48afb63602a90', 'request_id': 'req-30cb2cde-ff92-40e9-baf0-992534963426'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:42.286539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] The token cache is being invalidate because project 8b3c52d0349c4fe3abc48afb63602a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:42.287069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:42.289157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-30cb2cde-ff92-40e9-baf0-992534963426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:42.290088 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3758/7478] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:41 2022] DELETE /identity/v3/projects/8b3c52d0349c4fe3abc48afb63602a90 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:42.295487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.295943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.296043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.324809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:42.326773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:42.345150 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:42.411917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3721/7479] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:42.420122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.420326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.420599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.441552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:42.442788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:42.451942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3759/7480] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:42.456323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:42.468499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bb018-61f0-4447-98ce-af33df9b07fc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.474449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.475058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.475338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.475609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.476256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:42.476552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.478196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:42.494894 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3722/7481] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:42.499040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:42.511099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067cb0e-2864-401e-a9ba-5b7d14f425ee None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.516966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.517611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.517885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.518211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.519085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.521050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:42.640867 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3760/7482] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:42 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:42.642057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:42.653323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1960b-36a8-4182-8325-9c891f9c5660 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.722553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.723202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.723729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.723998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.724622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.726593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:42.925385 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3723/7483] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:42 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:42.926941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:42.942340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ad601-172e-4cfb-88cf-0d6884a65145 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.948276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.950134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.950640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.950917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.951634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.953291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:42.968822 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3761/7484] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:42.972808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:42.986333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd77863-bdfd-474a-9794-d00beef7bebc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:42.991178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:42.992021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:42.992374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:42.992716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:42.993487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:42.995175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.013403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3724/7485] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:43.015551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.029921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9aebb-541d-457e-8e26-129e7e3e7b66 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.035002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.035991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.036375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.036843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] PATH_INFO: `/v3/projects/31b1d4970c8845a59f83dc34c2266568/users/d01efe09e1834153ae1145c5e6ce15e5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.060325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b1d4970c8845a59f83dc34c2266568, user_id=d01efe09e1834153ae1145c5e6ce15e5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.065074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8d47-1a3c-490e-9abd-ef8b3eb003ff admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.071734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.073863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:43.141455 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3762/7486] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:43 2022] PUT /identity/v3/projects/31b1d4970c8845a59f83dc34c2266568/users/d01efe09e1834153ae1145c5e6ce15e5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:43.150190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.150731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.150976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bb70c-e4f3-4560-814a-c188c54e2bdd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.151320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.191355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] MFA Rules not processed for user `d01efe09e1834153ae1145c5e6ce15e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:43.194792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:43.196380 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:43.220464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.222091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.222899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.223653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.225960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:43.274116 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3763/7487] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:43.278983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.332249 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:43.337273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.338949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.365429 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3725/7488] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:43.367656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa3828-a92d-4bb9-8d41-31c8822bdfc7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.373766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.374597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.377186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.377549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.378565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.381530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.485588 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3764/7489] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:43.489477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.501255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e9694-cf86-4a37-b5d0-293924417243 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.578423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.579044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.579324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.579595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.580237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.582221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.689424 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3726/7490] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:43 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:43.693144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.704358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fcd48-a8c0-4d13-93a4-5339196f54cd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.709398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.710021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.710303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.710573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.711645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.713699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.726417 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3765/7491] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:43.730805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.743176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3445-49ac-4795-b784-f3c759732275 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.751393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.752358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.752898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.753187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] PATH_INFO: `/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10/users/f20a4b5683a8447f97daf4ffeaf71680/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.773843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaedc79c89d14f388fb92e2b33a9ec10, user_id=f20a4b5683a8447f97daf4ffeaf71680, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.776606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.838131 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3727/7492] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:43 2022] PUT /identity/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10/users/f20a4b5683a8447f97daf4ffeaf71680/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:43.842692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.854344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c3ef4-e2a7-4e21-8400-c21017768e48 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.932195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.932878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.933233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.934187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.934784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.937522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3c1c7-e519-403f-9fff-72f73019e790 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.952475 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3766/7493] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:43.954048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:43.964684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099681d2-7abc-4528-bf79-f25838106b4a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:43.969599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:43.970255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:43.970585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:43.971252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] PATH_INFO: `/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10/users/f20a4b5683a8447f97daf4ffeaf71680/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:43.975545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaedc79c89d14f388fb92e2b33a9ec10, user_id=f20a4b5683a8447f97daf4ffeaf71680, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:43.978305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:43.990243 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3728/7494] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:43 2022] PUT /identity/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10/users/f20a4b5683a8447f97daf4ffeaf71680/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:44.002308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:44.002599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:44.002854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:44.050060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] MFA Rules not processed for user `f20a4b5683a8447f97daf4ffeaf71680`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:44.050060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:44.194689 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3767/7495] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:44.200060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:44.213380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820ca3-557d-40f1-b6ff-920166301acd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:44.223760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20a4b5683a8447f97daf4ffeaf71680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaedc79c89d14f388fb92e2b33a9ec10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:44.224477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:44.224823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:44.225193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:44.226002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:44.228589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:44.347723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3729/7496] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:44 2022] POST /identity/v3/projects => generated 359 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:44.351663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:44.388305 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:44.414336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec971d-97ee-42a5-a1c1-23bffc0e719b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:44.474626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd01efe09e1834153ae1145c5e6ce15e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b1d4970c8845a59f83dc34c2266568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:44.475274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:44.475554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:44.475823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] PATH_INFO: `/v3/projects/0ebbb36f80ec48f38abe1c318a5f0f3a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:44.477076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] RBAC: Authorizing `identity:delete_project(project_id=0ebbb36f80ec48f38abe1c318a5f0f3a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 30 01:49:44.483701 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 30 01:49:44.484710 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:44.488342 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3768/7497] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:44 2022] DELETE /identity/v3/projects/0ebbb36f80ec48f38abe1c318a5f0f3a => generated 136 bytes in 134 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:49:44.496260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:44.496744 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:44.563042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffd24c-f267-4f1b-9b52-d4ca9bc82925 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:44.568279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f20a4b5683a8447f97daf4ffeaf71680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaedc79c89d14f388fb92e2b33a9ec10', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:44.569157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:44.569490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:44.569777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] PATH_INFO: `/v3/projects/0ebbb36f80ec48f38abe1c318a5f0f3a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:44.571372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ebbb36f80ec48f38abe1c318a5f0f3a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:44.574204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:44.711810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebbb36f80ec48f38abe1c318a5f0f3a', 'request_id': 'req-f70c0099-800c-4a8e-a773-68d3b0704956'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:44.720562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebbb36f80ec48f38abe1c318a5f0f3a', 'request_id': 'req-f70c0099-800c-4a8e-a773-68d3b0704956'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:44.819291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebbb36f80ec48f38abe1c318a5f0f3a', 'request_id': 'req-f70c0099-800c-4a8e-a773-68d3b0704956'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:44.833395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] The token cache is being invalidate because project 0ebbb36f80ec48f38abe1c318a5f0f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:44.833688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:44.834452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70c0099-800c-4a8e-a773-68d3b0704956 tempest-ProjectsNegativeTestJSON-2138662863 tempest-ProjectsNegativeTestJSON-2138662863-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:44.836188 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3730/7498] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:44 2022] DELETE /identity/v3/projects/0ebbb36f80ec48f38abe1c318a5f0f3a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:44.841534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:44.843234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:44.946756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786b8cf-bb94-4d68-94f5-dbd3e4cdb950 tempest-ProjectsNegativeTestJSON-1544638934 tempest-ProjectsNegativeTestJSON-1544638934-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:45.033426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:45.034002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:45.034285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:45.034546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] PATH_INFO: `/v3/users/d01efe09e1834153ae1145c5e6ce15e5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:45.036289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01efe09e1834153ae1145c5e6ce15e5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:45.038266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:45.219078 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:45.227624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01efe09e1834153ae1145c5e6ce15e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:45.315902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01efe09e1834153ae1145c5e6ce15e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:45.317213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01efe09e1834153ae1145c5e6ce15e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:45.332218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01efe09e1834153ae1145c5e6ce15e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:45.339550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01efe09e1834153ae1145c5e6ce15e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:45.347924 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3769/7499] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:44 2022] DELETE /identity/v3/users/d01efe09e1834153ae1145c5e6ce15e5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:45.353323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:45.353804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:45.353932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:45.375614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:45.377163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:45.457683 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3731/7500] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:45.467487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:45.469060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:45.532672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36affa92-9540-4f17-ae1a-9e902702913e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:45.538726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:45.538726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:45.538726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:45.538726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:45.548077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:45.549514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:45.561593 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3770/7501] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:45.975048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:45.976489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:45.993504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020ed9c-1841-40d3-81b2-6b62f4f99f6f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:45.999107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:45.999756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:46.001613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:46.001613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] PATH_INFO: `/v3/projects/31b1d4970c8845a59f83dc34c2266568` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:46.001613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b1d4970c8845a59f83dc34c2266568)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:46.003421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:46.349633 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:46.349633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b1d4970c8845a59f83dc34c2266568', 'request_id': 'req-4bcba5b8-8cb7-4597-8ab8-a62723b32430'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:46.349633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b1d4970c8845a59f83dc34c2266568', 'request_id': 'req-4bcba5b8-8cb7-4597-8ab8-a62723b32430'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:46.681949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b1d4970c8845a59f83dc34c2266568', 'request_id': 'req-4bcba5b8-8cb7-4597-8ab8-a62723b32430'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:46.694900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] The token cache is being invalidate because project 31b1d4970c8845a59f83dc34c2266568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:46.695193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:46.695859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:46.701304 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3732/7502] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:45 2022] DELETE /identity/v3/projects/31b1d4970c8845a59f83dc34c2266568 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:46.702414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:46.717214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146477-49db-4091-ac18-03f3bae8fe1c service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:46.787278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:46.787978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:46.788322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:46.788658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] PATH_INFO: `/v3/users/f20a4b5683a8447f97daf4ffeaf71680` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:46.789850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20a4b5683a8447f97daf4ffeaf71680)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:46.791886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:46.986937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20a4b5683a8447f97daf4ffeaf71680'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.092982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20a4b5683a8447f97daf4ffeaf71680'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.093587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20a4b5683a8447f97daf4ffeaf71680'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.100676 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:47.111788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20a4b5683a8447f97daf4ffeaf71680'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.119304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-43bc40ab-a348-4669-ac0b-310192388fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20a4b5683a8447f97daf4ffeaf71680'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.126641 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3771/7503] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:46 2022] DELETE /identity/v3/users/f20a4b5683a8447f97daf4ffeaf71680 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:47.682239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:47.684823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:47.704359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba5b8-8cb7-4597-8ab8-a62723b32430 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:47.786377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:47.787026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:47.787306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:47.787578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] PATH_INFO: `/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:47.788795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaedc79c89d14f388fb92e2b33a9ec10)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:47.791601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:47.918195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaedc79c89d14f388fb92e2b33a9ec10', 'request_id': 'req-db9f9575-e9ba-4689-a227-8ca2711ded35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.929686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaedc79c89d14f388fb92e2b33a9ec10', 'request_id': 'req-db9f9575-e9ba-4689-a227-8ca2711ded35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:47.996913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaedc79c89d14f388fb92e2b33a9ec10', 'request_id': 'req-db9f9575-e9ba-4689-a227-8ca2711ded35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:48.011337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] The token cache is being invalidate because project eaedc79c89d14f388fb92e2b33a9ec10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:48.012374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:48.013051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-db9f9575-e9ba-4689-a227-8ca2711ded35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:48.015048 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3733/7504] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:47 2022] DELETE /identity/v3/projects/eaedc79c89d14f388fb92e2b33a9ec10 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:48.019592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.020093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.020439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.047337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:48.048741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:48.168816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.169386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.169925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.173526 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3772/7505] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:48.205409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:48.207065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:48.219620 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3734/7506] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:49:48.224284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.238287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd22e79-96cb-4b26-8831-a9557091ff40 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.245652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.246882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.247184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.247452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.248229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:48.248526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.250148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.265384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3773/7507] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:48.269165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.279399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0cf32-879f-4fcd-833a-5440093a09e2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.284348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.285071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.285489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.285863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.286602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.288651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.413507 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3735/7508] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:48 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:48.417641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.446399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf20ee-c50a-4b5e-89b8-125fe083c414 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.538538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.539169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.539465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.539893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.540576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.543354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.638762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3774/7509] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:48 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:48.642852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.655520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac48ab-d038-4bf2-9b00-efbe74451237 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.661322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.662263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.662967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.663467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.664275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.666415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.682242 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3736/7510] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:48.686702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.705577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feab32-00e9-4861-8fa8-ab5125c6140b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.711613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.712347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.712703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.713040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.713797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.716000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c8f34-4b64-49e7-87e7-d20d608253c7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.733308 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3775/7511] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:48.735175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:48.747286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8f7e-33b5-49f3-90ec-65e84fec6183 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:48.753199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:48.753953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.754244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.754672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] PATH_INFO: `/v3/projects/f71ce998ea844649b46cec5082e14ab4/users/51a53b8c442d47e1baa01578632f10d9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.759368 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:48.777781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71ce998ea844649b46cec5082e14ab4, user_id=51a53b8c442d47e1baa01578632f10d9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:48.780455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:48.869461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3737/7512] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:48 2022] PUT /identity/v3/projects/f71ce998ea844649b46cec5082e14ab4/users/51a53b8c442d47e1baa01578632f10d9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:48.871298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:48.871522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:48.871792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:48.921443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] MFA Rules not processed for user `51a53b8c442d47e1baa01578632f10d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:48.923075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:48.975569 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:49.020291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3776/7513] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:49.024943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.109454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7bd01-fc8d-4878-ab1b-8f06a43dea86 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.116216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.117299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.117897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.118773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.119745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.125023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.226112 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3738/7514] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:49 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:49.230278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.241952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19464b6-9bac-4f46-b748-3849124b269e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.317362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.317989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.318269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.318534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.319206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.321449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.421863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3777/7515] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:49 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:49.422646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.435645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8ff2-7eae-4374-b873-1413cbe2e6fb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.440619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.441403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.447215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.447215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.447215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.447215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.460198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3739/7516] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:49.462389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.476680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2d815-d46d-4d3e-ac9d-c3f4459c2913 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.482249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.482914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.483198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.483463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] PATH_INFO: `/v3/projects/4b767889314842b69b623f3c4c9e465b/users/08fe0216d46f4f04b0b268108a4ed1d9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.501797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b767889314842b69b623f3c4c9e465b, user_id=08fe0216d46f4f04b0b268108a4ed1d9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.504490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.591982 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3778/7517] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:49 2022] PUT /identity/v3/projects/4b767889314842b69b623f3c4c9e465b/users/08fe0216d46f4f04b0b268108a4ed1d9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:49.596037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.606645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dba68-d3d9-4de3-b7e8-740423ecebd1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.675114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.678604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.678604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.678604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.678604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.678604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e007209-5d5e-4ef5-acfc-0cd30bedb3af admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.689250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3740/7518] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:49.693510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.705979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad914-0e2a-459a-b865-286d50953a1c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.712027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.712027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.712027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.712320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] PATH_INFO: `/v3/projects/4b767889314842b69b623f3c4c9e465b/users/08fe0216d46f4f04b0b268108a4ed1d9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.714393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b767889314842b69b623f3c4c9e465b, user_id=08fe0216d46f4f04b0b268108a4ed1d9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.717701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:49.740661 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3779/7519] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:49 2022] PUT /identity/v3/projects/4b767889314842b69b623f3c4c9e465b/users/08fe0216d46f4f04b0b268108a4ed1d9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:49.743605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.744655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.745114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.787519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] MFA Rules not processed for user `08fe0216d46f4f04b0b268108a4ed1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:49.788968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:49.854990 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:49.900391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:49.910897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3741/7520] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:49.915696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329d33d-23dc-482b-be7c-2b406a4e222f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:49.921571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:49.922700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:49.923115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:49.924324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:49.925388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:49.929900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:50.057530 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3780/7521] 10.222.0.13 () {60 vars in 1152 bytes} [Sun Oct 30 01:49:49 2022] POST /identity/v3/services => generated 239 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:50.060286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:50.073196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fc7fb-a169-44ee-a34d-938cc402d15f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:50.100184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:50.101110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:50.101589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:50.102037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/e11aaeb160aa4a15a8740412f2b3e0a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:50.102787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e11aaeb160aa4a15a8740412f2b3e0a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:50.104720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:50.225764 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3742/7522] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:50 2022] DELETE /identity/v3/services/e11aaeb160aa4a15a8740412f2b3e0a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:50.228199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:50.244592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74068ed-d4e0-43e0-ada0-5d88711b4a8e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:50.287114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:50.287114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:50.287114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:50.287671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:50.287671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:50.287671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:50.858970 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3781/7523] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:50 2022] POST /identity/v3/services => generated 289 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:50.891716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:50.906398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bcd4-3308-4784-a435-f44741e4dc60 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:50.929986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:50.930919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:50.931375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:50.931850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/4645f8d6676b449fb76f5936da0119d7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:50.932848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:update_service(service_id=4645f8d6676b449fb76f5936da0119d7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:50.934353 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:50.934353 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:49:50.934353 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:49:50.935830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.231561 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3743/7524] 10.222.0.13 () {60 vars in 1252 bytes} [Sun Oct 30 01:49:50 2022] PATCH /identity/v3/services/4645f8d6676b449fb76f5936da0119d7 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:51.235381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.247002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d31e7-95d3-4b69-9c4f-656183abf3e5 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.263552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.263657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.263904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.264129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/4645f8d6676b449fb76f5936da0119d7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.268360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:get_service(service_id=4645f8d6676b449fb76f5936da0119d7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.269729 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:51.269729 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:49:51.269729 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:49:51.270615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.278424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3782/7525] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services/4645f8d6676b449fb76f5936da0119d7 => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:51.284215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.301764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840b2b0-46bb-4c56-b948-b762e725f437 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.310140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.311342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.311724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.312440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/4645f8d6676b449fb76f5936da0119d7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.313145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4645f8d6676b449fb76f5936da0119d7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.315010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.401948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3744/7526] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:51 2022] DELETE /identity/v3/services/4645f8d6676b449fb76f5936da0119d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:51.406793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.416800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9946fb-ffe2-4891-b785-53a3de73216e tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.431779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.432406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.432684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.432954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/4645f8d6676b449fb76f5936da0119d7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.434117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:get_service(service_id=4645f8d6676b449fb76f5936da0119d7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.435704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Could not find service: 4645f8d6676b449fb76f5936da0119d7.: keystone.exception.ServiceNotFound: Could not find service: 4645f8d6676b449fb76f5936da0119d7. Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 4645f8d6676b449fb76f5936da0119d7. Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:49:51.444649 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 30 01:49:51.445813 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.get_or_create( Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application with Lock( Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self._enter() Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.creator() Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application created_value = creator( Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 4645f8d6676b449fb76f5936da0119d7. Oct 30 01:49:51.446879 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:49:51.447957 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3783/7527] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services/4645f8d6676b449fb76f5936da0119d7 => generated 113 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:49:51.451524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.462526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065ba82-f971-4570-aa14-11b4dcd1e4ff tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.467511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.468200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.468708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.468989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.469746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.471743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.550493 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3745/7528] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:51 2022] POST /identity/v3/services => generated 275 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:51.554582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.565281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64506db-2ca0-4e11-985e-8158ad74e257 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.581313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.583219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.583219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.583219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.583553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.584819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.588374 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:51.713626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.713759 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3784/7529] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:51 2022] POST /identity/v3/services => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:51.728116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d632-779c-46e4-91e1-5b1ddd5e5e79 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.745624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.746358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.746695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.747056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.747899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.749815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.855031 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3746/7530] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:51 2022] POST /identity/v3/services => generated 275 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:51.859247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.870846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ad13-61ff-44f8-a277-b4a5c38d8f17 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.899926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.900561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.900847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.901122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.902024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.903792 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:51.903792 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:49:51.903792 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:49:51.904692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.916821 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3785/7531] 10.222.0.13 () {58 vars in 1131 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services => generated 2980 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:51.918242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.930574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a20df-f769-40af-8860-7c2806999ee3 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.935707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.936396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.936752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.937102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.937964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1322933237) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:51.938346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.939423 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:51.939423 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:49:51.939423 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:49:51.940480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.946246 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3747/7532] 10.222.0.13 () {58 vars in 1222 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1322933237 => generated 418 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:51.950873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.961259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18154837-32ba-4881-9549-af32c38d5b20 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.967211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.967880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.968226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.968615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.969305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1821919303) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:51.969774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.971457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:51.978762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3786/7533] 10.222.0.13 () {58 vars in 1222 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1821919303 => generated 418 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:49:51.980918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:51.991056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be55bb-8a3d-4ed8-b053-226f3983a14d tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:51.995711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:51.996342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:51.996605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:51.996882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:51.997534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1537601412) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:51.997841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:51.999505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.004283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3748/7534] 10.222.0.13 () {58 vars in 1222 bytes} [Sun Oct 30 01:49:51 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1537601412 => generated 418 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:52.008148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:52.021393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3390b32-9026-4163-a392-108449bcad2f tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:52.026586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:52.028020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.028409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.028783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/d53559eb0b974080baa6c5a693d66433` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.029530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d53559eb0b974080baa6c5a693d66433)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:52.031253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.111652 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3787/7535] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:52 2022] DELETE /identity/v3/services/d53559eb0b974080baa6c5a693d66433 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:52.115581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:52.126490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09270311-5b0f-403a-988e-3101efba7119 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:52.142537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:52.143342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.143659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.144119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/d70ea70653754c0f880aec99ad6917a5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.144693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d70ea70653754c0f880aec99ad6917a5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:52.146348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.232904 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3749/7536] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:52 2022] DELETE /identity/v3/services/d70ea70653754c0f880aec99ad6917a5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:52.237195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:52.249775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50879ba-aade-4162-b31c-b2700917efdb tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:52.267396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08fe0216d46f4f04b0b268108a4ed1d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b767889314842b69b623f3c4c9e465b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:52.268042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.268323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.268786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] PATH_INFO: `/v3/services/cfaa067b0dbe47e3b31feb641cd554e7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.269322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cfaa067b0dbe47e3b31feb641cd554e7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:52.270951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16703c9c-9699-485d-8bd5-cf121c747df2 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.372075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:52.372162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3788/7537] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:52 2022] DELETE /identity/v3/services/cfaa067b0dbe47e3b31feb641cd554e7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:52.421051 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:52.459711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec50d4c-8c7c-414a-a29c-ce46a70191a4 tempest-ServicesTestJSON-1073448195 tempest-ServicesTestJSON-1073448195-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:52.475976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:52.476882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.477891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.478136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] PATH_INFO: `/v3/users/51a53b8c442d47e1baa01578632f10d9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.479337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a53b8c442d47e1baa01578632f10d9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:52.481927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.609967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a53b8c442d47e1baa01578632f10d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:52.610814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a53b8c442d47e1baa01578632f10d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:52.618984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a53b8c442d47e1baa01578632f10d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:52.619825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a53b8c442d47e1baa01578632f10d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:52.675610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a53b8c442d47e1baa01578632f10d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:52.711552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.712027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.712376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.715705 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3750/7538] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:52 2022] DELETE /identity/v3/users/51a53b8c442d47e1baa01578632f10d9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:52.755274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:52.756820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:52.819710 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3789/7539] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:52.833691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:52.835295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:52.925107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9c438-893a-474a-980f-c471ef4179e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:52.929476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:52.930157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:52.934505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:52.934505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:52.945823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:52.947284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:52.959251 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3751/7540] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:49:53.438144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:53.441560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:53.464155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397a14-d069-431e-8bca-7662b61c0f6b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:53.482470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:53.483140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:53.483424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:53.483693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] PATH_INFO: `/v3/projects/f71ce998ea844649b46cec5082e14ab4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:53.486702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71ce998ea844649b46cec5082e14ab4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:53.488733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:53.647890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71ce998ea844649b46cec5082e14ab4', 'request_id': 'req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:53.744905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71ce998ea844649b46cec5082e14ab4', 'request_id': 'req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:53.755533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71ce998ea844649b46cec5082e14ab4', 'request_id': 'req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:53.764856 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:53.777804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] The token cache is being invalidate because project f71ce998ea844649b46cec5082e14ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:53.778120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:53.779773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:53.782996 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3790/7541] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:53 2022] DELETE /identity/v3/projects/f71ce998ea844649b46cec5082e14ab4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:53.786812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:53.809668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad3336-6ba6-419a-821b-615512413310 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:53.885205 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:53.939399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:53.940187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:53.940860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:53.941322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] PATH_INFO: `/v3/users/08fe0216d46f4f04b0b268108a4ed1d9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:53.944484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fe0216d46f4f04b0b268108a4ed1d9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:53.946503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:54.136090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fe0216d46f4f04b0b268108a4ed1d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:54.137792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fe0216d46f4f04b0b268108a4ed1d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:54.147011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fe0216d46f4f04b0b268108a4ed1d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:54.148070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fe0216d46f4f04b0b268108a4ed1d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:54.195928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f442dd5a-5de4-406f-a6fc-9e64ea04368e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fe0216d46f4f04b0b268108a4ed1d9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:54.219036 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3752/7542] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:53 2022] DELETE /identity/v3/users/08fe0216d46f4f04b0b268108a4ed1d9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:54.686551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:54.689496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:54.761965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcbfc-18ee-4cef-9e64-d1e0c53c092f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:54.959500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:54.960471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:54.960983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:54.961513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] PATH_INFO: `/v3/projects/4b767889314842b69b623f3c4c9e465b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:54.963090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b767889314842b69b623f3c4c9e465b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:54.965471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.125598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b767889314842b69b623f3c4c9e465b', 'request_id': 'req-e691598c-c29c-4323-8cc7-4dc9254a6a3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:55.225164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b767889314842b69b623f3c4c9e465b', 'request_id': 'req-e691598c-c29c-4323-8cc7-4dc9254a6a3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:55.234248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b767889314842b69b623f3c4c9e465b', 'request_id': 'req-e691598c-c29c-4323-8cc7-4dc9254a6a3f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:55.248813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] The token cache is being invalidate because project 4b767889314842b69b623f3c4c9e465b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:55.249101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:55.249802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e691598c-c29c-4323-8cc7-4dc9254a6a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:55.251521 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3791/7543] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:54 2022] DELETE /identity/v3/projects/4b767889314842b69b623f3c4c9e465b => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:55.256432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.256932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.257047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.278108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:55.279304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:55.359896 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3753/7544] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:55.367574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.368106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.368573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.392365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:55.393674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:55.405517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3792/7545] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:55.406765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.417179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1ff8f-6d54-4886-87e8-3e6bec00d09c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.422313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.422995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.423342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.423758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.424475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:49:55.424842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.426560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.444530 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3754/7546] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:55.445791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.456502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4e1d-cb4b-479f-aedb-2519ef68fdb7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.461858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.462582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.463079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.463479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.464202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.466750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.561421 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3793/7547] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:55 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:55.562976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.574427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107729ce-60a9-4fb4-a5c2-50e18ceab5a9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.611679 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:55.637824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.638622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.639054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.639379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.640162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.642496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.768296 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3755/7548] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:55 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:55.772571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.784131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a42441-3531-45ad-9738-a08cb76ccb08 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.788885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.789543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.789822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.790089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.790730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.792307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.803326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3794/7549] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:55.807261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.864671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521c3b-2c2f-4e01-914b-5cd758ba9e60 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.864671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.864671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.864671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.865098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.865098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.865098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cd86e-688f-4f4d-9542-b0b31cec4ea9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:55.865098 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3756/7550] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:55.866795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:55.887800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46579746-e7a0-4266-a3ce-cf7dfb94fcd6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:55.902290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:55.909877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:55.909877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:55.909877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] PATH_INFO: `/v3/projects/4c91f299dd384549803f7133f30a23fa/users/ee16dcf51675475ca2737d9b5aa2c3d4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:55.921024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c91f299dd384549803f7133f30a23fa, user_id=ee16dcf51675475ca2737d9b5aa2c3d4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:55.923731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.013881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3795/7551] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:55 2022] PUT /identity/v3/projects/4c91f299dd384549803f7133f30a23fa/users/ee16dcf51675475ca2737d9b5aa2c3d4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:56.023755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.024145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.024519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.067918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] MFA Rules not processed for user `ee16dcf51675475ca2737d9b5aa2c3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:56.069758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:56.159308 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3757/7552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:56.163865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.192761 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:56.279084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d330d9b-194f-4030-bf4e-bea4d5f2720a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.288947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.289701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.290044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.290383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.291129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.293702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.416542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3796/7553] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:56 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:56.418942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.431536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666f211-abb5-4201-ba49-492c40a58043 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.502892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.503517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.503940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.504224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.504872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.506956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.650981 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3758/7554] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:56 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:56.652645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.663548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03e40-df0f-4a52-90a3-bfc21ca9c968 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.668140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.668690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.668965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.669233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.669895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.671482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.682449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3797/7555] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:49:56.687210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.698205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e381ba-19f0-4908-bf14-6a63e6a564c7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.703388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.704094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.704380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.704654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] PATH_INFO: `/v3/projects/ad472d88faae49c8965e830444cc358e/users/c5f007433942446aa494c6c35ef66660/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.721370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad472d88faae49c8965e830444cc358e, user_id=c5f007433942446aa494c6c35ef66660, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.724277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.853744 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3759/7556] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:56 2022] PUT /identity/v3/projects/ad472d88faae49c8965e830444cc358e/users/c5f007433942446aa494c6c35ef66660/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:56.857808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.870048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b03ddb-012f-4d3f-81ee-84a9184ef259 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.933735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.934320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.934616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.934993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.935639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.937310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e923979-5e26-4dc3-984a-39509f654278 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.949568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3798/7557] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:49:56.953788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:56.964612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209108d-2151-4b3a-9581-aa8d8c0b4b1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:56.969506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:56.970295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:56.970583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:56.970851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] PATH_INFO: `/v3/projects/ad472d88faae49c8965e830444cc358e/users/c5f007433942446aa494c6c35ef66660/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:56.972742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad472d88faae49c8965e830444cc358e, user_id=c5f007433942446aa494c6c35ef66660, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:56.976014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:56.979539 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:56.987671 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3760/7558] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:56 2022] PUT /identity/v3/projects/ad472d88faae49c8965e830444cc358e/users/c5f007433942446aa494c6c35ef66660/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:57.000842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.012046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.012046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.033540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] MFA Rules not processed for user `c5f007433942446aa494c6c35ef66660`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:57.034752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:57.109232 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3799/7559] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:57.114235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:57.131974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718b642-691b-4bc8-bc43-67da9d7d8d24 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:57.137294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:57.137957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.138261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.138540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.139176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:57.141038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:57.327484 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3761/7560] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:57 2022] POST /identity/v3/projects => generated 359 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:57.331245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:57.341597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ce0b3-6f49-47e9-b320-8d0bdb9a3f7f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:57.355926 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:57.412263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:57.413030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.413309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.413615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.414266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:57.416089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:57.549826 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3800/7561] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:57 2022] POST /identity/v3/users => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:57.554570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:57.567694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ab4a2-ff60-454b-8b33-7c2a15e0c2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:57.573638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:57.574354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.574729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.575012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/80345ad2a12a4882b911a1604f8f7efa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.591100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_user(user_id=80345ad2a12a4882b911a1604f8f7efa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:57.593289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:57.595445 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3762/7562] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:49:57 2022] GET /identity/v3/users/80345ad2a12a4882b911a1604f8f7efa => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:57.599932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:57.612148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a4c54-bf27-4055-9a4a-5f6df905d12b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:57.616802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:57.617485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.617764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.618037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/80345ad2a12a4882b911a1604f8f7efa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.619182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=80345ad2a12a4882b911a1604f8f7efa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:57.621315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:57.716709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80345ad2a12a4882b911a1604f8f7efa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:57.807113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80345ad2a12a4882b911a1604f8f7efa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:57.807955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80345ad2a12a4882b911a1604f8f7efa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:57.822156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80345ad2a12a4882b911a1604f8f7efa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:57.829646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80345ad2a12a4882b911a1604f8f7efa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:57.837761 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3801/7563] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:57 2022] DELETE /identity/v3/users/80345ad2a12a4882b911a1604f8f7efa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:57.842509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:57.845280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:57.896570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edcc54-0ffd-49fe-941b-1dbd72b86d19 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:57.955005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:57.955631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:57.955913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:57.956185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/f206349ae84e44b1bf2023b94633ddc1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:57.957302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f206349ae84e44b1bf2023b94633ddc1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:57.959329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.023242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.024891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:58.094772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca21ba-876a-49cf-8f88-7771be9a1184 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.100061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.100741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.101046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.101414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] PATH_INFO: `/v3/users/ea290cfe7c1544188e5aad17c7c2b592` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.102589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea290cfe7c1544188e5aad17c7c2b592)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.104738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.136027 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:58.143416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f206349ae84e44b1bf2023b94633ddc1', 'request_id': 'req-56e1ee3c-5cbc-4624-8920-5fba69b19d62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.150429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f206349ae84e44b1bf2023b94633ddc1', 'request_id': 'req-56e1ee3c-5cbc-4624-8920-5fba69b19d62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.241773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f206349ae84e44b1bf2023b94633ddc1', 'request_id': 'req-56e1ee3c-5cbc-4624-8920-5fba69b19d62'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.256499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] The token cache is being invalidate because project f206349ae84e44b1bf2023b94633ddc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:58.256831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.257711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.259691 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3763/7564] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:57 2022] DELETE /identity/v3/projects/f206349ae84e44b1bf2023b94633ddc1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:58.265199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.266727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:58.327479 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:58.343270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1ee3c-5cbc-4624-8920-5fba69b19d62 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.348612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.349255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.349654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.350137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.350837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.352753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.388423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea290cfe7c1544188e5aad17c7c2b592'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.470390 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3764/7565] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:58 2022] POST /identity/v3/projects => generated 359 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:58.474765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.517057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea290cfe7c1544188e5aad17c7c2b592'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.518190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea290cfe7c1544188e5aad17c7c2b592'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.539636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea290cfe7c1544188e5aad17c7c2b592'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.552342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6c394f04-e7f9-451d-9dfb-e6d615edabc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea290cfe7c1544188e5aad17c7c2b592'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:58.556622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f536fb-cf5e-453f-8a59-c7d852f414cf tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.560965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.561869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.562226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.562586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.566312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.566312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.567117 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3802/7566] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:58 2022] DELETE /identity/v3/users/ea290cfe7c1544188e5aad17c7c2b592 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:58.569068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.569565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.570000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.594811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:49:58.596400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:58.660292 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3765/7567] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:49:58 2022] POST /identity/v3/users => generated 417 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:58.662074 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3803/7568] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:49:58.664284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.666438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:58.672651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.674106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:58.684580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b864a-04b1-4e8c-bd03-98868d456a40 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.746757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2828e2-d3f8-44cb-aa21-9d02c31c2eb4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.754080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.755051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.755547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.756143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.761147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.761851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.762267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.762432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.763335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.765247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.771072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.773547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.785690 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3804/7569] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:49:58.859219 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3766/7570] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:49:58 2022] POST /identity/v3/roles => generated 239 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:58.860507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.872498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15f6e-9366-4893-9d71-fcde4555eae1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.884342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.885459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.886023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.886430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/22d5ac2b48f040f8b0ac033e2645d706` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.918276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_user(user_id=22d5ac2b48f040f8b0ac033e2645d706)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.922366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.925377 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3805/7571] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:49:58 2022] GET /identity/v3/users/22d5ac2b48f040f8b0ac033e2645d706 => generated 417 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:58.928278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.940648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718e479-4a1d-436a-8ab7-44620bf81cea tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.945299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.945960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.946244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.946519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/roles/85e85291e5c441cd88d43e267b31d593` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.947993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_role(role_id=85e85291e5c441cd88d43e267b31d593)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.949039 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:49:58.949039 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:49:58.949039 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:49:58.950001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:58.951504 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3767/7572] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:49:58 2022] GET /identity/v3/roles/85e85291e5c441cd88d43e267b31d593 => generated 239 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:58.955639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:58.967154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5108-6322-404d-be62-54a423bca79c tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:58.971989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:58.972575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:58.973120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:58.973421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:58.974052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:58.975878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.092552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.094162 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3806/7573] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:58 2022] POST /identity/v3/projects => generated 359 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:49:59.104708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609482a7-5722-4321-a41f-577bcaab83cb tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.159505 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:59.171528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.172115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.172480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.172761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.173915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_project(project_id=f1e9ee9fec484bb787ff5d2bcd831748)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.176021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.178573 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3768/7574] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:49:59 2022] GET /identity/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748 => generated 359 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:59.183299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.189115 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:59.195250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eff7ed-29a9-411a-af20-5c13b72b66e2 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.200372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.201014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.201379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.201669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748/users/22d5ac2b48f040f8b0ac033e2645d706/roles/85e85291e5c441cd88d43e267b31d593` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.203915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f1e9ee9fec484bb787ff5d2bcd831748, user_id=22d5ac2b48f040f8b0ac033e2645d706, role_id=85e85291e5c441cd88d43e267b31d593)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.206830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.295146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.297393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:59.300023 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3807/7575] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:59 2022] PUT /identity/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748/users/22d5ac2b48f040f8b0ac033e2645d706/roles/85e85291e5c441cd88d43e267b31d593 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:49:59.306031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.377286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae758b-e522-4fcf-a961-a7fbb05bef56 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.379072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78c212-05a1-47a2-a4f4-a99c074e033a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.382413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.383154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.383507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.383845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.384537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.387173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.439867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.440623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.440958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.441293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] PATH_INFO: `/v3/projects/4856da35f10e449eb3037015d6454107` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.442555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4856da35f10e449eb3037015d6454107)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.446609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.482424 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3808/7576] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:49:59 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:49:59.485119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.554099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a86aec-20ad-415f-ba05-cadd80569ffe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.559191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.559946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.560105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.560373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/24347d4659274e10b4a8d45da76fcfed` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.561770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_project(project_id=24347d4659274e10b4a8d45da76fcfed)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.563995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.565854 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3809/7577] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:49:59 2022] GET /identity/v3/projects/24347d4659274e10b4a8d45da76fcfed => generated 359 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:59.570188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.586098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a648a9-21ae-445a-b23f-3b3fdeb0c3da tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.592385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.593121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.593415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.593695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/24347d4659274e10b4a8d45da76fcfed/users/22d5ac2b48f040f8b0ac033e2645d706/roles/85e85291e5c441cd88d43e267b31d593` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.595951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_grant(project_id=24347d4659274e10b4a8d45da76fcfed, user_id=22d5ac2b48f040f8b0ac033e2645d706, role_id=85e85291e5c441cd88d43e267b31d593)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.599070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.695768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3810/7578] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:49:59 2022] PUT /identity/v3/projects/24347d4659274e10b4a8d45da76fcfed/users/22d5ac2b48f040f8b0ac033e2645d706/roles/85e85291e5c441cd88d43e267b31d593 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:59.696752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.706677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4856da35f10e449eb3037015d6454107', 'request_id': 'req-39a41133-8703-46c3-8cff-15626259ad0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:59.713828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4856da35f10e449eb3037015d6454107', 'request_id': 'req-39a41133-8703-46c3-8cff-15626259ad0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:59.767073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6646b5-7ebb-4224-b536-dc318bfdc2e8 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.774981 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:59.813738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4856da35f10e449eb3037015d6454107', 'request_id': 'req-39a41133-8703-46c3-8cff-15626259ad0e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:59.827546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] The token cache is being invalidate because project 4856da35f10e449eb3037015d6454107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:49:59.827835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:59.828626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:49:59.830273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3769/7579] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:59 2022] DELETE /identity/v3/projects/4856da35f10e449eb3037015d6454107 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:49:59.831715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.832462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.832927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.833527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/22d5ac2b48f040f8b0ac033e2645d706/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.835751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=22d5ac2b48f040f8b0ac033e2645d706)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.839649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.842437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.844257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:59.895830 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3811/7580] 10.222.0.13 () {58 vars in 1248 bytes} [Sun Oct 30 01:49:59 2022] GET /identity/v3/users/22d5ac2b48f040f8b0ac033e2645d706/projects => generated 842 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:49:59.895830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:49:59.898779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:49:59.904663 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:49:59.914135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae70d9-ac15-4969-a4ff-c75682b8b75b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.920785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.921458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.921746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.922019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/24347d4659274e10b4a8d45da76fcfed` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.923343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24347d4659274e10b4a8d45da76fcfed)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.925241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:49:59.940261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41133-8703-46c3-8cff-15626259ad0e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:49:59.945690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:49:59.946461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:49:59.946729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:49:59.946953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] PATH_INFO: `/v3/users/34e4c373f0e94c3ea47c05a1aecdf33a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:49:59.950209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e4c373f0e94c3ea47c05a1aecdf33a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:49:59.951317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:00.164185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e4c373f0e94c3ea47c05a1aecdf33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.164843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e4c373f0e94c3ea47c05a1aecdf33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.172678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e4c373f0e94c3ea47c05a1aecdf33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.173326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e4c373f0e94c3ea47c05a1aecdf33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.327106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e4c373f0e94c3ea47c05a1aecdf33a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.341549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24347d4659274e10b4a8d45da76fcfed', 'request_id': 'req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.347495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3770/7581] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:49:59 2022] DELETE /identity/v3/users/34e4c373f0e94c3ea47c05a1aecdf33a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:00.441407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24347d4659274e10b4a8d45da76fcfed', 'request_id': 'req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.448633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24347d4659274e10b4a8d45da76fcfed', 'request_id': 'req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.459273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] The token cache is being invalidate because project 24347d4659274e10b4a8d45da76fcfed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:00.459566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.460314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.461914 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3812/7582] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:49:59 2022] DELETE /identity/v3/projects/24347d4659274e10b4a8d45da76fcfed => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:00.466618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:00.468093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:00.535813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a260cba-1a7e-467a-a1b0-08a5636ea011 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:00.540542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:00.541175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:00.541493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:00.546402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:00.546402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1e9ee9fec484bb787ff5d2bcd831748)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:00.546402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:00.816046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e9ee9fec484bb787ff5d2bcd831748', 'request_id': 'req-162e3e74-c040-49cb-820c-197f3da1b50a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.819907 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:00.822054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e9ee9fec484bb787ff5d2bcd831748', 'request_id': 'req-162e3e74-c040-49cb-820c-197f3da1b50a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.853776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:00.855152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:00.922516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e9ee9fec484bb787ff5d2bcd831748', 'request_id': 'req-162e3e74-c040-49cb-820c-197f3da1b50a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.930556 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:00.935215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] The token cache is being invalidate because project f1e9ee9fec484bb787ff5d2bcd831748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:00.935522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.936220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:00.938034 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3771/7583] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:00 2022] DELETE /identity/v3/projects/f1e9ee9fec484bb787ff5d2bcd831748 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:00.938607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:00.940046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:00.950345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d560a-1ba1-4031-b92c-c86fb5d3bd6a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.018572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3e74-c040-49cb-820c-197f3da1b50a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.022107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.022784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.023050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.028671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.028791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.028791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.028791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.028989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.029068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] PATH_INFO: `/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.029068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a90e4b4bb845ad8e7b1bcd3e64e86b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.029068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.091184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.092677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.113149 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3813/7584] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:01.113975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.115284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.185728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34136-dcb5-4b2a-9728-d946cac8cd7b service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.190656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.191287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.191571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.191847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/roles/85e85291e5c441cd88d43e267b31d593` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.193319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_role(role_id=85e85291e5c441cd88d43e267b31d593)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.195119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.223004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a90e4b4bb845ad8e7b1bcd3e64e86b', 'request_id': 'req-c124a9f5-3555-4a15-ae70-d71f0c084fef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.230397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a90e4b4bb845ad8e7b1bcd3e64e86b', 'request_id': 'req-c124a9f5-3555-4a15-ae70-d71f0c084fef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.327414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a90e4b4bb845ad8e7b1bcd3e64e86b', 'request_id': 'req-c124a9f5-3555-4a15-ae70-d71f0c084fef'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.333291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invalidating the token cache because role 85e85291e5c441cd88d43e267b31d593 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:01.333858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.334792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.337952 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3814/7585] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:01 2022] DELETE /identity/v3/roles/85e85291e5c441cd88d43e267b31d593 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:01.341656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.344338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] The token cache is being invalidate because project 04a90e4b4bb845ad8e7b1bcd3e64e86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:01.344476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.344895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.345701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c124a9f5-3555-4a15-ae70-d71f0c084fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.348376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3772/7586] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:00 2022] DELETE /identity/v3/projects/04a90e4b4bb845ad8e7b1bcd3e64e86b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:01.355930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfa9-27b5-44a3-b718-2f97bb00adbd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.356247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfa9-27b5-44a3-b718-2f97bb00adbd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.356518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3cfa9-27b5-44a3-b718-2f97bb00adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.377306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-06b3cfa9-27b5-44a3-b718-2f97bb00adbd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:01.378536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-06b3cfa9-27b5-44a3-b718-2f97bb00adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.413133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f86e-2fc4-4d6a-bfff-bdf8677f8fbe tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.418561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.419194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.419481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.419760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/22d5ac2b48f040f8b0ac033e2645d706` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.420934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=22d5ac2b48f040f8b0ac033e2645d706)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.422937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.446575 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3773/7587] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:01.454978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.455338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.455618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.475845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:01.477100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.485745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3774/7588] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:01.489872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.499548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff18f0-f5f1-449e-86da-e91285f4c912 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.504176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.504815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.505091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.505537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.506036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:01.506332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.507932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.509487 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:01.520901 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3775/7589] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:50:01.525193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.542119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9193a-6bf9-4a9f-97a4-32bd2b9bf799 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.547334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.548584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.548584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.548584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.549260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.551116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.607291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d5ac2b48f040f8b0ac033e2645d706'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.687070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d5ac2b48f040f8b0ac033e2645d706'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.689090 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:01.689692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d5ac2b48f040f8b0ac033e2645d706'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.696401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3776/7590] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:01 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:01.699014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.700696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.704264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d5ac2b48f040f8b0ac033e2645d706'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.712522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d5ac2b48f040f8b0ac033e2645d706'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:01.718738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3815/7591] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:01 2022] DELETE /identity/v3/users/22d5ac2b48f040f8b0ac033e2645d706 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:01.723048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.725144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:01.770377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39689951-f5ed-4c54-aa27-7ec05a3591d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.811573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2930cf-652d-447b-a8e5-39389685dc36 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.811573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.812475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.812655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.812902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/b7a7f680ca9447de8be8689564d77532` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.817134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7a7f680ca9447de8be8689564d77532)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.817134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.857530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:01.858176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:01.858414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:01.858722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:01.859295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:01.861435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:01.971180 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3777/7592] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:01 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:01.972394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:01.989232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759f5ce-b696-446f-a39c-f4d4b3edc78d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:01.991430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a7f680ca9447de8be8689564d77532', 'request_id': 'req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.050576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.051833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.052720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.052720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.054042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.056711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.068508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3778/7593] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:02.072195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.075299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a7f680ca9447de8be8689564d77532', 'request_id': 'req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.085377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a7f680ca9447de8be8689564d77532', 'request_id': 'req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.088412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f122d-3ddb-4c3d-a6f8-05b40d370864 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.094984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.095759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.096044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.096341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.096963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.098876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.099400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] The token cache is being invalidate because project b7a7f680ca9447de8be8689564d77532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:02.099899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.100827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.102765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3816/7594] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:01 2022] DELETE /identity/v3/projects/b7a7f680ca9447de8be8689564d77532 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:02.109492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.111150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.112202 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3779/7595] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:50:02.116558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.118375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.133946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62883-ecae-42ec-8687-76418f707a3c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.139491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.145821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.145821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.145821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] PATH_INFO: `/v3/projects/ea9da1306e4b49dfa601180e77b927da/users/8d1a93a19edb4ee3961bed4d79c3f4c9/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.159813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9da1306e4b49dfa601180e77b927da, user_id=8d1a93a19edb4ee3961bed4d79c3f4c9, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.162543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.184084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b9ec0-1c7e-48b0-81c7-0488281abd0e tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.189360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.190119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.190466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.190808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.192121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee16dcf51675475ca2737d9b5aa2c3d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.194146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.253498 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3780/7596] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:02 2022] PUT /identity/v3/projects/ea9da1306e4b49dfa601180e77b927da/users/8d1a93a19edb4ee3961bed4d79c3f4c9/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:02.254774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.260302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.335311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.336082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c8f65-32a6-4093-951e-add888445c3e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.341022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.341716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.341997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.342272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.344138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.358825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.360768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae04828-2202-42b5-8ab7-50dca441187a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.362109 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:02.372975 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3781/7597] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:02.374525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.374824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.375327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.414233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] MFA Rules not processed for user `8d1a93a19edb4ee3961bed4d79c3f4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:02.417885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.486910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invalidating the token cache because user ee16dcf51675475ca2737d9b5aa2c3d4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:02.487252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.488020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f2b728f1-747c-427e-9ad0-de473b3ad248 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:02.491546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3817/7598] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:50:02 2022] PATCH /identity/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4 => generated 296 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:02.502627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.502910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.503164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.508611 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3782/7599] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:02.521555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.522882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.588012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] MFA Rules not processed for user `ee16dcf51675475ca2737d9b5aa2c3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:02.590241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.595740 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:02.600816 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3818/7600] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:02 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:50:02.609983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.609983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.681003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8927ac-0ea8-4c84-abab-e294cb01a35d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.694138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.695411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.695903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.707372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.713326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.732016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0da22-eebc-48dc-b7d8-4ac12f928db4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.743821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.745994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.760091 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3783/7601] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:02.762167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.762848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.763134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.763412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.774841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee16dcf51675475ca2737d9b5aa2c3d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.777492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.785885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:02.787879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:02.875724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e26b4-647d-4d8d-a7e1-5c6c33683c1d service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:02.891211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:02.892141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:02.892863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:02.893406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] PATH_INFO: `/v3/users/8d1a93a19edb4ee3961bed4d79c3f4c9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:02.894777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1a93a19edb4ee3961bed4d79c3f4c9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:02.897140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:02.916948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.104084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invalidating the token cache because user ee16dcf51675475ca2737d9b5aa2c3d4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:03.105172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.106736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.115302 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3819/7602] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:50:02 2022] PATCH /identity/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4 => generated 296 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:03.118152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:03.124874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:03.147108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471d356-d231-42fc-a107-eea72a9e40a7 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:03.154752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:03.178687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.178687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.178687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.178687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee16dcf51675475ca2737d9b5aa2c3d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:03.178687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:03.347416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.358991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1a93a19edb4ee3961bed4d79c3f4c9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.359645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1a93a19edb4ee3961bed4d79c3f4c9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.366488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1a93a19edb4ee3961bed4d79c3f4c9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.367095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1a93a19edb4ee3961bed4d79c3f4c9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.524453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invalidating the token cache because user ee16dcf51675475ca2737d9b5aa2c3d4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:03.524920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.525641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-01772877-8e7d-45b5-abf5-2fc175ff5bb3 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.527655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3820/7603] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:50:03 2022] PATCH /identity/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4 => generated 296 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:03.531972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.532623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.533109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.572132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] MFA Rules not processed for user `ee16dcf51675475ca2737d9b5aa2c3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:03.573426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:03.577569 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3821/7604] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:03 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 30 01:50:03.581742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:03.582992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:03.598744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3082baf-a4d6-441e-a6f7-de2236fd91f4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:03.603559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:03.604197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.604513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.604872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.606098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:update_user(user_id=ee16dcf51675475ca2737d9b5aa2c3d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:03.608083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:03.635466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7837787b-e621-4457-876a-bf9da1ecec78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1a93a19edb4ee3961bed4d79c3f4c9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.655477 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3784/7605] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:02 2022] DELETE /identity/v3/users/8d1a93a19edb4ee3961bed4d79c3f4c9 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:03.660202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.660530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.660809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.681411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:03.683231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:03.754634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3785/7606] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:03.754781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.770606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:03.772072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:03.833081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e6e87-ebff-4109-ad64-9be01e03d897 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:03.836608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:03.837208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.837519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.837792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.847519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:03.849202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:03.860475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3786/7607] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:03.869959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invalidating the token cache because user ee16dcf51675475ca2737d9b5aa2c3d4 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:03.870895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.871599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:03.873857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3822/7608] 10.222.0.13 () {60 vars in 1243 bytes} [Sun Oct 30 01:50:03 2022] PATCH /identity/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4 => generated 296 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:50:03.882472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:03.924185 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:03.947597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb8fe7-1694-4e29-8dc6-8290542085b5 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:03.953268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:03.953957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:03.954407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:03.954690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:03.955318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:03.957175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:04.130868 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3787/7609] 10.222.0.13 () {60 vars in 1143 bytes} [Sun Oct 30 01:50:03 2022] POST /identity/v3/users => generated 264 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:04.135501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:04.137235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:04.153049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cea33-0c1d-414a-a0fa-4996fa676543 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:04.158772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef299a6-57d2-4275-abfd-ca72a7c19520 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:04.159761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef299a6-57d2-4275-abfd-ca72a7c19520 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.159761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef299a6-57d2-4275-abfd-ca72a7c19520 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.166735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef299a6-57d2-4275-abfd-ca72a7c19520 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/220349a9a4c04ee4accf61348c6ac0c7/password` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.275948 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:04.326339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4ef299a6-57d2-4275-abfd-ca72a7c19520 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.392121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:04.394601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:04.411508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476f80b-3fc2-4fde-871d-dd00df932b34 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:04.416640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:04.417917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.418201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.418913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] PATH_INFO: `/v3/projects/ea9da1306e4b49dfa601180e77b927da` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.419761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9da1306e4b49dfa601180e77b927da)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:04.422255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:04.430616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3823/7610] 10.222.0.13 () {60 vars in 1269 bytes} [Sun Oct 30 01:50:04 2022] POST /identity/v3/users/220349a9a4c04ee4accf61348c6ac0c7/password => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:04.555808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9da1306e4b49dfa601180e77b927da', 'request_id': 'req-9966cb23-d010-4a4f-9267-2d3e4379b0be'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.562050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9da1306e4b49dfa601180e77b927da', 'request_id': 'req-9966cb23-d010-4a4f-9267-2d3e4379b0be'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.663966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9da1306e4b49dfa601180e77b927da', 'request_id': 'req-9966cb23-d010-4a4f-9267-2d3e4379b0be'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.677756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] The token cache is being invalidate because project ea9da1306e4b49dfa601180e77b927da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:04.678050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.678842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9966cb23-d010-4a4f-9267-2d3e4379b0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:04.680412 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3788/7611] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:04 2022] DELETE /identity/v3/projects/ea9da1306e4b49dfa601180e77b927da => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:04.686122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.686583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.686689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.706470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:04.707657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:04.770320 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3824/7612] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:04.778870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.780081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.780469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.804617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:04.805941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:04.816470 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3789/7613] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:04.827763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:04.837722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa368f-7440-4e04-acd0-bb2adf924003 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:04.843111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:04.843723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.844005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.844304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.844958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:04.845260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:04.846888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:04.863034 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3825/7614] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:04.867969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:04.878431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dfd6-8c93-4181-8723-946d2eb80391 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:04.883883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:04.884540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:04.884823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:04.885098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:04.885787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:04.887698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.019999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3790/7615] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:04 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:05.027666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.043613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6e6d2-ab36-4307-8b52-8955340d04f7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.103661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.104251 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:05.104364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.105308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.105620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.106264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.108264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.241439 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3826/7616] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:05 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:05.246100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.259018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4afacc-8aa4-4491-ab18-6558141ee778 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.265668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.266320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.266653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.266940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.271851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.271851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.290096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3791/7617] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:05.291411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.302749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14c64-4ccf-4f7f-8727-959641c9ca17 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.309502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.310264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.310787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.311066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.311733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.313733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b82a19-5f8f-4a3b-b824-eaef6a203879 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.327384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3827/7618] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:50:05.331296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.343334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c0b89-0e61-401d-aec5-8c9aca594dcf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.348707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.350102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.350389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.350695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] PATH_INFO: `/v3/projects/405027d986cb4be68bdd907752b9e5fd/users/d5feb71640df423da5cd384ca7ecf212/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.368607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405027d986cb4be68bdd907752b9e5fd, user_id=d5feb71640df423da5cd384ca7ecf212, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.372115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95130e18-8d0e-4b9c-b2fc-c5ab4096e619 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.436494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.436861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.437312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.457644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] MFA Rules not processed for user `220349a9a4c04ee4accf61348c6ac0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:05.458782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:05.462270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3828/7619] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:05 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 30 01:50:05.466398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.467732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:05.539474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3792/7620] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:05 2022] PUT /identity/v3/projects/405027d986cb4be68bdd907752b9e5fd/users/d5feb71640df423da5cd384ca7ecf212/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:05.539649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b0b81-17aa-4d2e-9cbf-24405e3766a0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.541665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.543099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.543459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.578208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] MFA Rules not processed for user `d5feb71640df423da5cd384ca7ecf212`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:05.580394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:05.620170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.621965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.622517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.622925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.631867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.635421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.646226 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3829/7621] 10.222.0.13 () {56 vars in 1263 bytes} [Sun Oct 30 01:50:05 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 30 01:50:05.651253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.664674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9453d-1ddf-4a19-8112-5af3d62456be tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.671101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.672091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.672601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.673242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/220349a9a4c04ee4accf61348c6ac0c7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.677473 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3793/7622] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:05.678508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=220349a9a4c04ee4accf61348c6ac0c7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.680565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.685966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:05.688702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:05.761979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f7050-bfbf-491f-b942-c7a383aaf823 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:05.765813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:05.766536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:05.766888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:05.767240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:05.777163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:05.778853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:05.788302 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3794/7623] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:05.881443 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:UPDATE=4,keystone:INSERT=8,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:05.888450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:05.989921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:05.990800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:06.006104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:06.013830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220349a9a4c04ee4accf61348c6ac0c7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:06.021619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3830/7624] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:05 2022] DELETE /identity/v3/users/220349a9a4c04ee4accf61348c6ac0c7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:06.029381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:06.041074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32636a-3da3-4445-a26a-07933e6db951 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:06.049433 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:06.103812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:06.105092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:06.105268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:06.105633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:06.106265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:06.109445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:06.287667 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3795/7625] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:06 2022] POST /identity/v3/users => generated 367 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:06.294371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:06.299954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:06.333009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1d46-bc02-4568-ae4c-8602cdda9d57 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:06.338552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:06.341830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:06.342376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:06.342832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:06.344576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:06.349141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:06.481436 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3831/7626] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:06 2022] POST /identity/v3/projects => generated 360 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:06.485970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:06.497175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7f7c-f7af-40a4-b7b1-7db4a55a102a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:06.556718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:06.557276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:06.557648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:06.557932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/c21e2d81faf24738889dd31a6fd80279` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:06.573431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:update_user(user_id=c21e2d81faf24738889dd31a6fd80279)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:06.574623 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:50:06.574623 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:50:06.574623 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:50:06.575851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:06.743099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:06.747844 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3796/7627] 10.222.0.13 () {60 vars in 1244 bytes} [Sun Oct 30 01:50:06 2022] PATCH /identity/v3/users/c21e2d81faf24738889dd31a6fd80279 => generated 522 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:50:06.770566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574790a8-3507-46e2-a819-0703d7a2a12a tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:06.777047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:06.777750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:06.780157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:06.780446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/c21e2d81faf24738889dd31a6fd80279` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:06.808243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:get_user(user_id=c21e2d81faf24738889dd31a6fd80279)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:06.812176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:06.820136 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3832/7628] 10.222.0.13 () {58 vars in 1221 bytes} [Sun Oct 30 01:50:06 2022] GET /identity/v3/users/c21e2d81faf24738889dd31a6fd80279 => generated 389 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:50:06.823884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:06.835877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd20b-f59b-46f8-9113-80d5b3d6818d tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:06.841985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:06.842636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:06.842918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:06.843199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/projects/0254fbb3c3b4421f9b30b4d37f566000` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:06.844453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0254fbb3c3b4421f9b30b4d37f566000)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:06.847033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:06.917001 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:06.962439 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:07.032628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0254fbb3c3b4421f9b30b4d37f566000', 'request_id': 'req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.038171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0254fbb3c3b4421f9b30b4d37f566000', 'request_id': 'req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.116391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0254fbb3c3b4421f9b30b4d37f566000', 'request_id': 'req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.132817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] The token cache is being invalidate because project 0254fbb3c3b4421f9b30b4d37f566000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:07.133116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.134201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.137369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3797/7629] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:06 2022] DELETE /identity/v3/projects/0254fbb3c3b4421f9b30b4d37f566000 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:07.142455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:07.145413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:07.162673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bc99d-45b7-4d6c-bb7a-1ff901500072 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:07.243202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5f007433942446aa494c6c35ef66660', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad472d88faae49c8965e830444cc358e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:07.243974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:07.244457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:07.244826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] PATH_INFO: `/v3/users/c21e2d81faf24738889dd31a6fd80279` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:07.246982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c21e2d81faf24738889dd31a6fd80279)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:07.249180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:07.298187 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:07.452524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21e2d81faf24738889dd31a6fd80279'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.527380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21e2d81faf24738889dd31a6fd80279'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.528874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21e2d81faf24738889dd31a6fd80279'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.543061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21e2d81faf24738889dd31a6fd80279'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.551529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bce34ad7-d205-4476-b1e5-2f5daf0a0025 tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21e2d81faf24738889dd31a6fd80279'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.564645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3833/7630] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:07 2022] DELETE /identity/v3/users/c21e2d81faf24738889dd31a6fd80279 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:07.565670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:07.567775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:07.627531 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:07.656640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202e6c8-5cc5-4cc2-85a4-f6b1397f5f8b tempest-UsersV3TestJSON-509519927 tempest-UsersV3TestJSON-509519927-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:07.724688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:07.725259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:07.725634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:07.725911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] PATH_INFO: `/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:07.743332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee16dcf51675475ca2737d9b5aa2c3d4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:07.745765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:07.983366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:07.985377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:08.003029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:08.004266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:08.081941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee16dcf51675475ca2737d9b5aa2c3d4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:08.116484 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3798/7631] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:07 2022] DELETE /identity/v3/users/ee16dcf51675475ca2737d9b5aa2c3d4 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:08.117214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:08.117699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:08.117819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:08.142238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:08.143587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:08.257616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3834/7632] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:08.265006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:08.266482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:08.353257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc501221-d4b7-4f65-8f6a-d0dbcc1ee926 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:08.357490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:08.358212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:08.359314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:08.359676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:08.369991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:08.372173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:08.387454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3799/7633] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:08.849245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:08.851080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:08.868199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05890a-13ae-4583-a77b-ce5ab88fbcb1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:08.888988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:08.889667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:08.898892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:08.899269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] PATH_INFO: `/v3/projects/4c91f299dd384549803f7133f30a23fa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:08.900672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c91f299dd384549803f7133f30a23fa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:08.903661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:09.039620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c91f299dd384549803f7133f30a23fa', 'request_id': 'req-c7c4f208-173c-4aef-a98b-c18d4a3024ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.110205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c91f299dd384549803f7133f30a23fa', 'request_id': 'req-c7c4f208-173c-4aef-a98b-c18d4a3024ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.119414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c91f299dd384549803f7133f30a23fa', 'request_id': 'req-c7c4f208-173c-4aef-a98b-c18d4a3024ec'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.132908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] The token cache is being invalidate because project 4c91f299dd384549803f7133f30a23fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:09.133201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.133959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.138524 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3835/7634] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:08 2022] DELETE /identity/v3/projects/4c91f299dd384549803f7133f30a23fa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:09.141327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:09.149365 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:09.154446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b221f-6b57-4b8d-94fa-004087623ab6 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:09.220917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:09.221759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:09.222045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:09.222322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] PATH_INFO: `/v3/users/c5f007433942446aa494c6c35ef66660` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:09.223834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f007433942446aa494c6c35ef66660)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:09.226270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:09.486089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f007433942446aa494c6c35ef66660'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.486759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f007433942446aa494c6c35ef66660'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.494466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f007433942446aa494c6c35ef66660'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.495626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f007433942446aa494c6c35ef66660'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.606782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb9c2679-0e07-4956-9f64-39128257cde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f007433942446aa494c6c35ef66660'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:09.652931 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3800/7635] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:09 2022] DELETE /identity/v3/users/c5f007433942446aa494c6c35ef66660 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:10.188777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:10.190428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:10.205964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f208-173c-4aef-a98b-c18d4a3024ec admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:10.242690 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:10.291896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:10.292649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:10.292929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:10.293202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] PATH_INFO: `/v3/projects/ad472d88faae49c8965e830444cc358e` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:10.294364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad472d88faae49c8965e830444cc358e)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:10.296266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:10.469967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad472d88faae49c8965e830444cc358e', 'request_id': 'req-59f205e5-289b-44dd-b1f3-08a54d56fbcc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:10.567395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad472d88faae49c8965e830444cc358e', 'request_id': 'req-59f205e5-289b-44dd-b1f3-08a54d56fbcc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:10.576276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad472d88faae49c8965e830444cc358e', 'request_id': 'req-59f205e5-289b-44dd-b1f3-08a54d56fbcc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:10.591227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] The token cache is being invalidate because project ad472d88faae49c8965e830444cc358e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:10.591227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:10.591227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-59f205e5-289b-44dd-b1f3-08a54d56fbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:10.593274 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3836/7636] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:10 2022] DELETE /identity/v3/projects/ad472d88faae49c8965e830444cc358e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:10.599573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:10.600354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:10.600800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:10.624217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:10.625967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:10.743386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3801/7637] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:10.752328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c41bc1-4b52-480b-a500-51244646850a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:10.752615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c41bc1-4b52-480b-a500-51244646850a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:10.753028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c41bc1-4b52-480b-a500-51244646850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:10.776116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-52c41bc1-4b52-480b-a500-51244646850a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:10.778050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-52c41bc1-4b52-480b-a500-51244646850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:10.788194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3837/7638] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:10.792560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:10.804195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95544182-644e-4457-ae1f-b94fc6eda739 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:10.827057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:10.830003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:10.830713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:10.831948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:10.832839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:10.834952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:10.842410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:10.870900 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3802/7639] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:50:10.879840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c41bc1-4b52-480b-a500-51244646850a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:10.899755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c41bc1-4b52-480b-a500-51244646850a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:10.908561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:10.909305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:10.909617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:10.910099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:10.910904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:10.914537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.033471 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3838/7640] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:10 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:11.036912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.054719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02c76-d78c-4f1b-ad71-0717e90280cd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.060547 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:11.129671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.130319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.130611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.130885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.131595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.133667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.217383 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3803/7641] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:11 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:11.218671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.232566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef1f29-1d31-47c8-a172-c0d1d5c56f2a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.238481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.239370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.239723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.240081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.240795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.242558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.256669 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3839/7642] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:11.261471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.284683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc7a78-47fa-476d-81b8-03bcfc8b0ba7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.290039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.290731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.291004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.291412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] PATH_INFO: `/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed/users/124c975721524769af9976e0f2d79ed4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.311967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef0e851f1694b5fa8428a8269ddb5ed, user_id=124c975721524769af9976e0f2d79ed4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.316015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.396253 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3804/7643] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:11 2022] PUT /identity/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed/users/124c975721524769af9976e0f2d79ed4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:11.400343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.412038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9119f11-007f-4d48-884d-a06de5df725d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.487878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.488500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.488777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.489045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.489865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.491478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645a194-e729-44d3-aad7-29270abcb450 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.503159 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3840/7644] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:11.507587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.533195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbacfc-5c3a-4be8-8550-355312ac5050 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.542629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.543604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.544094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.544553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] PATH_INFO: `/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed/users/124c975721524769af9976e0f2d79ed4/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.548430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef0e851f1694b5fa8428a8269ddb5ed, user_id=124c975721524769af9976e0f2d79ed4, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.552196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:11.603871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.603871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.603871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.610358 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3805/7645] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:11 2022] PUT /identity/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed/users/124c975721524769af9976e0f2d79ed4/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:11.656168 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:11.668674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] MFA Rules not processed for user `124c975721524769af9976e0f2d79ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:11.669962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:11.806703 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3841/7646] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:11.811497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:11.918415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639323e2-092d-4e0a-8752-6843770b0010 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:11.923328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:11.923932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:11.924207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:11.924476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:11.925234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:11.927114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.101535 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3806/7647] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:11 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:12.105440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:12.117573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8a2a-52c7-4078-94ae-f90db685e62d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:12.232772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:12.233601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.233714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.234079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.234570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:12.237265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.359367 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3842/7648] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:12 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:12.360476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:12.387285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058935e-0449-4646-9a68-cee11fa83a7c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:12.409627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:12.410276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.410566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.411186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.411490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:12.413125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.437157 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3807/7649] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:12.441508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:12.452485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebd8c3-5810-483a-985a-bdab42c6034b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:12.457275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:12.457933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.458284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.458588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.459350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:12.460973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec945-291a-4ea3-a8af-02b98188c06e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.478977 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3843/7650] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:12.482044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:12.496657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ac70-6b7b-4b1b-8b1c-33a89697d290 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:12.501468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:12.502137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.502418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.502695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] PATH_INFO: `/v3/projects/670fd2ff1f2e4d83a7dd481f22859789/users/1a43de0dc5fb4234a793e21bc207b669/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.518454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] RBAC: Authorizing `identity:create_grant(project_id=670fd2ff1f2e4d83a7dd481f22859789, user_id=1a43de0dc5fb4234a793e21bc207b669, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:12.521412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.618696 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3808/7651] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:12 2022] PUT /identity/v3/projects/670fd2ff1f2e4d83a7dd481f22859789/users/1a43de0dc5fb4234a793e21bc207b669/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:12.629230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.629569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.629982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.660755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] MFA Rules not processed for user `1a43de0dc5fb4234a793e21bc207b669`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:12.662041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:12.742483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3844/7652] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:12.750502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:12.752343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:12.773873 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:12.845301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881798d0-9ad6-4362-979d-f9c76648217e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:12.849716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:12.850341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:12.850619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:12.850890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:12.922061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:12.923627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8e96-a821-4325-91f5-8f3b07ca1c33 service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:12.934156 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3809/7653] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:13.510191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:13.516705 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:13.591163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea3290-3fb6-43d9-8def-44fc30143d25 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:13.595774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:13.596460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:13.599550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:13.599550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] PATH_INFO: `/v3/users/124c975721524769af9976e0f2d79ed4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:13.599550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=124c975721524769af9976e0f2d79ed4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:13.601034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:13.815374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124c975721524769af9976e0f2d79ed4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:13.926589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124c975721524769af9976e0f2d79ed4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:13.927285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124c975721524769af9976e0f2d79ed4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:13.939996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124c975721524769af9976e0f2d79ed4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:13.947651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124c975721524769af9976e0f2d79ed4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:13.954439 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3845/7654] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:13 2022] DELETE /identity/v3/users/124c975721524769af9976e0f2d79ed4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:13.959381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:13.959864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:13.960031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:13.985167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:13.987680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:14.085947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3810/7655] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:14.096172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:14.098072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:14.171313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c805c0-feb1-4de3-b069-d34e8407fa5b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:14.175349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:14.176104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:14.176438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:14.179599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:14.187792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:14.189322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:14.209846 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3846/7656] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:14.714738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:14.716341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:14.735743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7dc42-3d6c-41d0-9acf-17e35679c22a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:14.741993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:14.742745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:14.743192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:14.743563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] PATH_INFO: `/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:14.745614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef0e851f1694b5fa8428a8269ddb5ed)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:14.747689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:14.864337 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:14.866378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef0e851f1694b5fa8428a8269ddb5ed', 'request_id': 'req-fa1f60f3-060e-463c-bfc5-342f61782468'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:14.874392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef0e851f1694b5fa8428a8269ddb5ed', 'request_id': 'req-fa1f60f3-060e-463c-bfc5-342f61782468'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:14.943727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef0e851f1694b5fa8428a8269ddb5ed', 'request_id': 'req-fa1f60f3-060e-463c-bfc5-342f61782468'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:14.963044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] The token cache is being invalidate because project 6ef0e851f1694b5fa8428a8269ddb5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:14.964606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:14.965771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:14.971029 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3811/7657] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:14 2022] DELETE /identity/v3/projects/6ef0e851f1694b5fa8428a8269ddb5ed => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:14.978693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:14.990947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a2fa-5a6b-4879-bb71-6216c527bb04 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:15.025117 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:15.067386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:15.068639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:15.069243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:15.069902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] PATH_INFO: `/v3/users/1a43de0dc5fb4234a793e21bc207b669` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:15.071246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a43de0dc5fb4234a793e21bc207b669)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:15.074606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:15.254831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a43de0dc5fb4234a793e21bc207b669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:15.326376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a43de0dc5fb4234a793e21bc207b669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:15.327130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a43de0dc5fb4234a793e21bc207b669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:15.347538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a43de0dc5fb4234a793e21bc207b669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:15.355447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0d6627e2-56cc-4da0-b3f7-0591a53b13f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a43de0dc5fb4234a793e21bc207b669'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:15.365308 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3847/7658] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:14 2022] DELETE /identity/v3/users/1a43de0dc5fb4234a793e21bc207b669 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:15.929577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:15.931037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:15.947615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f60f3-060e-463c-bfc5-342f61782468 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:16.032282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:16.036103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:16.036657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:16.037462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] PATH_INFO: `/v3/projects/670fd2ff1f2e4d83a7dd481f22859789` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:16.038737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] RBAC: Authorizing `identity:delete_project(project_id=670fd2ff1f2e4d83a7dd481f22859789)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:16.041782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:16.226902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670fd2ff1f2e4d83a7dd481f22859789', 'request_id': 'req-bcc0223b-d5bf-4ff5-976c-f07acab3001a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:16.236140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670fd2ff1f2e4d83a7dd481f22859789', 'request_id': 'req-bcc0223b-d5bf-4ff5-976c-f07acab3001a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:16.327094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670fd2ff1f2e4d83a7dd481f22859789', 'request_id': 'req-bcc0223b-d5bf-4ff5-976c-f07acab3001a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:16.352855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] The token cache is being invalidate because project 670fd2ff1f2e4d83a7dd481f22859789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:16.353264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:16.354079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bcc0223b-d5bf-4ff5-976c-f07acab3001a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:16.355665 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3812/7659] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:15 2022] DELETE /identity/v3/projects/670fd2ff1f2e4d83a7dd481f22859789 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:16.361796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:16.362288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:16.362381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:16.386932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:16.388215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:16.500000 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3848/7660] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:16.507562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:16.507977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:16.508381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:16.531423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:16.532782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:16.545248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3813/7661] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:16.546746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:16.559783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce16de-c5ed-497c-bab3-f9b45a67b7db None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:16.564894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:16.565562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:16.565969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:16.566251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:16.566885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:16.567183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:16.568942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:16.583107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3849/7662] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:16.587863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:16.599922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0eb3-1305-48b8-94be-cf7b84d4ac5e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:16.670325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:16.670325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:16.670325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:16.670325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:16.670740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:16.670740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.004774 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3814/7663] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:17.008942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.022916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f76f7-6293-4430-aa7a-5aaf9b53b4d3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.057683 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:17.087184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.087790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.088065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.088379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.089048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.090985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.173252 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3850/7664] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:17 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:17.184349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.189874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7e81f-ff14-4d2e-a15e-216a0b23cb84 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.195526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.196381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.196697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.197023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.198494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.200419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.210615 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3815/7665] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:17.215736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.226530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17814eaf-182a-4fac-8582-c2ce081017dd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.241354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.249423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.249423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.249423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.249423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.249423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72081b19-8b4e-49d6-8d26-a59137092eb5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.266536 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3851/7666] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:17.267383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.283352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3707c6f-05b0-4634-868f-e0d740f1388d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.293272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.293979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.294255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.294531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] PATH_INFO: `/v3/projects/10d6800c7e064f09ad6384c34937b3c6/users/e58c43a50b1249fbbd97260bbdb56f60/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.326260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d6800c7e064f09ad6384c34937b3c6, user_id=e58c43a50b1249fbbd97260bbdb56f60, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.329451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.455421 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3816/7667] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:17 2022] PUT /identity/v3/projects/10d6800c7e064f09ad6384c34937b3c6/users/e58c43a50b1249fbbd97260bbdb56f60/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:17.466582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.467119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.467119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.517095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] MFA Rules not processed for user `e58c43a50b1249fbbd97260bbdb56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:17.518377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:17.605503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3852/7668] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:17.606023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.611455 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:17.687457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c18e8-9f5e-44a5-b345-4c13a47f9e2a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.692468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.694159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.694159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.694159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.694689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.696808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:17.800048 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3817/7669] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:17 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:17.802403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:17.816889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146838c-58a1-4ce9-a909-d246b66bb222 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:17.888143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:17.888895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:17.889248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:17.889623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:17.890398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:17.892344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.015238 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3853/7670] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:17 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:18.019175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:18.032168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd82e0-a546-4f03-8c65-8081cd17b1c9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:18.040211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:18.041025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.041303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.042193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.043250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:18.045086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.058635 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3818/7671] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:18.062688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:18.073708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8062df-1629-4727-990b-42c615bf361b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:18.079041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:18.082101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.082101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.082101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] PATH_INFO: `/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb/users/c4c60518dc174c9ebc8acab147979d43/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.095976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8fa5c9cd0f4e939e12a40b75ef77bb, user_id=c4c60518dc174c9ebc8acab147979d43, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:18.099573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.202049 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3854/7672] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:18 2022] PUT /identity/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb/users/c4c60518dc174c9ebc8acab147979d43/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:18.203944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:18.221958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16917ce-aaae-455d-ab53-3167d35d4fd0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:18.290026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:18.290841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.290953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.291229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.291905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:18.293552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89885-84b4-44b2-aa17-e5bf93851f95 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.309687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3819/7673] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:18.314078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:18.333654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657df69c-9589-424e-a653-96a0f136cbe3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:18.340410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:18.341143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.342505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.342505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] PATH_INFO: `/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb/users/c4c60518dc174c9ebc8acab147979d43/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.344019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8fa5c9cd0f4e939e12a40b75ef77bb, user_id=c4c60518dc174c9ebc8acab147979d43, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:18.346836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.349993 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:18.359146 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3855/7674] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:18 2022] PUT /identity/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb/users/c4c60518dc174c9ebc8acab147979d43/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:18.371553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.371842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.372106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.408858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] MFA Rules not processed for user `c4c60518dc174c9ebc8acab147979d43`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:18.410562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:18.496535 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:18.512343 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3820/7675] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:18.522764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:18.525019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:18.606829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f4e4-a57b-4027-8bfb-894b0f98e7f9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:18.612632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:18.613352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:18.613728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:18.613999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:18.762046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:18.763884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:18.785102 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3856/7676] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:19.619674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:19.621795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:19.649436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f625cc-a0f7-40db-a598-fcd457772496 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:19.660527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:19.661165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:19.661475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:19.661753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:19.679925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:19.681406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:19.709773 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3821/7677] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:20.922138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:20.924320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:21.045162 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be515ab-d4e5-4a7f-8493-c6f42614576f service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:21.051233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:21.051847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:21.052122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:21.052389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:21.054246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:21.069233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:21.070919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:21.084816 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3857/7678] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:21.442694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:21.444998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:21.566868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b307-8799-4368-bb18-e9172dd558a7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:21.592053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:21.593071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:21.593547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:21.594014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] PATH_INFO: `/v3/users/d5feb71640df423da5cd384ca7ecf212` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:21.595297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5feb71640df423da5cd384ca7ecf212)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:21.598037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:21.850587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5feb71640df423da5cd384ca7ecf212'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:21.851417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5feb71640df423da5cd384ca7ecf212'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:21.870565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5feb71640df423da5cd384ca7ecf212'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:21.871531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5feb71640df423da5cd384ca7ecf212'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:21.948232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:21.950504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:21.989300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f70e7c9a-66e4-442a-8861-6f1ca8ad143f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5feb71640df423da5cd384ca7ecf212'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:22.016729 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:22.020336 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3822/7679] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:21 2022] DELETE /identity/v3/users/d5feb71640df423da5cd384ca7ecf212 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:22.027101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:22.027729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:22.028137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:22.059410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:22.060742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:22.136424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad68b-5b90-45f4-bf32-201dc25d8de0 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:22.233574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3823/7680] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:22.281988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:22.284275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:22.297261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:22.298200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:22.298628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:22.299054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:22.301893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:22.302366 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:22.324223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:22.326549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:22.377469 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3858/7681] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:22.449450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5b8b8-5ba9-436a-a235-1efa0999e189 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:22.451473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:22.452126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:22.452640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:22.452967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:22.467996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:22.469835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2619b5-2581-4638-8cf6-6bd85f703426 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:22.484791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3824/7682] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:23.063275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:23.064915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:23.088925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e244d-6d17-460d-9c4f-c71685692041 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:23.094414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:23.102135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.110377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.110377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] PATH_INFO: `/v3/projects/405027d986cb4be68bdd907752b9e5fd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.110377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] RBAC: Authorizing `identity:delete_project(project_id=405027d986cb4be68bdd907752b9e5fd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:23.110377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:23.353431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405027d986cb4be68bdd907752b9e5fd', 'request_id': 'req-b1eedd56-e056-46aa-bb41-3b9d653d486f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:23.448080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405027d986cb4be68bdd907752b9e5fd', 'request_id': 'req-b1eedd56-e056-46aa-bb41-3b9d653d486f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:23.458665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405027d986cb4be68bdd907752b9e5fd', 'request_id': 'req-b1eedd56-e056-46aa-bb41-3b9d653d486f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:23.473486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] The token cache is being invalidate because project 405027d986cb4be68bdd907752b9e5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:23.473964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:23.475248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b1eedd56-e056-46aa-bb41-3b9d653d486f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:23.481378 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3859/7683] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:23 2022] DELETE /identity/v3/projects/405027d986cb4be68bdd907752b9e5fd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:23.484571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.485209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.485209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.515776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:23.517412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:23.596221 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3825/7684] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:23.606034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.606316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.606597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.638580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:23.640793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:23.653584 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3860/7685] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:23.654846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:23.672184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e831462-93b9-442c-a4d5-b50f88d0debb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:23.682896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:23.682896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.682896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.682896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.683278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:23.683278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:23.683278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:23.705368 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3826/7686] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:23.707003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:23.717234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702051e-291e-4a6a-81ae-c6b1cd24063d None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:23.727239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:23.727841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.728117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.728453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.729325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:23.731245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:23.860265 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3861/7687] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:23 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:23.864404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:23.878585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa424-5ec9-48c0-bb82-f876c52cd871 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:23.997295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:23.998001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:23.998447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:23.998916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:23.999619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:24.002056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:24.163521 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3827/7688] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:23 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:24.169372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:24.182567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8558f-0e33-4472-977c-025dfee9dc47 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:24.188787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:24.189970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:24.190969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:24.191513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:24.192558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:24.194450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:24.196275 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:24.214516 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3862/7689] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:24.218371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:24.233433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08ad0e-5e60-4da0-ba20-aa79b58243d1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:24.241802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:24.243057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:24.243381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:24.243661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:24.244412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:24.246295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584ba8-4659-434f-9dfb-9c0bce51409d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:24.272085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3828/7690] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:24.277414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:24.296865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6482-09bf-4b5c-b796-f98627f9781c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:24.308472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:24.309151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:24.309468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:24.309899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] PATH_INFO: `/v3/projects/0fb48e5537384db584e11f4ec43da845/users/2da518aa160c4056af3f454a519b4bdb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:24.340073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb48e5537384db584e11f4ec43da845, user_id=2da518aa160c4056af3f454a519b4bdb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:24.343925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:24.451615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3863/7691] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:24 2022] PUT /identity/v3/projects/0fb48e5537384db584e11f4ec43da845/users/2da518aa160c4056af3f454a519b4bdb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:24.453649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:24.454018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:24.454347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:24.477558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:24.479110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:24.488252 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:24.542684 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3829/7692] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:24.554920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:24.556634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:24.639081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285733d-f623-47bc-b42d-39c0bc58790f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:24.644535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:24.645151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:24.649223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:24.649223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:24.661131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:24.662822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb31d-84d8-40f2-b10d-4567d8705192 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:24.672675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3864/7693] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:33.623469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:33.625657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:33.630294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c6b4-20b3-4ed2-9dc1-923138396a17 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:33.635012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c6b4-20b3-4ed2-9dc1-923138396a17 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:33.635991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c6b4-20b3-4ed2-9dc1-923138396a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:33.640263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7726a6-7f16-4be9-977b-4db91cd1a512 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:33.645379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:33.653542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:33.653542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:33.653542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] PATH_INFO: `/v3/users/e58c43a50b1249fbbd97260bbdb56f60` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:33.653542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58c43a50b1249fbbd97260bbdb56f60)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:33.653542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:33.679658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5e99c6b4-20b3-4ed2-9dc1-923138396a17 None None] MFA Rules not processed for user `cb21ecdda88d49b59e11a30b0f3afc72`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:33.682056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5e99c6b4-20b3-4ed2-9dc1-923138396a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:33.805503 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3865/7694] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:33.918580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58c43a50b1249fbbd97260bbdb56f60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:33.921373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58c43a50b1249fbbd97260bbdb56f60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:33.942057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58c43a50b1249fbbd97260bbdb56f60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:33.946015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58c43a50b1249fbbd97260bbdb56f60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:34.092196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58c43a50b1249fbbd97260bbdb56f60'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:34.145054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3830/7695] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:33 2022] DELETE /identity/v3/users/e58c43a50b1249fbbd97260bbdb56f60 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:34.149366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:34.149653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:34.149924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:34.176416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:34.178402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:34.306230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3866/7696] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:34.317695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:34.319719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:34.431650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34fe3-10bc-44c2-91f2-dd4796224c8c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:34.436655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:34.437293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:34.437607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:34.437887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:34.453985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:34.457145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:34.474296 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3831/7697] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:35.013687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:35.015108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:35.040384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfc5dd-1ea8-4942-bc6d-3ad46266ac2f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:35.051557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:35.052480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:35.052863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:35.053012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] PATH_INFO: `/v3/projects/10d6800c7e064f09ad6384c34937b3c6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:35.060885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d6800c7e064f09ad6384c34937b3c6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:35.063011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:35.077047 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:35.195070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:35.196975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:35.268851 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:35.303173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d6800c7e064f09ad6384c34937b3c6', 'request_id': 'req-46e3601f-98df-4d96-80b2-7a8ed52ea18e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:35.367643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6dea-c27e-4e29-ba3b-6c4775142eaa service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:35.400927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d6800c7e064f09ad6384c34937b3c6', 'request_id': 'req-46e3601f-98df-4d96-80b2-7a8ed52ea18e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:35.412135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d6800c7e064f09ad6384c34937b3c6', 'request_id': 'req-46e3601f-98df-4d96-80b2-7a8ed52ea18e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:35.465952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] The token cache is being invalidate because project 10d6800c7e064f09ad6384c34937b3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:35.466451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:35.467257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:35.473457 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3867/7698] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:35 2022] DELETE /identity/v3/projects/10d6800c7e064f09ad6384c34937b3c6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:35.475688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:35.477475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:35.530818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:35.531462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:35.531744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:35.532018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:35.538342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:35.597865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:35.597865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba24c6-25f9-4b4b-af75-efea1814ce13 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:35.657827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3601f-98df-4d96-80b2-7a8ed52ea18e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:35.672136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:35.672790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:35.673070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:35.673372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] PATH_INFO: `/v3/users/c4c60518dc174c9ebc8acab147979d43` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:35.679172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c60518dc174c9ebc8acab147979d43)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:35.681782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:35.693689 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3832/7699] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:35.991390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c60518dc174c9ebc8acab147979d43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.114919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c60518dc174c9ebc8acab147979d43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.115849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c60518dc174c9ebc8acab147979d43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.130821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:36.132550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:36.133145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c60518dc174c9ebc8acab147979d43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.133695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:36.149800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c60518dc174c9ebc8acab147979d43'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.165369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3868/7700] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:35 2022] DELETE /identity/v3/users/c4c60518dc174c9ebc8acab147979d43 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:36.234035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] MFA Rules not processed for user `2da518aa160c4056af3f454a519b4bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:36.238034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:36.393884 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3833/7701] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:36.410231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:36.414821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:36.458165 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:36.554456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de9f89-5114-4583-b5e3-6f4826dc0680 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:36.565424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:36.567913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:36.569401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:36.570216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:36.570806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:36.571252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:36.573765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:36.581166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:36.602764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7759ccf-59a9-4ff0-ac19-053699206325 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:36.629083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:36.629982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:36.630426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:36.630855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] PATH_INFO: `/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:36.632520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8fa5c9cd0f4e939e12a40b75ef77bb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:36.636768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:36.788001 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3869/7702] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:36 2022] POST /identity/v3/projects => generated 381 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:36.791902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:36.849012 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:36.859449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8fa5c9cd0f4e939e12a40b75ef77bb', 'request_id': 'req-0712c2cc-8e36-4405-ab56-1fc8257d31c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.867124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8fa5c9cd0f4e939e12a40b75ef77bb', 'request_id': 'req-0712c2cc-8e36-4405-ab56-1fc8257d31c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:36.950709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8684-ee58-4e9d-ac63-ce55c18b83b4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:36.999248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8fa5c9cd0f4e939e12a40b75ef77bb', 'request_id': 'req-0712c2cc-8e36-4405-ab56-1fc8257d31c3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:37.024289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] The token cache is being invalidate because project df8fa5c9cd0f4e939e12a40b75ef77bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:37.024908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:37.026259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0712c2cc-8e36-4405-ab56-1fc8257d31c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:37.030529 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3834/7703] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:36 2022] DELETE /identity/v3/projects/df8fa5c9cd0f4e939e12a40b75ef77bb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:37.047022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb951fa-7fbb-4cc6-93fb-020372d26bb8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.047440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb951fa-7fbb-4cc6-93fb-020372d26bb8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.047821 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb951fa-7fbb-4cc6-93fb-020372d26bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.090874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.093229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.094872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.095285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1eb951fa-7fbb-4cc6-93fb-020372d26bb8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:37.095718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.098304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1eb951fa-7fbb-4cc6-93fb-020372d26bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:37.098809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.103999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.128628 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3835/7704] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:37.129495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.129928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.130349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.180126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:37.183657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:37.208463 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3836/7705] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:37.209527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.232857 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3870/7706] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:36 2022] POST /identity/v3/users => generated 297 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:37.237353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.239238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:37.242848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05804f3-59c1-48c9-92f9-36eddd874f3a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.263435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057d316-2750-434a-96b5-4db53403d2f3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.263712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.264761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.265047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.269903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.273827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:37.273827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.273827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.282000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.284501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.284501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.284501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.284501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.285565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.313190 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3837/7707] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:37.313841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3871/7708] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:37.324913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.325118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.338547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470e67-4e35-43dd-9f7f-8c0db389221e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.344065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.344696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.344970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.345250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.345935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.359003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.364650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9990a1f-e115-4fe4-8af6-4256d6f50aab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.387161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.388092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.388545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.389014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] PATH_INFO: `/v3/projects/679b7307107149d3a106f59aae38a4b5/users/ade48c3b0d434c2ea06ba0c256493e80/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.446010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b7307107149d3a106f59aae38a4b5, user_id=ade48c3b0d434c2ea06ba0c256493e80, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.450634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.559744 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:37.565577 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3872/7709] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:37 2022] PUT /identity/v3/projects/679b7307107149d3a106f59aae38a4b5/users/ade48c3b0d434c2ea06ba0c256493e80/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:37.570164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.584264 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3838/7710] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:37 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:37.589487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.738203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99600-f075-46b2-acf2-12a03d1bbef3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.748654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4e35c-e5c2-4906-bd64-0c46027e3d2a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.762556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.764907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.765486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.766010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.766651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.768402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.768402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.768608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.768682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.768751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.770151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.771676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.796039 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3873/7711] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:50:37.798604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:37.811849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085b1b1-9492-47a1-9637-9a9d96d77728 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:37.817425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:37.818321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:37.818683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:37.819028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] PATH_INFO: `/v3/projects/679b7307107149d3a106f59aae38a4b5/users/ade48c3b0d434c2ea06ba0c256493e80/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:37.821105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679b7307107149d3a106f59aae38a4b5, user_id=ade48c3b0d434c2ea06ba0c256493e80, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:37.824394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:37.851382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3874/7712] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:37 2022] PUT /identity/v3/projects/679b7307107149d3a106f59aae38a4b5/users/ade48c3b0d434c2ea06ba0c256493e80/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:37.940944 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3839/7713] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:37 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:37.947542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.054169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439b9e-5596-4ff4-b851-16551b3313c9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:38.061857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:38.062526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.062809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.063445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.064098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:38.065872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:38.082707 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3875/7714] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:38.083438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.096045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1ccf-1ef3-47de-9349-4908d29957b2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:38.110819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:38.111988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.111988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.112208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.112658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:38.114300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248471d-3e74-4059-a713-a5b656963e87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:38.132258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3840/7715] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:50:38.133498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.159700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b5946-c0c9-4597-8f64-88bfa7b9fcf3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:38.180558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:38.182309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.183410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.183748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] PATH_INFO: `/v3/projects/5cb67dac51a34b35934cc45e2318a252/users/6b3eddbcd6f94af48b7c32ffcc79ddaa/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.204575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb67dac51a34b35934cc45e2318a252, user_id=6b3eddbcd6f94af48b7c32ffcc79ddaa, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:38.207649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:38.320566 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3876/7716] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:38 2022] PUT /identity/v3/projects/5cb67dac51a34b35934cc45e2318a252/users/6b3eddbcd6f94af48b7c32ffcc79ddaa/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:38.321594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.322495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.323012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.385607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] MFA Rules not processed for user `6b3eddbcd6f94af48b7c32ffcc79ddaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:38.387053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:38.482605 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:38.493206 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3841/7717] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:38.498000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.570541 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:38.577841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677cfb-a807-46f1-a4c9-656bd67fa537 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:38.584837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:38.585574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.585853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.586128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.586800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:38.589451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:38.689118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3877/7718] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:38 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:38.693965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.705853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf249843-499a-4907-bd0d-45fd907906d5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:38.809849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:38.810610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:38.810958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:38.811394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:38.812357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:38.814425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:38.971036 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3842/7719] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:38 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:38.973167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:38.991616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ebd09-ce48-4977-9480-34f1d738126a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:39.015602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:39.016298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:39.016703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:39.017042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:39.017788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:39.024287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:39.053201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3878/7720] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:39.054765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:39.068321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686885-93f9-4210-a603-079bb7556a2b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:39.086668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:39.087924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:39.088204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:39.088474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] PATH_INFO: `/v3/projects/028112bfb2bf4a3d93976f083fdc0179/users/34e9a264d7b14ce9b2472630a43109e9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:39.150970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028112bfb2bf4a3d93976f083fdc0179, user_id=34e9a264d7b14ce9b2472630a43109e9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:39.154313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:39.321126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3843/7721] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:39 2022] PUT /identity/v3/projects/028112bfb2bf4a3d93976f083fdc0179/users/34e9a264d7b14ce9b2472630a43109e9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:50:39.325851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:39.370341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632883-152d-4fad-b895-075a00939cde admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:39.592841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:39.593573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:39.594205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:39.594205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:39.594753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:39.596434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8491c77-3298-413c-af78-54d3a8a455cd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:39.625295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3879/7722] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:39.629616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:39.642543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38c81-4c42-47fd-bcd4-3b9fa01cdb53 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:39.647756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:39.648751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:39.649185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:39.650299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] PATH_INFO: `/v3/projects/028112bfb2bf4a3d93976f083fdc0179/users/34e9a264d7b14ce9b2472630a43109e9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:39.652756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028112bfb2bf4a3d93976f083fdc0179, user_id=34e9a264d7b14ce9b2472630a43109e9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:39.655537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:39.669399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3844/7723] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:39 2022] PUT /identity/v3/projects/028112bfb2bf4a3d93976f083fdc0179/users/34e9a264d7b14ce9b2472630a43109e9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:39.679366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:39.679869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:39.680245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:39.723954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] MFA Rules not processed for user `34e9a264d7b14ce9b2472630a43109e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:39.725646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:39.875902 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3880/7724] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:39.922766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:39.924634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:40.059715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b9bcb-e7da-4fd0-ae49-83d45155dce5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:40.076766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:40.077450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:40.083929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:40.084430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:40.104671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:40.104671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed83456-97de-48d4-8a2c-667c54354575 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:40.132374 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3845/7725] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:45.778098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:45.882722 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:45.904778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8813-5a11-4e76-b501-13bc9df820e6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:45.909842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:45.910484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:45.910764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:45.911035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] PATH_INFO: `/v3/users/6b3eddbcd6f94af48b7c32ffcc79ddaa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:45.912170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3eddbcd6f94af48b7c32ffcc79ddaa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:45.914380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:46.099636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3eddbcd6f94af48b7c32ffcc79ddaa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:46.194339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3eddbcd6f94af48b7c32ffcc79ddaa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:46.195072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3eddbcd6f94af48b7c32ffcc79ddaa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:46.216673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3eddbcd6f94af48b7c32ffcc79ddaa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:46.248819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3eddbcd6f94af48b7c32ffcc79ddaa'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:46.267411 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3881/7726] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:45 2022] DELETE /identity/v3/users/6b3eddbcd6f94af48b7c32ffcc79ddaa => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:46.277530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:46.278019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:46.278128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:46.326718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:46.327945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:46.417643 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:46.437000 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3846/7727] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:46.446308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:46.448503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:46.564748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15f69a-6093-4431-a62f-ef07bdd6491f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:46.572926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:46.573584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:46.573864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:46.574139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:46.611543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:46.613013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:46.639896 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3882/7728] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:48.094798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:48.097610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:48.111871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062910-c68e-40b3-bcc8-341c62967963 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:48.124588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:48.181510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:48.181510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:48.181510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] PATH_INFO: `/v3/projects/5cb67dac51a34b35934cc45e2318a252` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:48.181510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb67dac51a34b35934cc45e2318a252)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:48.181510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:48.355505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb67dac51a34b35934cc45e2318a252', 'request_id': 'req-482b18f9-7c36-48e0-bc4d-6f06717dc722'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.370911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb67dac51a34b35934cc45e2318a252', 'request_id': 'req-482b18f9-7c36-48e0-bc4d-6f06717dc722'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.429147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb67dac51a34b35934cc45e2318a252', 'request_id': 'req-482b18f9-7c36-48e0-bc4d-6f06717dc722'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.455696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] The token cache is being invalidate because project 5cb67dac51a34b35934cc45e2318a252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:48.456301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.457699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-482b18f9-7c36-48e0-bc4d-6f06717dc722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.466171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:48.467248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3847/7729] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:48 2022] DELETE /identity/v3/projects/5cb67dac51a34b35934cc45e2318a252 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:48.483618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c992121-a49f-42bd-bdcc-9ad0e6e8f055 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:48.625520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:48.625520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:48.625520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:48.625520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] PATH_INFO: `/v3/users/34e9a264d7b14ce9b2472630a43109e9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:48.625933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e9a264d7b14ce9b2472630a43109e9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:48.627176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:48.651338 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:48.691436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:48.691769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:48.692105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:48.723818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] MFA Rules not processed for user `ade48c3b0d434c2ea06ba0c256493e80`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:48.725115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:48.809258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e9a264d7b14ce9b2472630a43109e9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.835552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3848/7730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:48.856142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:48.857676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:48.909319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e9a264d7b14ce9b2472630a43109e9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.910081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e9a264d7b14ce9b2472630a43109e9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.936578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e9a264d7b14ce9b2472630a43109e9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.950554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e9a264d7b14ce9b2472630a43109e9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:48.965580 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3883/7731] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:48 2022] DELETE /identity/v3/users/34e9a264d7b14ce9b2472630a43109e9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:49.012377 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:49.050344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc49ff-3f07-43ef-ae5e-43528ed0542c None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:49.186030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:49.186947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:49.187209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:49.187562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:49.198761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.296263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:49.298925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:49.317132 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3849/7732] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:49.345727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:49.347426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.454983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66ecf5-b1f9-447b-aa55-dd41fce710ab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:49.457415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:49.459081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.459971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:49.461229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:49.461977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:49.462251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] PATH_INFO: `/v3/projects/028112bfb2bf4a3d93976f083fdc0179` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:49.463429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] RBAC: Authorizing `identity:delete_project(project_id=028112bfb2bf4a3d93976f083fdc0179)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:49.470884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:49.484595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d1510-687a-4e1b-93d2-d3d34ef67de4 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:49.506077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:49.508365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:49.509189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:49.510594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:49.514224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.555006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:49.557428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539c48f-22e9-4b4c-9a27-3201772e8502 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:49.585066 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3850/7733] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:49.673602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028112bfb2bf4a3d93976f083fdc0179', 'request_id': 'req-29e96bd4-8037-4180-b897-5f6036ec812f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:49.788626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028112bfb2bf4a3d93976f083fdc0179', 'request_id': 'req-29e96bd4-8037-4180-b897-5f6036ec812f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:49.796624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028112bfb2bf4a3d93976f083fdc0179', 'request_id': 'req-29e96bd4-8037-4180-b897-5f6036ec812f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:49.818688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] The token cache is being invalidate because project 028112bfb2bf4a3d93976f083fdc0179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:50:49.819025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:49.819703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:49.827461 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3884/7734] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:50:49 2022] DELETE /identity/v3/projects/028112bfb2bf4a3d93976f083fdc0179 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:49.830558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9721005-a970-4f49-9388-6858c01b005d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:49.831496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9721005-a970-4f49-9388-6858c01b005d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:49.832052 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9721005-a970-4f49-9388-6858c01b005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:49.891631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:49.894519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.895768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d9721005-a970-4f49-9388-6858c01b005d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:49.900874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d9721005-a970-4f49-9388-6858c01b005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:49.934540 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:50.022568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e96bd4-8037-4180-b897-5f6036ec812f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.035563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.036187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.036466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.037399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.040479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:50.063897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3851/7735] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:50:50.071903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.072463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.073003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.081043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.083631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.111913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:50.113808 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3885/7736] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:50.114801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:50.145730 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3852/7737] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:50.147123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.162353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31022202-ce06-44c1-be7d-b1db6fe33514 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.174493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.175301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.175412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.175647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.176307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:50:50.176605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.188551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.206589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3886/7738] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:50:50.212689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.225264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7cff-9555-4851-903e-0c3994872e92 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.230437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.231053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.231334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.231606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.232250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.234970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.242854 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:50.380311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3853/7739] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:50:50 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:50:50.389789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.403191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c304-f1b0-4af8-978d-f3b61643cbe4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.476993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.478558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.478558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.478872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.479523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.481508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.593960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3887/7740] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:50:50 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:50:50.595394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.611898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9930185-f577-4334-a069-8453699cb9ff admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.617471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.626845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.626845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.626845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.626845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.626845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.638867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.641659 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3854/7741] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:50:50.650859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5a287-88b4-4256-8722-c28b2b76b98d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.656165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.656770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.657077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.657321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.658034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.659623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e6648-20fc-4e47-b7ea-7d4bb9b31369 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.671283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3888/7742] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:50:50.691049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:50.712010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88ec19-fd90-4676-a7ad-648d0d60152d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:50.741445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:50.741445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.741445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.741445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] PATH_INFO: `/v3/projects/057a057acd5c4d3ebe35fce8860347df/users/d27ea5342f604640b89ae6d513a7f85a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.768752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057a057acd5c4d3ebe35fce8860347df, user_id=d27ea5342f604640b89ae6d513a7f85a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:50.771812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:50.865507 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3855/7743] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:50:50 2022] PUT /identity/v3/projects/057a057acd5c4d3ebe35fce8860347df/users/d27ea5342f604640b89ae6d513a7f85a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:50:50.881983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:50.881983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:50.881983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:50.921301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] MFA Rules not processed for user `d27ea5342f604640b89ae6d513a7f85a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:50:50.922680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:51.058957 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3889/7744] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:50:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:50:51.069514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:51.073503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:51.251369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c536c0-ca97-45df-b044-00767d410585 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:51.259183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:51.260137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:51.260580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:51.261350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:51.274529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:51.276601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:51.304307 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3856/7745] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:50:51.410736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:51.428350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18018987-c719-48e7-b6f6-c5dafef68dc0 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:51.440634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:51.441921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:51.442201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:51.442472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:51.444868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:51.458318 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:50:51.556397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:51.558079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:51.569018 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3890/7746] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:50:59.392609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:50:59.394237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:50:59.418653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60917925-f0e6-4b27-9d51-24f557486b00 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:50:59.429718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:50:59.430929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:50:59.432932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:50:59.432932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] PATH_INFO: `/v3/users/dcb021152c684983b31e5db439518921` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:50:59.434188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb021152c684983b31e5db439518921)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:50:59.436607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:50:59.680894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb021152c684983b31e5db439518921'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:59.682538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb021152c684983b31e5db439518921'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:59.695001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb021152c684983b31e5db439518921'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:59.695874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb021152c684983b31e5db439518921'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:59.794158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-9a6d9663-264e-4bbc-8d4f-6153b931d704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb021152c684983b31e5db439518921'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:50:59.821186 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3857/7747] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:50:59 2022] DELETE /identity/v3/users/dcb021152c684983b31e5db439518921 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:00.426920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:00.440813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c777492-1f2f-4411-a077-d1f0b33125c1 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:00.504549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:00.505198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:00.505578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:00.505900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] PATH_INFO: `/v3/projects/311cde01e89442f1ab3aa930070b7343` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:00.507132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311cde01e89442f1ab3aa930070b7343)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:00.509824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:00.658110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311cde01e89442f1ab3aa930070b7343', 'request_id': 'req-8aaae643-2259-4e6e-a388-b0872c3e4995'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:00.783026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311cde01e89442f1ab3aa930070b7343', 'request_id': 'req-8aaae643-2259-4e6e-a388-b0872c3e4995'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:00.798541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311cde01e89442f1ab3aa930070b7343', 'request_id': 'req-8aaae643-2259-4e6e-a388-b0872c3e4995'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:00.818037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] The token cache is being invalidate because project 311cde01e89442f1ab3aa930070b7343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:00.818342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:00.819004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8aaae643-2259-4e6e-a388-b0872c3e4995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:00.825676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3891/7748] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:00 2022] DELETE /identity/v3/projects/311cde01e89442f1ab3aa930070b7343 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:00.827708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:00.828675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:00.829148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:00.868423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:00.875155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:00.905705 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:00.969966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:00.970387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:00.970757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:00.973500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3858/7749] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:01.001142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:01.003239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:01.026221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.031619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3892/7750] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:01.037573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff41e3-3caa-47ab-b531-a1aa41adb365 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.046211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.047147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.047436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.047714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.048375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:01.048682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.050383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.064270 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3859/7751] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:01.068745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.080692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce968f-a6e7-4a5e-b0aa-150ce60b22fc None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.088435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.089062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.089345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.089642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.090271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.092229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.253176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.254576 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3893/7752] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:01.266277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d7f9-cb3d-4fdf-ac39-32562948278a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.355245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.355998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.356091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.356564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.357366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.359285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.498909 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3860/7753] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:01 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:01.503710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.510898 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:01.517010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c4768-9377-44b4-899f-09e9724612a5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.522189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.522796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.523106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.523410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.524095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.525852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.537365 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3894/7754] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:01.541550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.552275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d52-ad94-4850-a9a9-3264abdbcca3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.559132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.560017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.560017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.560214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.560822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.562484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9469-9699-4504-a6e9-8bb484945826 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.573833 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3861/7755] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:01.578268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.590101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038b82b-ab02-4b8c-9661-2c75a9bac90b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.595254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.596167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.598199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.598199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] PATH_INFO: `/v3/projects/460d84157c4c4366933fd5274ad0fb9b/users/adaaee54d4904ef28bd5b78bb1c7b2fc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.612201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460d84157c4c4366933fd5274ad0fb9b, user_id=adaaee54d4904ef28bd5b78bb1c7b2fc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:01.615573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:01.737146 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3895/7756] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:01 2022] PUT /identity/v3/projects/460d84157c4c4366933fd5274ad0fb9b/users/adaaee54d4904ef28bd5b78bb1c7b2fc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:01.751579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.751951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.752288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:01.783696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] MFA Rules not processed for user `adaaee54d4904ef28bd5b78bb1c7b2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:01.784910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:01.862450 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3862/7757] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:01.877431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:01.882854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:01.983884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84db5b7-e957-414f-9e56-637bb8bec426 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:01.989691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:01.990293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:01.995108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:01.995108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:02.002918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:02.004610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:02.015306 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3896/7758] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:06.487003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:06.489448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:06.544086 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:06.601203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136dfa0-a51c-4ca9-a1f1-6a6e2df86720 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:06.606619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:06.607358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:06.607759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:06.608140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] PATH_INFO: `/v3/users/2da518aa160c4056af3f454a519b4bdb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:06.609486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da518aa160c4056af3f454a519b4bdb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:06.614931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:06.863313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da518aa160c4056af3f454a519b4bdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:06.864760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da518aa160c4056af3f454a519b4bdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:06.881391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da518aa160c4056af3f454a519b4bdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:06.881391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da518aa160c4056af3f454a519b4bdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:06.984484 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da518aa160c4056af3f454a519b4bdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:07.031041 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3863/7759] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:06 2022] DELETE /identity/v3/users/2da518aa160c4056af3f454a519b4bdb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:07.811235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:07.836548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231306b-afa3-414e-bd0a-967874d08840 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:07.946706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:07.947460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:07.947741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:07.948081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] PATH_INFO: `/v3/projects/0fb48e5537384db584e11f4ec43da845` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:07.949282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb48e5537384db584e11f4ec43da845)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:07.951326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:08.097177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb48e5537384db584e11f4ec43da845', 'request_id': 'req-ee952626-72c2-4cf0-b8b7-eb7319015179'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.103379 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:08.222028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb48e5537384db584e11f4ec43da845', 'request_id': 'req-ee952626-72c2-4cf0-b8b7-eb7319015179'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.233128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb48e5537384db584e11f4ec43da845', 'request_id': 'req-ee952626-72c2-4cf0-b8b7-eb7319015179'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.244898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] The token cache is being invalidate because project 0fb48e5537384db584e11f4ec43da845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:08.245191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.245924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.247641 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3897/7760] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:07 2022] DELETE /identity/v3/projects/0fb48e5537384db584e11f4ec43da845 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:08.251782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:08.253215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:08.267907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140e44d-23b7-402b-b551-59077582b87c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:08.329936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:08.330834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:08.331005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:08.331244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] PATH_INFO: `/v3/users/ade48c3b0d434c2ea06ba0c256493e80` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:08.332534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade48c3b0d434c2ea06ba0c256493e80)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:08.334529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:08.579783 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:08.583921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade48c3b0d434c2ea06ba0c256493e80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.584679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade48c3b0d434c2ea06ba0c256493e80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.596514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade48c3b0d434c2ea06ba0c256493e80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.597291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade48c3b0d434c2ea06ba0c256493e80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.691016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-87328500-b927-4bf3-867c-12391ee780ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade48c3b0d434c2ea06ba0c256493e80'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:08.711674 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3864/7761] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:08 2022] DELETE /identity/v3/users/ade48c3b0d434c2ea06ba0c256493e80 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:09.121253 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:09.125855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:09.171487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952626-72c2-4cf0-b8b7-eb7319015179 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:09.314232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:09.315110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:09.315708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:09.316180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] PATH_INFO: `/v3/projects/679b7307107149d3a106f59aae38a4b5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:09.317591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=679b7307107149d3a106f59aae38a4b5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:09.323640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:09.444265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679b7307107149d3a106f59aae38a4b5', 'request_id': 'req-85dbaf8b-afbb-464b-82ea-0cff1f892edd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:09.537066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679b7307107149d3a106f59aae38a4b5', 'request_id': 'req-85dbaf8b-afbb-464b-82ea-0cff1f892edd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:09.550890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679b7307107149d3a106f59aae38a4b5', 'request_id': 'req-85dbaf8b-afbb-464b-82ea-0cff1f892edd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:09.576824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] The token cache is being invalidate because project 679b7307107149d3a106f59aae38a4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:09.577288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:09.578185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-85dbaf8b-afbb-464b-82ea-0cff1f892edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:09.589485 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3898/7762] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:09 2022] DELETE /identity/v3/projects/679b7307107149d3a106f59aae38a4b5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:09.591403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:09.592613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:09.593107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:09.644600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:09.646815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:09.818725 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3865/7763] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:09.821987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:09.822437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:09.829261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:09.895893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:09.897601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:09.936656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3899/7764] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:09.942339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:09.963583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1884-9b49-42bb-92db-9dc27e514094 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:09.985924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:09.987235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:09.988791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:09.996815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.001063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:10.001458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.003116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.046552 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3866/7765] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:10.057313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.068962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956ff85-39cc-4459-8a06-041d15758158 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:10.087838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:10.088769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.089285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.089866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.090690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.092883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.225166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3900/7766] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:10.228226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.244335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b9d6d-a3fb-4bee-82cd-01051fdede6c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:10.354266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:10.355188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.355483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.355746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.358881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.365038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.491852 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3867/7767] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:10 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:10.496716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.516525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd53fd-0d97-4e5e-80e1-08b94d8693eb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:10.531142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:10.531972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.532406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.532781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.533924 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.536020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.560397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3901/7768] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:10.564562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.577389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4194-dd6e-468d-8eae-e0df21de8827 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:10.592418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:10.593129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.593383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.593678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.594339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.596218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c0277-2f23-4559-bdd8-d1dd17b45ae3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.621783 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3868/7769] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:10.627573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.646905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a290031-86d4-4177-b97e-e50dbe2404f4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:10.661421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:10.662254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.662641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.663154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] PATH_INFO: `/v3/projects/735c13f1d49640319694d0a6a3a16519/users/33a9a7ae4f5a42d7ac76baf67fdb7a2d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.704291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=735c13f1d49640319694d0a6a3a16519, user_id=33a9a7ae4f5a42d7ac76baf67fdb7a2d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:10.709234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:10.789986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3902/7770] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:10 2022] PUT /identity/v3/projects/735c13f1d49640319694d0a6a3a16519/users/33a9a7ae4f5a42d7ac76baf67fdb7a2d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:10.800406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:10.800941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:10.801433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:10.850488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] MFA Rules not processed for user `33a9a7ae4f5a42d7ac76baf67fdb7a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:10.852015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:10.866821 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:10.936700 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3869/7771] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:10.937969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:10.957605 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:11.081300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812be34-7bf5-4d4b-94c7-38c32484819f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:11.087503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:11.088983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:11.089358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:11.090036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:11.090819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:11.094338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:11.215165 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3903/7772] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:10 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:11.218879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:11.233388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c972c07-20f9-48e5-b9ee-670b7c7020a4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:11.437912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:11.440828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:11.441457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:11.441574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:11.442215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:11.444153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:11.548793 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3870/7773] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:11 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:11.550897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:11.573559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01c69-7a75-40f1-9f6a-35805d42225a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:11.584413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:11.585299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:11.585878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:11.586452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:11.590055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:11.591995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:11.619999 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3904/7774] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:11.624416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:11.657792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c93de-395b-44b1-99f0-9ab7c972edd3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:11.670957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:11.671911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:11.672342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:11.672764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] PATH_INFO: `/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc/users/81460822123b43b7b220512827c2f6db/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:11.698564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d26ea46a2ef4babab9a27c8cd04dcbc, user_id=81460822123b43b7b220512827c2f6db, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:11.701616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:11.795733 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3871/7775] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:11 2022] PUT /identity/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc/users/81460822123b43b7b220512827c2f6db/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:11.799555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:11.810495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48264e-d4b3-45da-a13a-cc8bbe3df683 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:11.981773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:11.982396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:11.982744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:11.983020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:11.983955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:11.985630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e3524-9c63-49c0-8482-fc5ef89d2508 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:12.016466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:12.017397 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3905/7776] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:12.031633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebf5c1-c481-4859-8ced-609fa69311fc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:12.046729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:12.047654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:12.048009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:12.048492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] PATH_INFO: `/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc/users/81460822123b43b7b220512827c2f6db/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:12.050743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d26ea46a2ef4babab9a27c8cd04dcbc, user_id=81460822123b43b7b220512827c2f6db, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:12.073981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:12.087946 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3872/7777] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:12 2022] PUT /identity/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc/users/81460822123b43b7b220512827c2f6db/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:12.100154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:12.108276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:12.108666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:12.147111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] MFA Rules not processed for user `81460822123b43b7b220512827c2f6db`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:12.148358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:12.240069 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3906/7778] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:12.260708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:12.263392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:12.379333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b1d11-ed66-4f0a-b2ce-0872a4549359 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:12.385434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:12.386510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:12.386789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:12.387062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:12.421453 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:12.475592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:12.477703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e1bc3-92ff-4631-a5cd-02329f5a5fb3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:12.488133 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3873/7779] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:13.765766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:13.767501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:13.783571 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:13.871546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0858b-072c-45da-a2fe-b5be09e40800 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:13.879022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:13.880006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:13.880496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:13.882309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] PATH_INFO: `/v3/users/d27ea5342f604640b89ae6d513a7f85a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:13.882309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27ea5342f604640b89ae6d513a7f85a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:13.887638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:14.106263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27ea5342f604640b89ae6d513a7f85a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:14.193463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27ea5342f604640b89ae6d513a7f85a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:14.194106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27ea5342f604640b89ae6d513a7f85a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:14.218602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27ea5342f604640b89ae6d513a7f85a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:14.234752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27ea5342f604640b89ae6d513a7f85a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:14.266510 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3907/7780] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:13 2022] DELETE /identity/v3/users/d27ea5342f604640b89ae6d513a7f85a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:14.271159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:14.275242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:14.275709 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:14.364530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:14.369746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:14.479029 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3874/7781] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:14.490658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:14.492390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:14.609688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8402f4-0ea6-4bd0-85f0-55ff30706503 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:14.622013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:14.622573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:14.622855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:14.623225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:14.639361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:14.640852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f466f63-7a54-4d14-8db1-09062d8256f6 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:14.654898 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3908/7782] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:14.927159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:14.928644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:14.951998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbec62-2882-465d-a691-4b6ae2b3c7d0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:14.968427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:14.968427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:14.968427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:14.968427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] PATH_INFO: `/v3/projects/057a057acd5c4d3ebe35fce8860347df` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:14.968899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057a057acd5c4d3ebe35fce8860347df)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:14.968899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.131296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057a057acd5c4d3ebe35fce8860347df', 'request_id': 'req-7bb1bb85-c525-4623-b77a-4851108efc35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:15.141468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057a057acd5c4d3ebe35fce8860347df', 'request_id': 'req-7bb1bb85-c525-4623-b77a-4851108efc35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:15.224965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057a057acd5c4d3ebe35fce8860347df', 'request_id': 'req-7bb1bb85-c525-4623-b77a-4851108efc35'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:15.241984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] The token cache is being invalidate because project 057a057acd5c4d3ebe35fce8860347df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:15.242212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:15.243209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7bb1bb85-c525-4623-b77a-4851108efc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:15.245919 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3875/7783] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:14 2022] DELETE /identity/v3/projects/057a057acd5c4d3ebe35fce8860347df => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:15.250526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.251035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.252056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.274286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:15.275795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:15.300726 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:15.344029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3909/7784] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:15.352621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.353139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.353378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.375634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:15.377118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:15.389475 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3876/7785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:15.390634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.401927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ecdac-c454-42a9-ba38-7d41d21c1e33 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.407203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.407877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.408175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.408450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.409134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:15.409508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:15.411171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.434755 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3910/7786] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:51:15.436161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.448867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656c73c-b33b-4c2a-a671-5063c1f21776 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.453774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.454415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.454716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.455334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.456134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:15.458116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.573010 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3877/7787] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:15 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:15.577236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.589672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f4c6-fdd6-4edc-b547-64dc507b8e4d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.676345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.677212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.677649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.678059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.678824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:15.681372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.781708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.782699 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3911/7788] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:15 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:15.808173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41afc5c-c2ee-4034-9514-224fbf76e723 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.821015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.822142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.822629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.823322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.824168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:15.826186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.846195 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3878/7789] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:15.849821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.875201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf1dc1-cdb0-455d-847a-61eac458e5be admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.887428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.888229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.888935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.896453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.896453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:15.899678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee705bc5-ff6b-4d14-99bb-1f09807d3f42 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:15.942651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3912/7790] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:15.947019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:15.962537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396b81-ca7d-4cdd-bc63-4d8e70b43350 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:15.977512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:15.978398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:15.978792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:15.979214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] PATH_INFO: `/v3/projects/2aff8f578cff48989769eb19aa263f08/users/c7370acaf040486c9c930cb076a6c9d2/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:15.983468 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:16.001913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aff8f578cff48989769eb19aa263f08, user_id=c7370acaf040486c9c930cb076a6c9d2, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:16.005770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:16.093244 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3879/7791] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:15 2022] PUT /identity/v3/projects/2aff8f578cff48989769eb19aa263f08/users/c7370acaf040486c9c930cb076a6c9d2/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:16.103268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:16.103868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:16.104471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:16.185615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] MFA Rules not processed for user `c7370acaf040486c9c930cb076a6c9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:16.189058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:16.342016 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3913/7792] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:16.345934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:16.347726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:16.449554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd0ab7-eaf4-43e6-97b0-d71a35dab6ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:16.454231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:16.454959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:16.455249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:16.455516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:16.468443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:16.470036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:16.494778 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3880/7793] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:16.744189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:16.746633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:16.784383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5623-cb85-4e17-9910-200eaa497cb6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:16.806926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:16.809828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:16.811734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:16.812023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:16.819298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:16.861798 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:16.959876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:16.962060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c34b5-ecc8-4e85-a5ec-198b650b38b4 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:16.979383 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3914/7794] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:17.563685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:17.571836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:17.769711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e0c4c-a936-47fe-8577-638817ba2dc2 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:17.789554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:17.790442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:17.790823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:17.791201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] PATH_INFO: `/v3/users/adaaee54d4904ef28bd5b78bb1c7b2fc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:17.792475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaaee54d4904ef28bd5b78bb1c7b2fc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:17.795316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:18.048974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaaee54d4904ef28bd5b78bb1c7b2fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:18.049599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaaee54d4904ef28bd5b78bb1c7b2fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:18.078059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaaee54d4904ef28bd5b78bb1c7b2fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:18.078832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaaee54d4904ef28bd5b78bb1c7b2fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:18.176437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaaee54d4904ef28bd5b78bb1c7b2fc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:18.218078 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3881/7795] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:17 2022] DELETE /identity/v3/users/adaaee54d4904ef28bd5b78bb1c7b2fc => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:18.222224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:18.222709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:18.222709 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:18.299928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:18.301286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:18.418616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3915/7796] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:18.430048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:18.432049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:18.440435 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:18.593692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117e0a-9e6f-45af-87bc-5a72e8a8cbb6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:18.598680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:18.599529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:18.601009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:18.602043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:18.633825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:18.639078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46a518-23c2-480b-8546-92a7c8a67db4 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:18.673263 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3882/7797] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:19.604258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:19.604258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:19.623613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff539aa8-fba1-4e14-b19b-aa234d69ef16 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:19.654735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:19.655482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:19.656008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:19.656502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] PATH_INFO: `/v3/projects/460d84157c4c4366933fd5274ad0fb9b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:19.657904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460d84157c4c4366933fd5274ad0fb9b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:19.662160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:19.837493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460d84157c4c4366933fd5274ad0fb9b', 'request_id': 'req-23f9f7d3-8275-404f-9f7d-87f57c189ce7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:19.919579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460d84157c4c4366933fd5274ad0fb9b', 'request_id': 'req-23f9f7d3-8275-404f-9f7d-87f57c189ce7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:19.929308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460d84157c4c4366933fd5274ad0fb9b', 'request_id': 'req-23f9f7d3-8275-404f-9f7d-87f57c189ce7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:19.951665 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] The token cache is being invalidate because project 460d84157c4c4366933fd5274ad0fb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:19.952100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:19.958034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-23f9f7d3-8275-404f-9f7d-87f57c189ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:19.962677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3916/7798] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:19 2022] DELETE /identity/v3/projects/460d84157c4c4366933fd5274ad0fb9b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:19.964462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:19.964923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:19.965018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:20.025572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:20.026830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:20.220957 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3883/7799] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:20.230714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:20.231014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:20.231272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:20.286313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:20.293788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:20.320264 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3917/7800] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:20.321559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:20.336869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0ce1b-29fd-4293-9e9c-e5d9203e1e20 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:20.362710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:20.363347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:20.363634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:20.363909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:20.364566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:20.364870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:20.366679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:20.393701 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3884/7801] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:20.395345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:20.416016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c976f-a1ab-40ca-bda8-c817655f4041 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:20.442075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:20.455886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:20.455886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:20.455886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:20.455886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:20.455886 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:20.630807 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3918/7802] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:20 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:20.635294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:20.651546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6f7ad-909b-4551-9ef9-055cb95dc016 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:20.858166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:20.858788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:20.859071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:20.859346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:20.859987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:20.862000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:21.008736 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3885/7803] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:20 2022] POST /identity/v3/users => generated 283 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:21.010391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:21.031320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa7462-5755-42d7-9d36-4082098119cc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:21.042147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:21.042787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:21.043074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:21.043401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:21.044165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:21.045794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:21.057603 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:21.065369 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3919/7804] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:21.068157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:21.083308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a0182-f629-4683-82d3-6b38fc3873e4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:21.090528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:21.093260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:21.093260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:21.093260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:21.093260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:21.093991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d0b3-2d8d-4901-bccb-25b376f37bd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:21.108423 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3886/7805] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:21.112504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:21.125947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9c62d-6d84-4a32-8712-7a2d9bd36244 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:21.131474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:21.132270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:21.132551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:21.132826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] PATH_INFO: `/v3/projects/92f2fb1bcfff47d483edb1188255428b/users/8f22832545704f7d89f057be8998159d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:21.173206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f2fb1bcfff47d483edb1188255428b, user_id=8f22832545704f7d89f057be8998159d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:21.188659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:21.322435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3920/7806] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:21 2022] PUT /identity/v3/projects/92f2fb1bcfff47d483edb1188255428b/users/8f22832545704f7d89f057be8998159d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:21.443998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:21.446377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:21.446377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:21.506436 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:21.512956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] MFA Rules not processed for user `8f22832545704f7d89f057be8998159d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:21.514231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:21.662742 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3887/7807] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:21.668381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:21.802672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c8af6-0831-4db0-8673-4bb31c67faa8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:21.808777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:21.814142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:21.814142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:21.814142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:21.814142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:21.816514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:22.142389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:22.150495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3921/7808] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:21 2022] POST /identity/v3/projects => generated 367 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:22.163599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cf68b-7ddc-4a7b-82e7-8d03008353cb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:22.407936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:22.408572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:22.408845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:22.409177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:22.409895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:22.411857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:22.557410 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3888/7809] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:22 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:22.561020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:22.575689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30a737-0ea9-4d89-9d4e-3ca266075b62 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:22.588663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:22.589154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:22.589661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:22.592246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:22.593426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:22.598718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:22.649956 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3922/7810] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:22.652903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:22.675303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b7513-7ed5-472d-94d1-26f426178526 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:22.691162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:22.699803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:22.699803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:22.699803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] PATH_INFO: `/v3/projects/ece0b8f26037408e968aa59ef3240a04/users/319706123d5244fab52efc50b7ea6c55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:22.721508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece0b8f26037408e968aa59ef3240a04, user_id=319706123d5244fab52efc50b7ea6c55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:22.725918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:22.870105 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3889/7811] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:22 2022] PUT /identity/v3/projects/ece0b8f26037408e968aa59ef3240a04/users/319706123d5244fab52efc50b7ea6c55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:22.876897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:22.902115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59513864-d3da-4d0a-9e72-20488b3d7b4f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:23.058439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:23.059291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.059715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.060394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.061298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:23.063143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eff979-3582-44ca-9d45-91cf9562faa1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:23.082580 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3923/7812] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:23.085887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:23.102196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e027-b4aa-4087-9820-86fd19472cb4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:23.107211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:23.108441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.108855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.109392 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] PATH_INFO: `/v3/projects/ece0b8f26037408e968aa59ef3240a04/users/319706123d5244fab52efc50b7ea6c55/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.112121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece0b8f26037408e968aa59ef3240a04, user_id=319706123d5244fab52efc50b7ea6c55, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:23.115009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:23.144367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3890/7813] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:23 2022] PUT /identity/v3/projects/ece0b8f26037408e968aa59ef3240a04/users/319706123d5244fab52efc50b7ea6c55/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:23.156078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.156408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.156632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.228439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] MFA Rules not processed for user `319706123d5244fab52efc50b7ea6c55`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:23.229853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:23.321787 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:23.421598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:23.432656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3924/7814] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:23.436373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378db18b-75ec-43ff-ba77-97a4a280acb3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:23.448765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:23.455435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.455435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.455435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.455435 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:23.455827 n-d-master-1 devstack@keystone.service[82036]: WARNING py.warnings [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:51:23.455827 n-d-master-1 devstack@keystone.service[82036]: warnings.warn(msg) Oct 30 01:51:23.455827 n-d-master-1 devstack@keystone.service[82036]: Oct 30 01:51:23.459605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:23.550052 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3891/7815] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:51:23 2022] POST /identity/v3/regions => generated 224 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:23.554034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:23.564329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77213-2def-4f7e-b514-008cf704e34e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:23.622500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:23.623054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.623335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.629767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.630614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:23.631666 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:51:23.631666 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:51:23.631666 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:51:23.638363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:23.777782 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3925/7816] 10.222.0.13 () {60 vars in 1149 bytes} [Sun Oct 30 01:51:23 2022] POST /identity/v3/regions => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:23.782095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:23.861516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5b247-bcd1-4c86-9406-e76cd3609421 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:23.905057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:23.910787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:23.910787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:23.910787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/5654d059-72bd-4ec6-b0b4-0d7e20750f45` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:23.910787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:create_region(region_id=5654d059-72bd-4ec6-b0b4-0d7e20750f45)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:23.910787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:23.928266 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:24.064925 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3892/7817] 10.222.0.13 () {60 vars in 1259 bytes} [Sun Oct 30 01:51:23 2022] PUT /identity/v3/regions/5654d059-72bd-4ec6-b0b4-0d7e20750f45 => generated 231 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:24.069677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:24.140696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44ca2b-8454-4ceb-a6bc-94ab3152162d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:24.188180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:24.191358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:24.192999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:24.193283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/5654d059-72bd-4ec6-b0b4-0d7e20750f45` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:24.196451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5654d059-72bd-4ec6-b0b4-0d7e20750f45)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:24.199696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:24.301675 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3926/7818] 10.222.0.13 () {58 vars in 1242 bytes} [Sun Oct 30 01:51:24 2022] DELETE /identity/v3/regions/5654d059-72bd-4ec6-b0b4-0d7e20750f45 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:24.307812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:24.342332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742493d4-8305-4a8c-8994-846b54b36497 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:24.407642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:24.408771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:24.409207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:24.409928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:24.411292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:24.414834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:24.525369 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3893/7819] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:51:24 2022] POST /identity/v3/regions => generated 253 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:24.531247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:24.550513 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec5f49-ce2e-4754-9616-11aa38acecdf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:24.615552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:24.616533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:24.616824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:24.617098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:24.618074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:update_region(region_id=bfff1f2997044c1baf2062e8d0d6dc88)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:24.620339 n-d-master-1 devstack@keystone.service[82035]: WARNING py.warnings [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 30 01:51:24.620339 n-d-master-1 devstack@keystone.service[82035]: warnings.warn(msg) Oct 30 01:51:24.620339 n-d-master-1 devstack@keystone.service[82035]: Oct 30 01:51:24.621238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:24.755800 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3927/7820] 10.222.0.13 () {60 vars in 1250 bytes} [Sun Oct 30 01:51:24 2022] PATCH /identity/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88 => generated 254 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:24.759966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:24.785750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a488-9327-4fc3-9705-888355f34109 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:24.836236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:24.838176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:24.838651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:24.841876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:24.842929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:get_region(region_id=bfff1f2997044c1baf2062e8d0d6dc88)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:24.846336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:24.862660 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3894/7821] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:51:24 2022] GET /identity/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88 => generated 254 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:24.866646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:24.901831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b193c1-1ab5-44ef-b220-885044adb787 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:24.923355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:24.924019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:24.924301 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:24.924574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:24.925164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bfff1f2997044c1baf2062e8d0d6dc88)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:24.934482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.028980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3928/7822] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:51:24 2022] DELETE /identity/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:25.030295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.046009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887e949-a432-4047-a6ec-d33a94a27de6 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.094209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.096896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.097811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.097811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.098154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.099257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.138901 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3895/7823] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:51:25 2022] GET /identity/v3/regions => generated 669 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:25.143834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.156139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cfb8-7969-466f-afdb-46d01abe105a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.169065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.169750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.172323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.172323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.173116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bfff1f2997044c1baf2062e8d0d6dc88)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.174834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Could not find region: bfff1f2997044c1baf2062e8d0d6dc88.: keystone.exception.RegionNotFound: Could not find region: bfff1f2997044c1baf2062e8d0d6dc88. Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: bfff1f2997044c1baf2062e8d0d6dc88. Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:51:25.210165 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: bfff1f2997044c1baf2062e8d0d6dc88. Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:25.215103 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3929/7824] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:51:25 2022] DELETE /identity/v3/regions/bfff1f2997044c1baf2062e8d0d6dc88 => generated 112 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 30 01:51:25.217400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.227643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709acf-9e75-468b-b2f9-8826f540153d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.240671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.243470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.243810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.244034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.244655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.248998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.266703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3896/7825] 10.222.0.13 () {58 vars in 1128 bytes} [Sun Oct 30 01:51:25 2022] GET /identity/v3/regions => generated 669 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:25.269061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.285298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23789c-1c12-4dcf-a036-135e42a4954a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.296014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.298621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.300374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.300738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.303413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.308691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.421809 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3930/7826] 10.222.0.13 () {60 vars in 1150 bytes} [Sun Oct 30 01:51:25 2022] POST /identity/v3/regions => generated 253 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:25.423063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.437150 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7cf8b-0d91-48c5-8c83-57567e4c804d tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.473243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.474327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.474838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.475348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.476781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Adding query filter params (parent_region_id=99049d3f9e9d4a58bd30496c508a98bc) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:25.484943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.486475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.503376 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3897/7827] 10.222.0.13 () {58 vars in 1227 bytes} [Sun Oct 30 01:51:25 2022] GET /identity/v3/regions?parent_region_id=99049d3f9e9d4a58bd30496c508a98bc => generated 399 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:51:25.504284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.523514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31cc28-79b7-4cfb-9e4a-80af5f70f9d1 tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.536746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.537491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.537925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.539045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/a413e3f731664158be2617700933ab95` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.539648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a413e3f731664158be2617700933ab95)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.541377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.690228 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3931/7828] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:51:25 2022] DELETE /identity/v3/regions/a413e3f731664158be2617700933ab95 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:25.691652 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.712767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33404d-7f6f-48da-a323-b51a28153d3e tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.768167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.769184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.769694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.770188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/9db2db56ca5a45e392e6d900cea9fc6f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.770991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9db2db56ca5a45e392e6d900cea9fc6f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.773588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.909845 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3898/7829] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:51:25 2022] DELETE /identity/v3/regions/9db2db56ca5a45e392e6d900cea9fc6f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:25.915120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:25.930562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d11c-d6ff-483d-b9fb-6022bb97dbcf tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:25.980901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319706123d5244fab52efc50b7ea6c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ece0b8f26037408e968aa59ef3240a04', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:25.981944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:25.982444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:25.982929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] PATH_INFO: `/v3/regions/99049d3f9e9d4a58bd30496c508a98bc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:25.983721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorizing `identity:delete_region(region_id=99049d3f9e9d4a58bd30496c508a98bc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:25.985600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce534-061d-4114-8ccf-8043f0a83c0c tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:25.989566 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:26.112105 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3932/7830] 10.222.0.13 () {58 vars in 1230 bytes} [Sun Oct 30 01:51:25 2022] DELETE /identity/v3/regions/99049d3f9e9d4a58bd30496c508a98bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:26.116662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:26.389705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1c20-8783-4352-9aa7-6bf446a76d8a tempest-RegionsTestJSON-1338921579 tempest-RegionsTestJSON-1338921579-project-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:26.414659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:26.415748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:26.416174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:26.416897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] PATH_INFO: `/v3/users/8f22832545704f7d89f057be8998159d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:26.418285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f22832545704f7d89f057be8998159d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:26.420296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:26.440890 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:26.624134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f22832545704f7d89f057be8998159d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:26.630710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f22832545704f7d89f057be8998159d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:26.647343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f22832545704f7d89f057be8998159d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:26.650908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f22832545704f7d89f057be8998159d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:26.831466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f22832545704f7d89f057be8998159d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:26.893296 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3899/7831] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:26 2022] DELETE /identity/v3/users/8f22832545704f7d89f057be8998159d => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:26.898625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:26.905868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:26.905868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:26.982032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:26.983228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:27.110244 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3933/7832] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:27.118981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:27.125292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:27.377780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7d88-b571-457b-8e3b-5c81fa84ac37 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:27.383263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:27.387338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:27.387338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:27.387338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:27.401068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:27.402882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:27.421364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3900/7833] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:28.357514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:28.365994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:28.403105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fcd1-1083-45c4-a5d9-c78abab160ff None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:28.421202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:28.422142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:28.422599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:28.423018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] PATH_INFO: `/v3/projects/92f2fb1bcfff47d483edb1188255428b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:28.439641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f2fb1bcfff47d483edb1188255428b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:28.451938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:28.685181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f2fb1bcfff47d483edb1188255428b', 'request_id': 'req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:28.811543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f2fb1bcfff47d483edb1188255428b', 'request_id': 'req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:28.822773 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f2fb1bcfff47d483edb1188255428b', 'request_id': 'req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:28.852035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] The token cache is being invalidate because project 92f2fb1bcfff47d483edb1188255428b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:28.852035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:28.852669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:28.855398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3934/7834] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:28 2022] DELETE /identity/v3/projects/92f2fb1bcfff47d483edb1188255428b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:28.860465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:28.875664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b9f13-d5b2-48a1-b546-2422d8045371 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:29.079419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:29.079419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:29.082010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:29.082394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] PATH_INFO: `/v3/users/319706123d5244fab52efc50b7ea6c55` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:29.089877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=319706123d5244fab52efc50b7ea6c55)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:29.106001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:29.385562 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:29.420462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319706123d5244fab52efc50b7ea6c55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:29.421252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319706123d5244fab52efc50b7ea6c55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:29.437365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319706123d5244fab52efc50b7ea6c55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:29.438270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319706123d5244fab52efc50b7ea6c55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:29.525603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2fd26934-0237-4978-83c8-aff7b81de352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319706123d5244fab52efc50b7ea6c55'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:29.570487 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3901/7835] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:28 2022] DELETE /identity/v3/users/319706123d5244fab52efc50b7ea6c55 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:30.346303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:30.347977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:30.380357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9bf38-770c-4fed-a4ad-77a9bfd69d6a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:30.473414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:30.474787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:30.476080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:30.476586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] PATH_INFO: `/v3/projects/ece0b8f26037408e968aa59ef3240a04` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:30.478104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece0b8f26037408e968aa59ef3240a04)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:30.481909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:30.484370 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:30.661733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece0b8f26037408e968aa59ef3240a04', 'request_id': 'req-73235350-d801-47c3-a147-61e286d45f29'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:30.764830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece0b8f26037408e968aa59ef3240a04', 'request_id': 'req-73235350-d801-47c3-a147-61e286d45f29'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:30.773254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece0b8f26037408e968aa59ef3240a04', 'request_id': 'req-73235350-d801-47c3-a147-61e286d45f29'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:30.798270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] The token cache is being invalidate because project ece0b8f26037408e968aa59ef3240a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:30.798649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:30.802360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-73235350-d801-47c3-a147-61e286d45f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:30.815473 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3935/7836] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:30 2022] DELETE /identity/v3/projects/ece0b8f26037408e968aa59ef3240a04 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:30.821795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:30.822278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:30.822381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:30.866554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:30.868147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:31.052291 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3902/7837] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:31.054197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.054545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.054824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.099240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:31.111000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:31.139983 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3936/7838] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:31.143905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.162354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e574c-0121-41c3-a9e6-30e7c7a8f7b4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.176105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.176774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.177053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.177324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.178064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:31.178371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.184075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:31.217406 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3903/7839] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:31.220119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.234184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e6905-bb40-48ca-adad-e35f10da6b59 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.246830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.247456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.247872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.248158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.248799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.250794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabb5e4-5f99-4742-804b-0f3d6628212c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:31.397961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3937/7840] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:31.402324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.418851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ceb1c-d286-4351-aaaf-4d021ebd7252 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.463288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.463711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.464204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.505818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] MFA Rules not processed for user `33a9a7ae4f5a42d7ac76baf67fdb7a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:31.507400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:31.546585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.547531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.548109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.548597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.549509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.554679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:31.652159 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3938/7841] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:31.662004 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3904/7842] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:31 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:31.672903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.690000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47133b-8055-41aa-bfd9-316b8eec76e1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.700397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.701020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.701460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.701682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.702332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.704198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:31.731787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3939/7843] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:31.733750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.755807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6937731-859d-464e-a6d6-2e0408a91b82 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.788867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.789541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.789823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.790099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.790751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.792356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5de586-9a3b-48aa-bc3d-25c8818950ac admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:31.805917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3905/7844] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:31.810127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:31.823467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155290c-288d-47cb-805d-0a1ca9454c35 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:31.830619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:31.831629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:31.832120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:31.832620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] PATH_INFO: `/v3/projects/b5cad99e787d43e2a4a33e8f0e7c7513/users/0b928f23ffea4ef8b45334f5bc9b8163/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:31.933219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cad99e787d43e2a4a33e8f0e7c7513, user_id=0b928f23ffea4ef8b45334f5bc9b8163, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:31.936142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.033747 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3940/7845] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:31 2022] PUT /identity/v3/projects/b5cad99e787d43e2a4a33e8f0e7c7513/users/0b928f23ffea4ef8b45334f5bc9b8163/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:32.044330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.044330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.044837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.079685 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:32.084377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] MFA Rules not processed for user `0b928f23ffea4ef8b45334f5bc9b8163`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:32.086656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:32.172221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.174205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:32.204509 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3906/7846] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:32.211632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.228526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a31a54-c1a8-480f-99a9-77b7d7f58af3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.231797 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:32.235742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.236581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.237431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.237786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.238988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:create_application_credential(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.241521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.277918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404699f-b612-4a4b-926f-6772af35ad97 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.283088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.283951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.284591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.285323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.288943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:32.319114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.321452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.334118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3941/7847] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:51:32.437365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3907/7848] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:51:32 2022] POST /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials => generated 921 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:32.439860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.453055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33451a-36f0-4f86-87eb-c108b27b4e68 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.458362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.459069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.460013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.460309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/7679c7a209f94f01bcebd1f30b0d8bab` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.462227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:delete_access_rule(user_id=0b928f23ffea4ef8b45334f5bc9b8163, access_rule_id=7679c7a209f94f01bcebd1f30b0d8bab)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.463662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application session.delete(ref) Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application yield resource Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application next(self.gen) Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.rollback() Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.force_reraise() Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 30 01:51:32.533842 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise self.value Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application session.commit() Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._prepare_impl() Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.session.flush() Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._flush(objects) Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 30 01:51:32.538560 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application compat.raise_( Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application flush_context.execute() Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rec.execute(self) Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._synchronize( Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise AssertionError( Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 30 01:51:32.539613 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:51:32.540519 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 01:51:32.541472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3942/7849] 10.222.0.13 () {58 vars in 1362 bytes} [Sun Oct 30 01:51:32 2022] DELETE /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/7679c7a209f94f01bcebd1f30b0d8bab => generated 89 bytes in 96 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 30 01:51:32.541891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.554850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a61f8a-3914-4fd3-98e6-a858e293a458 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.564617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.565302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.565603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.565884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials/374e3614a6fb46a7be0ae26f9fbe3a20` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.602310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:delete_application_credential(user_id=0b928f23ffea4ef8b45334f5bc9b8163, application_credential_id=374e3614a6fb46a7be0ae26f9fbe3a20)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.604064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.744996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3908/7850] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:32 2022] DELETE /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials/374e3614a6fb46a7be0ae26f9fbe3a20 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:32.749409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.759478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed65ac-f6a7-4736-823c-879d4820795e tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.764132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.766395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.766395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.766395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.767525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:list_access_rules(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.769421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.776609 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3943/7851] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:51:32 2022] GET /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules => generated 369 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:32.780573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.792576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.794566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:32.794825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e126ebb-54d8-40a4-9c68-3004d5905cff tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.801106 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.802629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.803107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.803929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/7679c7a209f94f01bcebd1f30b0d8bab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.805640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:delete_access_rule(user_id=0b928f23ffea4ef8b45334f5bc9b8163, access_rule_id=7679c7a209f94f01bcebd1f30b0d8bab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.808054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:32.934631 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3909/7852] 10.222.0.13 () {58 vars in 1362 bytes} [Sun Oct 30 01:51:32 2022] DELETE /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/7679c7a209f94f01bcebd1f30b0d8bab => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:32.935878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:32.956476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb4bb-17fe-4d44-921e-c38f55ff6db2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:32.971585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:32.972068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:32.972354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:32.972631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:32.979865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:list_access_rules(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:32.988449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.009757 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3910/7853] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:51:32 2022] GET /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules => generated 158 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:51:33.014786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.018423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143580a-2fd0-46f4-8819-cac1da342d92 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.029575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d521-0b71-4c57-88ad-c8d69e157952 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.033570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.036830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.036830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.036830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] PATH_INFO: `/v3/users/34dab0e224694d18ae7542b524297aa9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.037752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34dab0e224694d18ae7542b524297aa9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.040393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.043204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.043529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.043816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.044510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:create_application_credential(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.045077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.045689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.120265 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:33.330014 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3911/7854] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:51:33 2022] POST /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials => generated 921 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:33.331003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.350771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34dab0e224694d18ae7542b524297aa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:33.357647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a0158-4c85-4f75-876f-1ae2b3f20146 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.368633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.369299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.369630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.371158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.372671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:list_access_rules(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.374682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.386991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3912/7855] 10.222.0.13 () {58 vars in 1260 bytes} [Sun Oct 30 01:51:33 2022] GET /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:33.390596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.402790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ac084-5804-48ad-b3a0-b57f1b25b313 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.407645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.408384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.408690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.408972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.412324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:create_application_credential(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.414259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.422667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34dab0e224694d18ae7542b524297aa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:33.423356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34dab0e224694d18ae7542b524297aa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:33.456691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34dab0e224694d18ae7542b524297aa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:33.469456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b05169bd-89ed-481c-8bd3-0e8bfdc9414a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34dab0e224694d18ae7542b524297aa9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:33.490859 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3944/7856] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:32 2022] DELETE /identity/v3/users/34dab0e224694d18ae7542b524297aa9 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:33.495523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.496073 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.496548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.523878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:33.525452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:33.567031 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:33.679472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3945/7857] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:33.696411 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3913/7858] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:51:33 2022] POST /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/application_credentials => generated 921 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:33.697630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.698221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.700620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:33.702424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:33.721775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e31d-11b5-4266-8401-fbaec5dd7199 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.816403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea2eb9-2218-48e1-b6a8-1b8af67526a2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.822518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.823355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.823747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.824274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.840463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.843873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.868282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b928f23ffea4ef8b45334f5bc9b8163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.868967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.869257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.869564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/fae5b676614c49828093a2517d3cb205` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.870769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorizing `identity:get_access_rule(user_id=0b928f23ffea4ef8b45334f5bc9b8163, access_rule_id=fae5b676614c49828093a2517d3cb205)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.871887 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3946/7859] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:33.872386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76491a55-4f93-412b-a0b0-0242e4ba17b2 tempest-AccessRulesV3Test-2057150658 tempest-AccessRulesV3Test-2057150658-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:33.895954 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3914/7860] 10.222.0.13 () {58 vars in 1359 bytes} [Sun Oct 30 01:51:33 2022] GET /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163/access_rules/fae5b676614c49828093a2517d3cb205 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:33.902351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:33.904128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:33.933834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ec304-ff27-4736-96b3-41fb773db32a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:33.952971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:33.954675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:33.954955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:33.957802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] PATH_INFO: `/v3/users/0b928f23ffea4ef8b45334f5bc9b8163` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:33.961455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b928f23ffea4ef8b45334f5bc9b8163)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:33.964293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:34.232243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b928f23ffea4ef8b45334f5bc9b8163'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:34.318534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b928f23ffea4ef8b45334f5bc9b8163'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:34.320799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b928f23ffea4ef8b45334f5bc9b8163'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:34.582805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b928f23ffea4ef8b45334f5bc9b8163'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:34.597962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b928f23ffea4ef8b45334f5bc9b8163'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:34.617008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3947/7861] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:33 2022] DELETE /identity/v3/users/0b928f23ffea4ef8b45334f5bc9b8163 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:34.621493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:34.622009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:34.623046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:34.647381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:34.649172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:34.662461 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:34.664883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:34.687347 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:34.734569 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:34.781489 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3915/7862] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:34.791346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:34.791876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1603-1af7-43e3-9c41-558b85498330 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:34.793296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:34.797601 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:34.798281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:34.798965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:34.799332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] PATH_INFO: `/v3/projects/7446a8e0337448619c0efc77f6856feb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:34.802579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7446a8e0337448619c0efc77f6856feb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:34.805744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:34.932521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e260d-9f54-4a93-9775-55cab9a3a586 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:34.962576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7446a8e0337448619c0efc77f6856feb', 'request_id': 'req-86f5c848-cc7a-414a-90e6-1092b65ad910'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:35.015079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.015738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.016083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.016432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.067661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7446a8e0337448619c0efc77f6856feb', 'request_id': 'req-86f5c848-cc7a-414a-90e6-1092b65ad910'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:35.075919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7446a8e0337448619c0efc77f6856feb', 'request_id': 'req-86f5c848-cc7a-414a-90e6-1092b65ad910'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:35.085053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.086808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3922e39-c21e-4205-b685-5c1e148ff4bb service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.097867 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3916/7863] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:51:35.106540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] The token cache is being invalidate because project 7446a8e0337448619c0efc77f6856feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:35.107234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:35.108018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-86f5c848-cc7a-414a-90e6-1092b65ad910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:35.115207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3948/7864] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:34 2022] DELETE /identity/v3/projects/7446a8e0337448619c0efc77f6856feb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:35.115500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.116316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.116600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.154592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:35.157922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:35.178981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.180335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.180729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.190615 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3917/7865] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:35.207640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:35.208854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:35.220738 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3949/7866] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:35.225062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.236292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bc54-62db-4e65-aebb-bf2c8676f6c8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.256538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.260630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.261154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.261491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.262877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:35.263512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.265236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.279726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3918/7867] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:51:35.283888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.307979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38fce9-d926-4454-8a12-dffbbdaaab52 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.314864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.315533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.316244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.316244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.316723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.319867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.504512 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3950/7868] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:35 2022] POST /identity/v3/projects => generated 399 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:35.506153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.519882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513203bc-11e7-415d-b13e-a2e0d6cd66b8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.653826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.654749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.654950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.655284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.655933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.660060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.708881 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:35.793375 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3919/7869] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:35 2022] POST /identity/v3/users => generated 300 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:35.795152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.809526 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9f4e0-cc7f-44e4-888b-da2c52d56379 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.814817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.815436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.815719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.820586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.820586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.820586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.830255 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3951/7870] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:35.834494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.846184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b08dc2-dd30-40f2-a3fc-d8aae2d607d3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.855386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.855386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.855386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.855386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.855865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.855865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.866512 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3920/7871] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:35.870690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.892837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:35.895714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ed06-f164-4fce-8752-fff1538100a0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.900294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:35.918633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed3d4c-f8b2-454d-8f5f-6437fcf9ba4e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:35.923817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.924584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.924813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.925057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] PATH_INFO: `/v3/projects/b5cad99e787d43e2a4a33e8f0e7c7513` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.925292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:35.926117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:35.926276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cad99e787d43e2a4a33e8f0e7c7513)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.926989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:35.927335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] PATH_INFO: `/v3/projects/5c2bdd9b545d4bd9854bdc40fe7fa956/users/7b70abb4b727428faf8aff16657b02c5/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:35.928731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:35.948798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2bdd9b545d4bd9854bdc40fe7fa956, user_id=7b70abb4b727428faf8aff16657b02c5, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:35.952446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2de4-7c21-4b0c-a9a6-fc6b1eede276 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.042083 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3952/7872] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:35 2022] PUT /identity/v3/projects/5c2bdd9b545d4bd9854bdc40fe7fa956/users/7b70abb4b727428faf8aff16657b02c5/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:36.052866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.062268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.062268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.067431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'request_id': 'req-59c5708c-c78e-40cf-adbb-ca91765332da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:36.085597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'request_id': 'req-59c5708c-c78e-40cf-adbb-ca91765332da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:36.086185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] MFA Rules not processed for user `7b70abb4b727428faf8aff16657b02c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:36.087421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:36.156908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cad99e787d43e2a4a33e8f0e7c7513', 'request_id': 'req-59c5708c-c78e-40cf-adbb-ca91765332da'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:36.179224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] The token cache is being invalidate because project b5cad99e787d43e2a4a33e8f0e7c7513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:36.179544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:36.180928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-59c5708c-c78e-40cf-adbb-ca91765332da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:36.188501 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3921/7873] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:35 2022] DELETE /identity/v3/projects/b5cad99e787d43e2a4a33e8f0e7c7513 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:36.190680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1c12-3346-42b1-847f-e51d1bb0e0b4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.191012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1c12-3346-42b1-847f-e51d1bb0e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.191237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1c12-3346-42b1-847f-e51d1bb0e0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.198330 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3953/7874] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:36.206161 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:36.212894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.217716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:36.222967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c79f1c12-3346-42b1-847f-e51d1bb0e0b4 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:36.224567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c79f1c12-3346-42b1-847f-e51d1bb0e0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:36.325457 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3922/7875] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:36.326939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.327228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.327556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.337198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36afbc-e0c9-43c6-a9b1-0ccb6735cccf None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.342053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.343653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.346260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.351334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.354268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:36.354508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:36.356110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:36.369519 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3923/7876] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:36.371728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.373940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.374479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.387015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f576c3-8869-4b51-af87-fef6705a03fc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.392528 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3954/7877] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:51:36.405326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.409730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.411217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.411495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.424216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:36.426604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.431627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.456548 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3924/7878] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:36.456967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.470909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8ea86-1c66-4e5d-ae2f-35f1ed8c95c7 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.478374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.479082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.479469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.479850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.480867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.483991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.625294 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3955/7879] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:36 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:36.626746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.633205 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:36.639502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6299-6308-4cc1-a345-0a8c511379bb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.721158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.721907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.722188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.722462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.723222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.725673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.821459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3925/7880] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:36 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:36.825356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.839540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08a0aa-3137-44c7-9c19-fa94b5cae3e7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.857000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.858358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.858649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.858976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.859730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.862196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.878173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3956/7881] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:36.882122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.902992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24a44-bb8c-4c79-9187-7033ae477946 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.923155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.923840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.924118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.924389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.925969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.932071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8c81-a455-4884-9966-aed94972066a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:36.949198 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3926/7882] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:36.953628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:36.966825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af3773-c4bc-4113-9b07-5989474d4615 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:36.972403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:36.973068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:36.973438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:36.973652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] PATH_INFO: `/v3/projects/3b5f787dd36f4fb98ae1d76039eeea9d/users/b3883e12e26c474e9d5bdce8798fca23/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:36.993221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5f787dd36f4fb98ae1d76039eeea9d, user_id=b3883e12e26c474e9d5bdce8798fca23, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:36.996540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:37.113522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3957/7883] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:36 2022] PUT /identity/v3/projects/3b5f787dd36f4fb98ae1d76039eeea9d/users/b3883e12e26c474e9d5bdce8798fca23/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:37.124808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.125098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.125407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.160696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] MFA Rules not processed for user `b3883e12e26c474e9d5bdce8798fca23`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:37.161962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:37.251978 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3927/7884] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:37.253288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:37.277020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf809be-1763-408e-8d83-34ea54b2b52b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:37.281858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:37.282628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.282921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.283192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.284401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:37.285046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a850b-d502-403b-8ef9-d928d79240a9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:37.484627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3958/7885] 10.222.0.13 () {60 vars in 1314 bytes} [Sun Oct 30 01:51:37 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 789 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:37.485568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:37.500855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ed53-8426-44e1-bad8-fb46fa7792da None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:37.508517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:37.509269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.509579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.509918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/5b815113f0ad43949b29554a5cfe2ff1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.520295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:get_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=5b815113f0ad43949b29554a5cfe2ff1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:37.522661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:37.527540 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3928/7886] 10.222.0.13 () {58 vars in 1392 bytes} [Sun Oct 30 01:51:37 2022] GET /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/5b815113f0ad43949b29554a5cfe2ff1 => generated 689 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:51:37.529713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.530056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.530483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.549318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] MFA Rules not processed for user `b3883e12e26c474e9d5bdce8798fca23`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:37.551084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:37.691495 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3959/7887] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:37 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 30 01:51:37.697201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:37.711695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea4ef-0da5-4814-b0f5-a2d49c72346d tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:37.720309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:37.721286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.721861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.722282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/5b815113f0ad43949b29554a5cfe2ff1` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.723500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=5b815113f0ad43949b29554a5cfe2ff1)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:37.725511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:37.864605 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3929/7888] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:37 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/5b815113f0ad43949b29554a5cfe2ff1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:37.870205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:37.883875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888548-93a8-4ed9-8b91-eb04205d333f None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:37.889408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:37.890174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:37.890627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:37.891159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:37.892014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:37.894406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:37.947926 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:38.122275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.122885 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3960/7889] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:51:37 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 920 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:38.132791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e3a3-0b44-40ac-bcc9-1060e14e6c38 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.138617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.139287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.139573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.139860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/3da06281fc4b48d3b48db9e929ce91b4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.162844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=3da06281fc4b48d3b48db9e929ce91b4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.162844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.236389 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3930/7890] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:38 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/3da06281fc4b48d3b48db9e929ce91b4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:38.241469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.251608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4febc3-6579-4fa1-ba4b-5100b25a3fbc tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.256853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.257602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.257955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.258335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.259059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.260881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.325012 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:38.415820 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3961/7891] 10.222.0.13 () {60 vars in 1315 bytes} [Sun Oct 30 01:51:38 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 812 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:38.416688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.426899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba18ae-039f-4da5-a2f4-74a0d9bca053 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.436224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.436791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.437152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.437543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/290682d069d649199363eda35bd6205f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.447989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=290682d069d649199363eda35bd6205f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.449352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.524956 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3931/7892] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:38 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/290682d069d649199363eda35bd6205f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:38.530047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.539958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eae056-3184-452b-a692-c6e4abd0fc08 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.544195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.544818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.545109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.545410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.546063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.547375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.699814 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3962/7893] 10.222.0.13 () {60 vars in 1314 bytes} [Sun Oct 30 01:51:38 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 788 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:38.704127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.714820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0f04-b851-4032-b5a6-60599bcc9960 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.720205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.720879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.721210 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:38.722338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.723037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.725646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.726384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.923520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3932/7894] 10.222.0.13 () {60 vars in 1314 bytes} [Sun Oct 30 01:51:38 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 787 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:38.925057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.941920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a067d80-8336-4c07-ba23-688c18064059 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.947521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.948754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.949291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.949824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.951028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.953005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:38.967942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3963/7895] 10.222.0.13 () {58 vars in 1293 bytes} [Sun Oct 30 01:51:38 2022] GET /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 1499 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:38.972535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:38.982509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bcb2a-ad8c-43e6-bfb9-8bb63fe5b132 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:38.986783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:38.987443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:38.987719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:38.987990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/b58b996e674f48f49dfd591f1301cf9a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:38.997036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=b58b996e674f48f49dfd591f1301cf9a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:38.998893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.107482 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3933/7896] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:38 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/b58b996e674f48f49dfd591f1301cf9a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:39.111786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.122028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea93d4-af5b-4928-b500-56280f442280 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.127501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.128137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.128417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.128692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/aad5be3b230f4158b01fdc344633fdb7` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.138794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=aad5be3b230f4158b01fdc344633fdb7)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.140327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.220780 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3964/7897] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:39 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/aad5be3b230f4158b01fdc344633fdb7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:39.226251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.235940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c9591-7ce0-4f07-91cb-2b891f4ed480 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.240449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.241159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.241492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.241816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.246358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.246358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.404926 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3934/7898] 10.222.0.13 () {60 vars in 1314 bytes} [Sun Oct 30 01:51:39 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 788 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:39.406748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.450477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8d9e-6678-4bfa-8579-2f30adc581c9 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.457464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.457735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.458017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.458634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.459118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:create_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.466648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.640783 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3965/7899] 10.222.0.13 () {60 vars in 1314 bytes} [Sun Oct 30 01:51:39 2022] POST /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials => generated 789 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:51:39.644718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.654935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b86ba5-1e55-478f-97f6-e5844eff9ac0 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.660424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.661120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.661874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.661874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.666114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Adding query filter params (name=tempest-application_credential-1257474298) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:39.666114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:list_application_credentials(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.666114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.682201 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3935/7900] 10.222.0.13 () {58 vars in 1386 bytes} [Sun Oct 30 01:51:39 2022] GET /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials?name=tempest-application_credential-1257474298 => generated 887 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:39.683069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.696430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda76e-bff4-48cf-883e-6f9a1678f397 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.705466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.706398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.706833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.707252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/b8feb7dc92ce4d54bfc1157dcce9b335` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.718896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=b8feb7dc92ce4d54bfc1157dcce9b335)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.721267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.732006 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:39.825380 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3966/7901] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:39 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/b8feb7dc92ce4d54bfc1157dcce9b335 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:39.827919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:39.838706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e9a4-d46e-47d5-a709-64e9c69917ad tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:39.843618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3883e12e26c474e9d5bdce8798fca23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b5f787dd36f4fb98ae1d76039eeea9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:39.848756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:39.848756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:39.849007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/9ff0f22ab4ef4c3fab33b4be850e5548` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:39.864486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b3883e12e26c474e9d5bdce8798fca23, application_credential_id=9ff0f22ab4ef4c3fab33b4be850e5548)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:39.867912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1060-89b8-44fa-9715-2def06fa3f05 tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:39.871012 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:40.012706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:40.013249 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3936/7902] 10.222.0.13 () {58 vars in 1395 bytes} [Sun Oct 30 01:51:39 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23/application_credentials/9ff0f22ab4ef4c3fab33b4be850e5548 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:40.104597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18525c51-9035-4f09-9288-e8f7741b5b1b tempest-ApplicationCredentialsV3Test-1071831491 tempest-ApplicationCredentialsV3Test-1071831491-project] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:40.111874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:40.112606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:40.115855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:40.115855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] PATH_INFO: `/v3/users/b3883e12e26c474e9d5bdce8798fca23` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:40.115855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3883e12e26c474e9d5bdce8798fca23)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:40.117249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:40.363849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3883e12e26c474e9d5bdce8798fca23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:40.440097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3883e12e26c474e9d5bdce8798fca23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:40.447310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3883e12e26c474e9d5bdce8798fca23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:40.593277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3883e12e26c474e9d5bdce8798fca23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:40.606015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3883e12e26c474e9d5bdce8798fca23'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:40.624447 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3967/7903] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:40 2022] DELETE /identity/v3/users/b3883e12e26c474e9d5bdce8798fca23 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:40.626191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:40.626489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:40.626757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:40.678718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:40.680055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:40.781378 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3937/7904] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:40.828132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:40.830662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:40.923018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e2c17-a658-48d4-80d9-7efaf17a3f4b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:40.926727 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:40.927393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:40.927875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:40.928913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:40.940693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:40.942477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72a2c4-dbd7-4c5b-9686-206643fd64d8 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:40.954370 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3968/7905] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:51:41.735305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:41.737315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:41.771638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86a898-fbc3-4863-b4fb-8e7f8994d8eb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:41.779184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:41.779906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:41.780198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:41.781057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] PATH_INFO: `/v3/projects/3b5f787dd36f4fb98ae1d76039eeea9d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:41.782349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5f787dd36f4fb98ae1d76039eeea9d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:41.787249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:41.925417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5f787dd36f4fb98ae1d76039eeea9d', 'request_id': 'req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:41.933002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5f787dd36f4fb98ae1d76039eeea9d', 'request_id': 'req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:42.027357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5f787dd36f4fb98ae1d76039eeea9d', 'request_id': 'req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:42.050342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] The token cache is being invalidate because project 3b5f787dd36f4fb98ae1d76039eeea9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:42.050632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:42.054260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b96f54ec-84b1-4df7-b398-fe5e3d5a09f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:42.063789 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3938/7906] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:41 2022] DELETE /identity/v3/projects/3b5f787dd36f4fb98ae1d76039eeea9d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:42.064587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.065397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.065823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.128232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:42.130605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:42.138845 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:42.241388 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3969/7907] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:42.246540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.247029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.251567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.309546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:42.310811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:42.340020 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3939/7908] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:42.347336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.365102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef159843-adc6-4e35-92a6-ba9c04b81b02 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.371427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.371990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.372337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.372700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.373739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:42.373939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.375612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.389194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3970/7909] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:42.393300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.403358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc896e9-af6b-4f47-852b-491bb30248fd None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.408215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.408792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.409075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.409377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.410048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.411929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.517258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3940/7910] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:42 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:42.518661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.528656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd095e08-9c32-422e-94b4-c5a92caf15d5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.600239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.600953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.601293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.601748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.602591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.604724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.751509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3971/7911] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:42 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:42.752701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.763876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbad93a-995f-4f29-979d-f261e67709c8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.768500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.769097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.769427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.769705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.770444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.772009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.788005 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3941/7912] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:42.789195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.799687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf7006-14a9-41dd-8ca3-f8d49c7951c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.807358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.807928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.808291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.809473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.809593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.812473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4be07-6102-46b2-800d-02f31cd730ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.826144 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3972/7913] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:42.830856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:42.841178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12288856-5971-49b8-89a6-934497d6152b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:42.846172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:42.846825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.847105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.847379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] PATH_INFO: `/v3/projects/6e7dbb09107246ff9b162ebeb941d62f/users/f037a89887ce44d0bc239d27b4db4efc/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.863952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7dbb09107246ff9b162ebeb941d62f, user_id=f037a89887ce44d0bc239d27b4db4efc, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:42.867363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:42.932282 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:42.937998 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3942/7914] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:42 2022] PUT /identity/v3/projects/6e7dbb09107246ff9b162ebeb941d62f/users/f037a89887ce44d0bc239d27b4db4efc/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:42.949004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:42.949419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:42.949830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:42.985282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] MFA Rules not processed for user `f037a89887ce44d0bc239d27b4db4efc`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:42.986638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:43.055630 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3973/7915] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:43.060665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:43.081903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384e40-4510-4367-bf6c-8fabfb1fec7f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:43.086466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f037a89887ce44d0bc239d27b4db4efc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e7dbb09107246ff9b162ebeb941d62f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:43.087554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:43.088826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:43.089308 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] PATH_INFO: `/v3/domains/default` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:43.090842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:43.093436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5d640-dfc7-437f-b89c-15750a057856 tempest-DefaultDomainTestJSON-48459058 tempest-DefaultDomainTestJSON-48459058-project] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:43.096020 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3943/7916] 10.222.0.13 () {58 vars in 1152 bytes} [Sun Oct 30 01:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:43.106202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:43.121407 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:43.183525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306e5c-df55-4063-8dcb-2dfa3ffd03b9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:43.191719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:43.192360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:43.192635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:43.193230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] PATH_INFO: `/v3/users/f037a89887ce44d0bc239d27b4db4efc` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:43.194127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f037a89887ce44d0bc239d27b4db4efc)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:43.196114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:43.426694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f037a89887ce44d0bc239d27b4db4efc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:43.516708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f037a89887ce44d0bc239d27b4db4efc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:43.520378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f037a89887ce44d0bc239d27b4db4efc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:43.539342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f037a89887ce44d0bc239d27b4db4efc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:43.547112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f037a89887ce44d0bc239d27b4db4efc'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:43.555297 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3974/7917] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:43 2022] DELETE /identity/v3/users/f037a89887ce44d0bc239d27b4db4efc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:43.559906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:43.560188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:43.560488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:43.579695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:43.580914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:43.756258 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3944/7918] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:43.764532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:43.766182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:43.883232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6129-70e6-4c48-a4a5-af4f059aa5e3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:43.887250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:43.888054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:43.888340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:43.888667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:43.910815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:43.910815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c1d94-2529-40c0-82d8-cee42203f8f1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:43.950945 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3975/7919] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:44.454204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:44.454204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:44.466525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c19d9-7f15-48f9-93be-ac7da0466f21 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:44.471478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:44.472336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:44.472770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:44.473190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] PATH_INFO: `/v3/projects/6e7dbb09107246ff9b162ebeb941d62f` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:44.474635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7dbb09107246ff9b162ebeb941d62f)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:44.477632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:44.639623 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7dbb09107246ff9b162ebeb941d62f', 'request_id': 'req-fbe5139c-0ba3-45da-9653-43e0f35e853e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:44.647280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7dbb09107246ff9b162ebeb941d62f', 'request_id': 'req-fbe5139c-0ba3-45da-9653-43e0f35e853e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:44.707617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7dbb09107246ff9b162ebeb941d62f', 'request_id': 'req-fbe5139c-0ba3-45da-9653-43e0f35e853e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:44.733264 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] The token cache is being invalidate because project 6e7dbb09107246ff9b162ebeb941d62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:44.733766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:44.734957 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fbe5139c-0ba3-45da-9653-43e0f35e853e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:44.741948 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3945/7920] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:44 2022] DELETE /identity/v3/projects/6e7dbb09107246ff9b162ebeb941d62f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:44.744265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:44.745063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:44.745360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:44.790091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:44.791733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:44.805887 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:44.928563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3976/7921] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:44.935207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:44.936469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:44.937679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:44.963734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:44.965011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:44.978175 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3946/7922] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:44.979321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:44.989758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5290ea-2223-453d-b3a1-ae5cee364604 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:44.998198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:44.998824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:44.999105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:44.999383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.000196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:45.000713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.002678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.018476 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3977/7923] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:45.022730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.052395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d7f2-5cce-458e-9d82-e7e92d759568 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.066635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.067706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.068216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.068725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.069730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.073043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.179769 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3947/7924] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:45 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:45.183674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.198869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473703-df94-4a37-8c27-804c35b909c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.275938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.275938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.275938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.275938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.276344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.276344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.361704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3978/7925] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:45 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:45.365751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.378476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de11af4-64f2-44d5-a69e-85630af06281 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.385221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.391114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.391114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.391114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.391114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.391114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.405663 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3948/7926] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:45.412406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.430196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabe934-a8ba-43f4-9660-22f3532440d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.435639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.436845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.437172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.437557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.438425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.455101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84e3ec-8349-45b4-9177-23bee1eed31f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.485398 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3979/7927] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:45.487611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.503227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade021c5-423a-4c6c-9989-793a45d7ae76 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.509945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.510801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.511300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.511716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] PATH_INFO: `/v3/projects/8cc2266bd27a432cab28b05af0144414/users/fa6dd670082547f9a82aebef2a86bf0f/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.530369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc2266bd27a432cab28b05af0144414, user_id=fa6dd670082547f9a82aebef2a86bf0f, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.533234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.651077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.651285 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3949/7928] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:45 2022] PUT /identity/v3/projects/8cc2266bd27a432cab28b05af0144414/users/fa6dd670082547f9a82aebef2a86bf0f/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:45.651381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.651677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.694249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] MFA Rules not processed for user `fa6dd670082547f9a82aebef2a86bf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:45.695966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:45.826505 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3980/7929] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:45.837907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:45.840371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:45.865842 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:45.929919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcdbb1-5d43-4110-9178-a76635abbcae admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:45.937869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:45.942190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:45.942473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:45.942860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:45.958230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:45.959903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613942e2-ddae-43a4-88f4-d9ddb9e92303 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:45.973953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3950/7930] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:49.270456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:49.273528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:49.295134 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:49.449113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe456ccb-7328-4978-b6e4-c15f54894e62 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:49.464700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:49.465393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:49.469536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:49.470050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] PATH_INFO: `/v3/users/7b70abb4b727428faf8aff16657b02c5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:49.472889 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b70abb4b727428faf8aff16657b02c5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:49.479284 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:49.747388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b70abb4b727428faf8aff16657b02c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:49.839006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b70abb4b727428faf8aff16657b02c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:49.839728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b70abb4b727428faf8aff16657b02c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:49.864164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b70abb4b727428faf8aff16657b02c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:49.884054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b70abb4b727428faf8aff16657b02c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:49.895751 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3981/7931] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:49 2022] DELETE /identity/v3/users/7b70abb4b727428faf8aff16657b02c5 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:49.900438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:49.904066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:49.904685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:49.950043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:49.951924 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:50.119450 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3951/7932] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:50.141044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:50.142706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:50.326986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692b9c-ceba-419f-8fd4-5465daa5e326 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:50.326986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:50.326986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:50.326986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:50.328018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:50.328018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:50.328018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:50.347547 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3982/7933] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:50.556762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:50.562311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:50.691804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107574ce-0601-4ef1-87c0-ca663a05621b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:50.704690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:50.705567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:50.706010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:50.706482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:50.715009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:50.842914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:50.844616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f286c-87be-41a8-b100-5ffbf1f10ad8 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:50.875878 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3952/7934] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:51.739843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:51.741606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:51.772341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7e319-3cdc-4249-9f45-b784ea5a7409 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:51.781477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:51.782186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:51.782476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:51.782754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] PATH_INFO: `/v3/projects/5c2bdd9b545d4bd9854bdc40fe7fa956` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:51.784986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2bdd9b545d4bd9854bdc40fe7fa956)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:51.792926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:51.901587 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:51.927866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2bdd9b545d4bd9854bdc40fe7fa956', 'request_id': 'req-b7df5c8c-332e-4b97-9c4d-1113e27da53a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:52.016580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2bdd9b545d4bd9854bdc40fe7fa956', 'request_id': 'req-b7df5c8c-332e-4b97-9c4d-1113e27da53a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:52.032654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2bdd9b545d4bd9854bdc40fe7fa956', 'request_id': 'req-b7df5c8c-332e-4b97-9c4d-1113e27da53a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:52.073971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] The token cache is being invalidate because project 5c2bdd9b545d4bd9854bdc40fe7fa956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:52.076930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:52.076930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7df5c8c-332e-4b97-9c4d-1113e27da53a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:52.082834 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3983/7935] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:51 2022] DELETE /identity/v3/projects/5c2bdd9b545d4bd9854bdc40fe7fa956 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:52.088835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.089846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.090479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.100840 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:52.158942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:52.160253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:52.286299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3953/7936] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:52.293491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.293788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.294124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.336966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:52.341498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:52.360340 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3984/7937] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:52.364715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:52.381417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915c1a-8d21-4561-8d3f-8390d19e7392 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:52.389409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:52.390134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.390417 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.390692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.391379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:52.391684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:52.395580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:52.423600 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3954/7938] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:52.428524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:52.440666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95f439-f2ee-45e6-8fb3-ad6da0821197 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:52.456104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:52.456929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.457742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.458189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.460158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:52.465016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:52.647312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:52.648189 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3985/7939] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:52 2022] POST /identity/v3/projects => generated 393 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:52.669617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb577-1878-4769-90e2-0d7b6cec4b3c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:52.830707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:52.831482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.832061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.832519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.833354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:52.837370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:52.946164 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3955/7940] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:52 2022] POST /identity/v3/users => generated 297 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:52.948318 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:52.950762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:52.957084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:52.961211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df6bcb-3271-43e1-85ef-7b646df75702 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:52.966614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:52.967707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:52.968175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:52.968882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:52.970896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:52.972704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:52.987527 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3986/7941] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:52.991388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.007765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f9848-551d-44f6-86bf-1dd32ebb0a4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.013807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.014912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.015362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.015800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.017129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.019394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.034974 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3987/7942] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:53.039599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.094475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d8ca-5b40-4c83-bf53-5619f41db5ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.127038 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.130379 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.130839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.131165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] PATH_INFO: `/v3/projects/f2bf165fe12748b29e66ea4f61364aef/users/f0f51fe515ee4375a252a8d8a98ec77b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.155869 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:53.169042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dc708-1e26-4108-a036-dfdc66e44fd8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.184553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bf165fe12748b29e66ea4f61364aef, user_id=f0f51fe515ee4375a252a8d8a98ec77b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.198046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.198884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.199173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.199451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.205208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:53.212004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00457f7a-10cb-4532-adaf-42d13f3224d7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.260982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.262922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.283428 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3956/7943] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:53.284433 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.286600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:53.308596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0447a3-04b6-4f03-855f-a79c2f03ba1c service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.311205 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3988/7944] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:53 2022] PUT /identity/v3/projects/f2bf165fe12748b29e66ea4f61364aef/users/f0f51fe515ee4375a252a8d8a98ec77b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:53.325414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.325414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.325414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.417245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] MFA Rules not processed for user `f0f51fe515ee4375a252a8d8a98ec77b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:53.420906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:53.447994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.449398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.449832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.450291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] PATH_INFO: `/v3/users/c7370acaf040486c9c930cb076a6c9d2` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.452042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7370acaf040486c9c930cb076a6c9d2)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.467641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.551750 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3989/7945] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:53.557819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.581893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe438f3-5723-4a54-a8f8-aca0ea1824f1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.587801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.588349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.588630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.588899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.589655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.592643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.714817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7370acaf040486c9c930cb076a6c9d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:53.717703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7370acaf040486c9c930cb076a6c9d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:53.718578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3990/7946] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:53 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:53.720456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.741125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7370acaf040486c9c930cb076a6c9d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:53.742841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7370acaf040486c9c930cb076a6c9d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:53.747624 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:53.835087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7aedc-36ad-4f79-8651-88b8f5e386d0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:53.841029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:53.841689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.841971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.842802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.843453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:53.846834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:53.850918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1f663a75-9759-4663-b30d-08ba1043e1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7370acaf040486c9c930cb076a6c9d2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:53.893449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3957/7947] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:51:53 2022] DELETE /identity/v3/users/c7370acaf040486c9c930cb076a6c9d2 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:53.895989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:53.896936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:53.899228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:53.922939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:53.924555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:53.956434 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3991/7948] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:53 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:53.959915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:53.963366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:53.981000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f7b96-4a3c-4c81-838d-68478c96535a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.047140 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3958/7949] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:54.057977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.059744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:54.061811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.062751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.063035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.063303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.066714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.071316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.075981 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:54.101567 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3992/7950] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:54.103481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.119896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392e43-8927-42de-bdab-872a41e0b372 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.125155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.125884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.126163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.126438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] PATH_INFO: `/v3/projects/5645b1258faf4b1483556cea1d3197c3/users/1c171756ca034defa78c77d149f59d86/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.151824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5645b1258faf4b1483556cea1d3197c3, user_id=1c171756ca034defa78c77d149f59d86, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.156091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.192681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e374a53-53eb-4448-9da8-c553002c9c05 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.197602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.198242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.199104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.199441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.211208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.212809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.224125 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3959/7951] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:54.244221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3993/7952] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:54 2022] PUT /identity/v3/projects/5645b1258faf4b1483556cea1d3197c3/users/1c171756ca034defa78c77d149f59d86/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:54.245459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.257284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc3811-a3e3-4338-9b9b-c8c92448799b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.340389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.341193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.341325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.342034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.342683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.344552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7f832-0094-4501-8e89-47a142ced558 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.361299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3960/7953] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:54.361842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.374715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857d22-3a7d-484b-a474-aa7b54e0329b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.380530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.380884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.381164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.381606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] PATH_INFO: `/v3/projects/5645b1258faf4b1483556cea1d3197c3/users/1c171756ca034defa78c77d149f59d86/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.383816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5645b1258faf4b1483556cea1d3197c3, user_id=1c171756ca034defa78c77d149f59d86, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.387674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.413743 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3994/7954] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:54 2022] PUT /identity/v3/projects/5645b1258faf4b1483556cea1d3197c3/users/1c171756ca034defa78c77d149f59d86/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:51:54.415751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.416089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.416366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.448438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] MFA Rules not processed for user `1c171756ca034defa78c77d149f59d86`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:54.449754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:54.575199 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3961/7955] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:54.594376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.596095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:54.668825 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:54.692404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032bf4e-0804-4625-99a5-d8fe80cf3fdc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.698649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.699440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.699715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.699996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.701858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:54.779669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.781307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f8a1-f2bf-44ef-a23c-0b35345674a0 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:54.792980 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3995/7956] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:54.832350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:54.833516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:54.878308 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:54.934795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbae8fa-6884-43f0-aab6-28872c2656a2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:54.939826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:54.940837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:54.940837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:54.941141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] PATH_INFO: `/v3/projects/2aff8f578cff48989769eb19aa263f08` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:54.942364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aff8f578cff48989769eb19aa263f08)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:54.944858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.069644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aff8f578cff48989769eb19aa263f08', 'request_id': 'req-e06ffd42-4bc4-4164-ac3b-f448579940dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:55.075969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aff8f578cff48989769eb19aa263f08', 'request_id': 'req-e06ffd42-4bc4-4164-ac3b-f448579940dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:55.205256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aff8f578cff48989769eb19aa263f08', 'request_id': 'req-e06ffd42-4bc4-4164-ac3b-f448579940dc'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:55.235291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] The token cache is being invalidate because project 2aff8f578cff48989769eb19aa263f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:51:55.235701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:55.236879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e06ffd42-4bc4-4164-ac3b-f448579940dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:51:55.247626 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3962/7957] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:51:54 2022] DELETE /identity/v3/projects/2aff8f578cff48989769eb19aa263f08 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:55.250982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.250982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.250982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.293646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:55.306850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:55.427595 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3996/7958] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:51:55.434113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.434395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.434695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.464949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:55.467363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:55.482623 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3963/7959] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:55.498153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.514218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5da17-c2b7-41b1-9e5d-e257de5c21bd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:55.529132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:55.529747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.530080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.530538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.531145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:51:55.531453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:55.533157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.551739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3997/7960] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:51:55.552536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.566976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a4bc0-5354-44dc-836c-8033baefccee None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:55.574416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:55.575036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.575312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.575578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.576569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:55.578800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.684869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3964/7961] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:51:55 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:55.688497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.716428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d37d4-3bd5-47a2-97c2-d56c10721d73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:55.807343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:55.808329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.808610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.809056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.809887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:55.811876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.914012 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3998/7962] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:51:55 2022] POST /identity/v3/users => generated 281 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:51:55.915192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.926451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5a2f8-87d7-4293-a6cf-0346db005d43 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:55.931598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:55.932192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.932478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.932736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.933420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:55.935018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.945972 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3965/7963] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:51:55.949884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.960239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b37a71-618c-47cd-92cd-d6a7b601ea0e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:55.965170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:55.965823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:55.966095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:55.966361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:55.966996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:55.968584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2fc27-c28a-40c0-92b8-f7d9bfc741ab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:55.971634 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:51:55.981230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 3999/7964] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:51:55.985616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:55.997450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660ff40-d203-4cef-af10-45e566728e66 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:56.003646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:56.004995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:56.004995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:56.004995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] PATH_INFO: `/v3/projects/f04769a3c9e34c84a95991d3bfd5a2d4/users/2fca3101651740baa378ee5a662c676e/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:56.022689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04769a3c9e34c84a95991d3bfd5a2d4, user_id=2fca3101651740baa378ee5a662c676e, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:56.025361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:56.170870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3966/7965] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:51:55 2022] PUT /identity/v3/projects/f04769a3c9e34c84a95991d3bfd5a2d4/users/2fca3101651740baa378ee5a662c676e/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:51:56.258707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917862b-793f-468f-8467-58aad70886c7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:56.259282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917862b-793f-468f-8467-58aad70886c7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:56.259282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917862b-793f-468f-8467-58aad70886c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:56.292238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a917862b-793f-468f-8467-58aad70886c7 None None] MFA Rules not processed for user `2fca3101651740baa378ee5a662c676e`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:51:56.293522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a917862b-793f-468f-8467-58aad70886c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:56.381109 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4000/7966] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:51:56.388377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:56.390404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:56.493657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f276003-5554-4471-99c9-02ba63aae805 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:56.498064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:56.498512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:56.498777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:56.499056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:56.509041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:56.510480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:56.521144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3967/7967] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:51:59.398570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917862b-793f-468f-8467-58aad70886c7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:51:59.400737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a917862b-793f-468f-8467-58aad70886c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:59.600056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917862b-793f-468f-8467-58aad70886c7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:51:59.606850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:51:59.607473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:51:59.607749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:51:59.608074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:51:59.610505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:51:59.641215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:51:59.643279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:51:59.672106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4001/7968] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:51:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:52:02.503920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:02.506523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:02.517043 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:02.542041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491b6a8-4054-462c-a3a2-0dcf356d20ed service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:02.547002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:02.551574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:02.551574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:02.551574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:02.551574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:02.629665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:02.631406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de461f-8505-4b76-bd17-af5553323112 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:02.652143 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3968/7969] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:52:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:52:07.299350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:07.302058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:07.391055 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:07.463802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7273fb-8ed9-4c5b-a6db-1f18ecb15c62 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:07.472584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:07.475215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:07.475740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:07.477238 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] PATH_INFO: `/v3/users/fa6dd670082547f9a82aebef2a86bf0f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:07.480005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6dd670082547f9a82aebef2a86bf0f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:07.486082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:07.748981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6dd670082547f9a82aebef2a86bf0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:07.855823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6dd670082547f9a82aebef2a86bf0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:07.856979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6dd670082547f9a82aebef2a86bf0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:07.886026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6dd670082547f9a82aebef2a86bf0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:07.906309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6dd670082547f9a82aebef2a86bf0f'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:07.913453 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4002/7970] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:52:07 2022] DELETE /identity/v3/users/fa6dd670082547f9a82aebef2a86bf0f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:52:07.920470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b39be-6eb8-4fa7-bda3-4c009d4ca6da None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:07.921050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b39be-6eb8-4fa7-bda3-4c009d4ca6da None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:07.921050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b39be-6eb8-4fa7-bda3-4c009d4ca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:07.978513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-009b39be-6eb8-4fa7-bda3-4c009d4ca6da None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:07.979410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-009b39be-6eb8-4fa7-bda3-4c009d4ca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:08.219441 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3969/7971] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:52:08.231954 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:08.234101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:08.384912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b319-6f3e-4e34-9290-835927dad53e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:08.390992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:08.396654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:08.397224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:08.397694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:08.419602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:08.423344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:08.465658 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4003/7972] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:52:08.563683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0f5c-73e9-4a33-b000-0d6c3309221c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:08.568474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0f5c-73e9-4a33-b000-0d6c3309221c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:08.568754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0f5c-73e9-4a33-b000-0d6c3309221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:08.614836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-caed0f5c-73e9-4a33-b000-0d6c3309221c None None] MFA Rules not processed for user `f0f51fe515ee4375a252a8d8a98ec77b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:08.616336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-caed0f5c-73e9-4a33-b000-0d6c3309221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:08.730287 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3970/7973] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:52:09.124116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:09.126136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:09.163991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8a43a-7e13-46d5-9fae-ee4fb7c22a30 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:09.194095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:09.195777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:09.200022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:09.200530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] PATH_INFO: `/v3/projects/8cc2266bd27a432cab28b05af0144414` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:09.203851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc2266bd27a432cab28b05af0144414)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:09.206429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:09.343014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc2266bd27a432cab28b05af0144414', 'request_id': 'req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:09.348419 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:09.448384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc2266bd27a432cab28b05af0144414', 'request_id': 'req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:09.455585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc2266bd27a432cab28b05af0144414', 'request_id': 'req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:09.480988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] The token cache is being invalidate because project 8cc2266bd27a432cab28b05af0144414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:52:09.481524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:09.482541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ac4f31e8-ee57-4659-ab69-bdef284d6e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:52:09.484522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4004/7974] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:52:09 2022] DELETE /identity/v3/projects/8cc2266bd27a432cab28b05af0144414 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:52:09.490493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:09.491285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:09.491749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:09.591846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:09.593088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:09.614971 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:09.718082 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3971/7975] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:52:09.726421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:09.726699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:09.726970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:09.751177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:09.752783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:09.764583 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4005/7976] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:52:09.769240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:09.799647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1262-394c-4543-ae12-cf8c6b2a6fc8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:09.811143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:09.811783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:09.812560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:09.812560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:09.812983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:52:09.813283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:09.814919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:09.852017 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3972/7977] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:52:09.853198 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:09.866256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76dcd7-059b-424c-b100-684c10d98312 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:09.884450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:09.885483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:09.885763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:09.886037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:09.886684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:09.888633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:10.082118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4006/7978] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:52:09 2022] POST /identity/v3/projects => generated 361 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:52:10.087439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:10.103724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62041d-fa24-46de-bf0a-b9a88d72b452 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:10.195760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:10.198766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:10.200347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:10.200664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:10.201395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:10.203359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:10.391520 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3973/7979] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:52:10 2022] POST /identity/v3/users => generated 281 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:52:10.393122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:10.424109 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64974f-7968-4e31-81cc-2b94f9922e5d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:10.438124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:10.440778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:10.441630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:10.443006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:10.444245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:10.446121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:10.477290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4007/7980] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:52:10.485404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:10.503538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f236d5-0381-4225-a554-7453cb43d39e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:10.516941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:10.517612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:10.522382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:10.522674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:10.523355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:10.524983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f430219-2079-40fb-a205-29f4a26c53ff admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:10.557053 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3974/7981] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:52:10.558375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:10.570330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07657d66-2ab8-42a2-a0ff-70c3444a3f74 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:10.577843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:10.578869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:10.579278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:10.579657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] PATH_INFO: `/v3/projects/c61433067dfa48e096049b9e3cf8be56/users/09c0cdbddb0848789c547df98284b908/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:10.648997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61433067dfa48e096049b9e3cf8be56, user_id=09c0cdbddb0848789c547df98284b908, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:10.648997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:10.790571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4008/7982] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:52:10 2022] PUT /identity/v3/projects/c61433067dfa48e096049b9e3cf8be56/users/09c0cdbddb0848789c547df98284b908/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:52:10.795196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f67b-d7e5-4746-917b-b64b35241030 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:10.795886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f67b-d7e5-4746-917b-b64b35241030 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:10.796379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031f67b-d7e5-4746-917b-b64b35241030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:10.843409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2031f67b-d7e5-4746-917b-b64b35241030 None None] MFA Rules not processed for user `09c0cdbddb0848789c547df98284b908`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:10.845470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2031f67b-d7e5-4746-917b-b64b35241030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:11.034921 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3975/7983] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:52:11.042551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:11.044414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:11.187279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df95a7b-c1ae-467b-91e2-9f38f9e49422 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:11.192539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:11.192539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:11.192539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:11.193056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:11.202887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:11.204338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:11.215143 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4009/7984] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:52:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:52:21.025584 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:21.210838 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:32.563713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:32.564219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:32.564219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:32.609792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] MFA Rules not processed for user `33a9a7ae4f5a42d7ac76baf67fdb7a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:52:32.614521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:32.741575 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3976/7985] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:52:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:52:42.728067 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=25 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:52:58.512647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:52:58.514263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:58.632733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9934b7-e5d9-4ed1-bafb-bcc22a902e49 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:52:58.639923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:52:58.640671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:52:58.641060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:52:58.641573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:52:58.648612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:52:58.667904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:52:58.670466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:52:58.691412 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4010/7986] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:52:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:02.817298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:02.834645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67cd3-5b74-4a97-a918-c76cc87eb9fc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:02.842590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:02.844212 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:02.844981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:02.845552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:02.848399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:02.868639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:02.870988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:02.902932 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3977/7987] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:03.124966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:03.144346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3c346-7de2-43da-a526-42ad4292214a service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:03.151449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:03.152314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:03.152786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:03.153235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:03.155843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:03.173558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:03.176154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:03.195688 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4011/7988] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:03.956894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:03.959287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:03.986342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb14f63-0ecf-4efa-96d6-32552e00b555 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:03.986342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:03.986342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:03.986342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:03.986757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:03.986757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:04.164332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:04.166793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38b7ef-cb06-4efd-9814-cf6979570810 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:04.202112 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3978/7989] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:04.442950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:04.535976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f39-601a-4c3f-93bb-350932908afc service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:04.543816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:04.546383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:04.548677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:04.551625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] PATH_INFO: `/v3/users/09c0cdbddb0848789c547df98284b908` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:04.553570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c0cdbddb0848789c547df98284b908)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:04.556141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:04.776117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c0cdbddb0848789c547df98284b908'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:04.881311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c0cdbddb0848789c547df98284b908'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:04.882507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c0cdbddb0848789c547df98284b908'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:04.907295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c0cdbddb0848789c547df98284b908'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:04.917461 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:04.920337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c0cdbddb0848789c547df98284b908'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:04.937863 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4012/7990] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:04 2022] DELETE /identity/v3/users/09c0cdbddb0848789c547df98284b908 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:04.940602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:04.941136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:04.941677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:04.975349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:04.977443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:05.062527 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3979/7991] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:05.074137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:05.075828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:05.219003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4d603-e783-49d5-9239-129d38abb403 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:05.230745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:05.231376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:05.231653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:05.231995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:05.243319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:05.246474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89073561-0bbd-45ab-bffe-cf4915271a99 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:05.283818 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4013/7992] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:06.056996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:06.058958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:06.083666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799fe3b-5ae5-45a8-8328-8fb6c9ff733d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:06.106490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:06.106490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.106490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.106490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] PATH_INFO: `/v3/projects/c61433067dfa48e096049b9e3cf8be56` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.109609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61433067dfa48e096049b9e3cf8be56)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:06.111605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:06.310558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61433067dfa48e096049b9e3cf8be56', 'request_id': 'req-83110de1-86e5-4059-a431-b8ff9f2e8a37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:06.311893 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:06.331781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61433067dfa48e096049b9e3cf8be56', 'request_id': 'req-83110de1-86e5-4059-a431-b8ff9f2e8a37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:06.431056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61433067dfa48e096049b9e3cf8be56', 'request_id': 'req-83110de1-86e5-4059-a431-b8ff9f2e8a37'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:06.454719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] The token cache is being invalidate because project c61433067dfa48e096049b9e3cf8be56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:06.456369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:06.457510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-83110de1-86e5-4059-a431-b8ff9f2e8a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:06.459703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3980/7993] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:06 2022] DELETE /identity/v3/projects/c61433067dfa48e096049b9e3cf8be56 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:06.464896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.465434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.470691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.492013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:06.493630 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:06.617543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4014/7994] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:06.617990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.618278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.618550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.641257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:06.643379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:06.652391 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3981/7995] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:06.656391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:06.669171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22690-95de-4031-ab48-337c1103e7a9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:06.679368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:06.680210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.680674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.680951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.681824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:53:06.682286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:06.684076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:06.698467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4015/7996] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:53:06.708644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:06.718519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e6d0e-6855-4b8b-9782-a72955c1abcf None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:06.725202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:06.725886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.726143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.726471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.727262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:06.729262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:06.825154 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3982/7997] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:06 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:53:06.827369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:06.838455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbaaca-beaf-4299-8ec1-58c3275a8329 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:06.915217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:06.915875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:06.916169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:06.916440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:06.923336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:06.923336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:07.040188 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4016/7998] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:06 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:07.041712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:07.052410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf0b7-5f19-49c4-b643-40c37c14342a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:07.056991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:07.057680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.058228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.058228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:07.058790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:07.060378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:07.071039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3983/7999] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:07.075121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:07.086365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bbf1d-e40a-433e-8aaa-fe9ff18c6e19 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:07.092535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:07.093217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.093735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.094079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:07.094813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:07.096480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a771da5-2b15-4774-a29a-da2e4b79d31f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:07.109664 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4017/8000] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:07.120287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:07.136014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350e843-da41-41f3-b2ee-5107579be5c0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:07.141165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:07.142105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.142749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.143783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] PATH_INFO: `/v3/projects/85504015863c43cead532f857050f680/users/c184ec406485465cb278c3472e71077a/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:07.160933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85504015863c43cead532f857050f680, user_id=c184ec406485465cb278c3472e71077a, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:07.163663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:07.261918 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3984/8001] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:07 2022] PUT /identity/v3/projects/85504015863c43cead532f857050f680/users/c184ec406485465cb278c3472e71077a/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:07.272699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.272987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.273257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:07.284581 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:07.313522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] MFA Rules not processed for user `c184ec406485465cb278c3472e71077a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:07.315537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:07.384730 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4018/8002] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:07.395948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:07.397744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:07.476940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8704-8f04-4e99-988b-6502e6861e6d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:07.484696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:07.487848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.488563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.489033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:07.500891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:07.503663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f711621-07cb-4b6b-a4f7-379cba868878 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:07.520126 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3985/8003] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:07.920825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:07.993348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75f13b-2466-4b3b-86de-2441157c033a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:07.998299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:07.998957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:07.999235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:07.999509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] PATH_INFO: `/v3/users/c184ec406485465cb278c3472e71077a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:08.000764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c184ec406485465cb278c3472e71077a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:08.003381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:08.261416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c184ec406485465cb278c3472e71077a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:08.355271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c184ec406485465cb278c3472e71077a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:08.356165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c184ec406485465cb278c3472e71077a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:08.382442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c184ec406485465cb278c3472e71077a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:08.391029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c184ec406485465cb278c3472e71077a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:08.398558 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4019/8004] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:07 2022] DELETE /identity/v3/users/c184ec406485465cb278c3472e71077a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:08.402975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:08.403496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:08.403818 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:08.424018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:08.425403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:08.514080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3986/8005] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:53:08.524406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:08.526251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:08.551145 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:08.622666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751d24-5697-4638-8175-1d0a70d45941 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:08.627789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:08.628418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:08.628711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:08.629032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:08.640406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:08.642035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30beca8f-6b44-4915-a8bf-91c8f8d410b3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:08.656209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4020/8006] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:09.333078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:09.334387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:09.349051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dad6b-0b9a-485f-8222-a3795f938a22 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:09.357405 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:09.365280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:09.365595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:09.366062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] PATH_INFO: `/v3/projects/85504015863c43cead532f857050f680` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:09.372815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85504015863c43cead532f857050f680)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:09.374808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:09.392191 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:09.511082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85504015863c43cead532f857050f680', 'request_id': 'req-bfb65374-a8bc-4c8c-910c-e0caffc61731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:09.523354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85504015863c43cead532f857050f680', 'request_id': 'req-bfb65374-a8bc-4c8c-910c-e0caffc61731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:09.595800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85504015863c43cead532f857050f680', 'request_id': 'req-bfb65374-a8bc-4c8c-910c-e0caffc61731'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:09.610082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] The token cache is being invalidate because project 85504015863c43cead532f857050f680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:09.610774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:09.613148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-bfb65374-a8bc-4c8c-910c-e0caffc61731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:09.615853 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3987/8007] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:09 2022] DELETE /identity/v3/projects/85504015863c43cead532f857050f680 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:09.620607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:09.633597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:09.633597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:09.643604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:09.645082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:09.727789 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4021/8008] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:09.739489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:09.740051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:09.740509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:09.764202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:09.765875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:09.774041 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3988/8009] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:09.778675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:09.790107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703ef68-4afd-42d0-9b47-4cd0f6faeb75 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:09.796660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:09.798036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:09.798036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:09.798036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:09.798912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:53:09.799834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:09.801583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:09.823055 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4022/8010] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:53:09.823734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:09.834973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8376b-d4e2-489c-915f-91ad387f882e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:09.840936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:09.843304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:09.843894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:09.844307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:09.846825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:09.850199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.080311 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3989/8011] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:09 2022] POST /identity/v3/projects => generated 383 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:10.084228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:10.103841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8d39-5b91-4491-a1c2-825bd6723c8d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:10.231203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:10.231934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.232922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.233199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.233861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:10.236794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.365955 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4023/8012] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:10 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:10.370561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:10.385217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443dcb8-5b8f-468a-bb9c-eb3dee250068 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:10.404810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:10.407587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.408030 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.408672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.409669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:10.411568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.425961 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3990/8013] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:10.430287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:10.444467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2b602-0e49-4d5a-a510-b15dd3cb2619 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:10.464241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:10.464900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.465183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.465491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.466149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:10.468006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b4583-3254-463d-943d-f999d56f168e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.489315 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4024/8014] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:10.493297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:10.510702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a4a41-9e2a-4dc6-99ec-b23e13294f45 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:10.521891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:10.523359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.523828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.524613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] PATH_INFO: `/v3/projects/8001552254424ac296ba054f37b89866/users/10b5fadf6c7841f383e43975e01c1ba4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.546318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8001552254424ac296ba054f37b89866, user_id=10b5fadf6c7841f383e43975e01c1ba4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:10.551750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.678279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.678756 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.679742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.680360 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3991/8015] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:10 2022] PUT /identity/v3/projects/8001552254424ac296ba054f37b89866/users/10b5fadf6c7841f383e43975e01c1ba4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:53:10.726183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] MFA Rules not processed for user `10b5fadf6c7841f383e43975e01c1ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:10.727418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:10.742447 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:10.810228 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4025/8016] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:10.824465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:10.826205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:10.898340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848c35-3b22-412b-a41e-67dadbac7f1f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:10.903345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:10.903989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:10.904479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:10.904923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:10.917931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:10.919568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:10.931080 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3992/8017] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:11.848661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:11.862627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55cf5-148a-40d6-9d21-d0eb443d5c24 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:11.868079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:11.868743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:11.869090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:11.869503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:11.871607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:11.947608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:11.949749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:11.964532 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4026/8018] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:13.095520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:13.098045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:13.132595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa20f4f-911f-4890-a2a2-0bdaace51534 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:13.137407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:13.138415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:13.138691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:13.138964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] PATH_INFO: `/v3/users/cb21ecdda88d49b59e11a30b0f3afc72` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:13.140226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb21ecdda88d49b59e11a30b0f3afc72)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:13.144142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:13.309416 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:13.319277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb21ecdda88d49b59e11a30b0f3afc72'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:13.319986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb21ecdda88d49b59e11a30b0f3afc72'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:13.327342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb21ecdda88d49b59e11a30b0f3afc72'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:13.328012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb21ecdda88d49b59e11a30b0f3afc72'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:13.402752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb21ecdda88d49b59e11a30b0f3afc72'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:13.437379 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3993/8019] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:13 2022] DELETE /identity/v3/users/cb21ecdda88d49b59e11a30b0f3afc72 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:14.366653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:14.380746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4f21-270f-46fd-b0ed-1e2b28783989 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:14.482963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:14.485849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:14.486414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:14.487091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] PATH_INFO: `/v3/projects/767edc5f9e7a4c81929df4fa8a12d94b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:14.488706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767edc5f9e7a4c81929df4fa8a12d94b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:14.493735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:14.679764 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:14.682240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767edc5f9e7a4c81929df4fa8a12d94b', 'request_id': 'req-39261e7b-99cd-470a-99fc-994d3b65eaf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:14.808945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767edc5f9e7a4c81929df4fa8a12d94b', 'request_id': 'req-39261e7b-99cd-470a-99fc-994d3b65eaf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:14.827769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767edc5f9e7a4c81929df4fa8a12d94b', 'request_id': 'req-39261e7b-99cd-470a-99fc-994d3b65eaf3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:14.844562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] The token cache is being invalidate because project 767edc5f9e7a4c81929df4fa8a12d94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:14.845116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:14.846635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-39261e7b-99cd-470a-99fc-994d3b65eaf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:14.862564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4027/8020] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:14 2022] DELETE /identity/v3/projects/767edc5f9e7a4c81929df4fa8a12d94b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:23.961233 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:25.042280 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:25.194627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:25.196428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:25.211457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d747f1f-0868-498d-b001-c8b618a4386b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:25.279890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:25.280628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:25.281391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:25.281672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] PATH_INFO: `/v3/users/10b5fadf6c7841f383e43975e01c1ba4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:25.282851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b5fadf6c7841f383e43975e01c1ba4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:25.285700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:25.524314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b5fadf6c7841f383e43975e01c1ba4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:25.529149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b5fadf6c7841f383e43975e01c1ba4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:25.538675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b5fadf6c7841f383e43975e01c1ba4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:25.540221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b5fadf6c7841f383e43975e01c1ba4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:25.623635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b5fadf6c7841f383e43975e01c1ba4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:25.645011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3994/8021] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:25 2022] DELETE /identity/v3/users/10b5fadf6c7841f383e43975e01c1ba4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:25.649729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:25.650399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:25.650854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:25.674789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:25.677138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:25.749266 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4028/8022] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:25.765317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:25.768695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:25.828256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444777-e987-435c-95b0-4db175394be8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:25.832565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:25.833171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:25.833495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:25.833773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:25.843420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:25.844843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1fd15-172c-4889-a92e-259bd6431db2 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:25.855065 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3995/8023] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:53:26.272619 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:26.274235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:26.290676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71bdf-9bfd-4635-9732-4c6c60c67bbd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:26.295764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:26.296392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.297408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.297408 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] PATH_INFO: `/v3/projects/8001552254424ac296ba054f37b89866` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.298293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8001552254424ac296ba054f37b89866)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:26.300229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:26.423040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8001552254424ac296ba054f37b89866', 'request_id': 'req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:26.500265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8001552254424ac296ba054f37b89866', 'request_id': 'req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:26.514670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8001552254424ac296ba054f37b89866', 'request_id': 'req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:26.530068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] The token cache is being invalidate because project 8001552254424ac296ba054f37b89866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:26.530432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:26.531189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a8cbabbe-c1d6-4ab8-a9db-d1fd27219ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:26.533323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4029/8024] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:26 2022] DELETE /identity/v3/projects/8001552254424ac296ba054f37b89866 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:26.538045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.538532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.538649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.560574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:26.561922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:26.583635 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:26.627515 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3996/8025] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:26.635683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.636224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.636730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.657997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:26.659360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:26.668385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4030/8026] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:53:26.672337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:26.683238 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ffd6b-5f84-486e-b2fd-4bc4c0a778b3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:26.687991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:26.688718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.689008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.689936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.690592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:53:26.690896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:26.692528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:26.706364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3997/8027] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:53:26.709534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:26.721471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73df38-21ba-41e7-8958-73dfc3abfcc5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:26.726945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:26.736907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.736907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.736907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.736907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:26.736907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:26.862773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4031/8028] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:26 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:26.869947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:26.890111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640a11-3075-4842-b2da-e71170ec67d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:26.988335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:26.988947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:26.989216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:26.989643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:26.990330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:26.992366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.106739 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3998/8029] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:26 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:27.110683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.123014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b8af8-fa28-4864-8ae7-51bb82f6a5b1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.134607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.139028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.139028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.139028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.139028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.139028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.150179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4032/8030] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:27.154398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.166962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0aba5-6a22-4c77-b3c2-4d77086ec58b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.181282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.182190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.182675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.183196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.184045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.186293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5148-4917-40e2-9ac9-88ca4854f0c6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.218034 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 3999/8031] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:53:27.219696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.236701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e438b-2d21-4ead-b485-091636fc00d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.253790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.253790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.253790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.253790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] PATH_INFO: `/v3/projects/28c5cc5676cb4f5fb0736c7bae73e9a6/users/a055ab10e28141bb91aaf53ca9869376/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.276893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c5cc5676cb4f5fb0736c7bae73e9a6, user_id=a055ab10e28141bb91aaf53ca9869376, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.284807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.358402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4033/8032] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:27 2022] PUT /identity/v3/projects/28c5cc5676cb4f5fb0736c7bae73e9a6/users/a055ab10e28141bb91aaf53ca9869376/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:27.359806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.360140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.360418 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.401835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] MFA Rules not processed for user `a055ab10e28141bb91aaf53ca9869376`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:27.404679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:27.506935 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4000/8033] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:53:27.511421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.541986 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:27.595346 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e097d8-1c3d-4a31-9368-be72d4c8c167 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.607479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.608650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.609204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.609670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.615011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.615011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.733969 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4034/8034] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:27 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:27.738904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.756169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294699-b758-4527-88e8-b6a85d0744f7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.773861 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:27.868400 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.869252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.870041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.870371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.872706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.876327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:27.956161 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4001/8035] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:27 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:27.959334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:27.980688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c5ea-08ee-4758-ad08-41e0853a56af admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:27.988937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:27.990518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:27.991164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:27.992286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:27.993511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:27.995731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:28.016604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:28.017739 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4035/8036] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:28.031488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88b71-f9d2-40c5-b0e4-42a11f5b423d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:28.037850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:28.038717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.039097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.039475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] PATH_INFO: `/v3/projects/df619aeccd51439992622e6b92ee815c/users/940064bb22704b1fb4c0826be31b3aa1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.065355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df619aeccd51439992622e6b92ee815c, user_id=940064bb22704b1fb4c0826be31b3aa1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:28.068789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:28.237503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4002/8037] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:28 2022] PUT /identity/v3/projects/df619aeccd51439992622e6b92ee815c/users/940064bb22704b1fb4c0826be31b3aa1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:53:28.239197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:28.250662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f926e-2b1f-4743-a43c-a70bc548d050 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:28.354022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:28.355358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.355645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.355965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.356701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:28.358579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d1bb-ccd7-45c4-92ad-c2f6415b992d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:28.370484 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4036/8038] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:28.374315 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:28.388474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fa1a8-5efd-4f24-bc37-036d2a9245c3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:28.395452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:28.396260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.396643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.397396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] PATH_INFO: `/v3/projects/df619aeccd51439992622e6b92ee815c/users/940064bb22704b1fb4c0826be31b3aa1/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.399350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df619aeccd51439992622e6b92ee815c, user_id=940064bb22704b1fb4c0826be31b3aa1, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:28.402397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:28.418497 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4003/8039] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:28 2022] PUT /identity/v3/projects/df619aeccd51439992622e6b92ee815c/users/940064bb22704b1fb4c0826be31b3aa1/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:28.431100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.431701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.431980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.465930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] MFA Rules not processed for user `940064bb22704b1fb4c0826be31b3aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:28.467462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:28.554206 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4037/8040] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:28.566440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:28.568171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:28.640524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4da980-7e36-4df2-8ced-9753675005fb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:28.645205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:28.646543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.646543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.646755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.657378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:28.659090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:28.670019 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4004/8041] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:53:28.955533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:28.969041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22e0a8-6704-4734-82fc-817fad6013f1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:28.974553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:28.975369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:28.975821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:28.976239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:28.991301 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:29.038986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:29.041863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0428c9c-36ea-49bb-829d-137fef17cce5 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:29.061987 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4038/8042] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:29.697029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:29.698833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:29.770274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8ad2e-3ff2-422c-bee3-5642c0c9beaf service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:29.774840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:29.775467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:29.775741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:29.776010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] PATH_INFO: `/v3/users/2fca3101651740baa378ee5a662c676e` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:29.777116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fca3101651740baa378ee5a662c676e)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:29.779057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:29.794086 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:30.013165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fca3101651740baa378ee5a662c676e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.013922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fca3101651740baa378ee5a662c676e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.021915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fca3101651740baa378ee5a662c676e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.022619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fca3101651740baa378ee5a662c676e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.099621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fca3101651740baa378ee5a662c676e'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.119642 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4005/8043] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:29 2022] DELETE /identity/v3/users/2fca3101651740baa378ee5a662c676e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:53:30.124382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:30.124848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:30.124970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:30.148735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:30.150163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:30.221153 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4039/8044] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:53:30.231220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:30.232850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:30.294108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de91f6-0686-4aad-ab40-cfccb1809897 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:30.298599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:30.299780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:30.300162 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:30.300446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:30.312561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:30.314641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f5d46-b21c-44e8-8d0a-2379654d494c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:30.324714 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4006/8045] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:30.637200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:30.638636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:30.651059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eff53-2f49-4345-8a6b-39f2cce8e9b2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:30.656194 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:30.656825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:30.657105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:30.657426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] PATH_INFO: `/v3/projects/f04769a3c9e34c84a95991d3bfd5a2d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:30.659119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04769a3c9e34c84a95991d3bfd5a2d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:30.661021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:30.821683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04769a3c9e34c84a95991d3bfd5a2d4', 'request_id': 'req-6b4a5737-d82a-422d-842f-feea8812f0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.871280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04769a3c9e34c84a95991d3bfd5a2d4', 'request_id': 'req-6b4a5737-d82a-422d-842f-feea8812f0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.881324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04769a3c9e34c84a95991d3bfd5a2d4', 'request_id': 'req-6b4a5737-d82a-422d-842f-feea8812f0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.898002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] The token cache is being invalidate because project f04769a3c9e34c84a95991d3bfd5a2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:30.898443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.899784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6b4a5737-d82a-422d-842f-feea8812f0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:30.901676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4040/8046] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:30 2022] DELETE /identity/v3/projects/f04769a3c9e34c84a95991d3bfd5a2d4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:30.906659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:30.907159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:30.907516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:30.932386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:30.933787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:31.002449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4007/8047] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:31.010326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.010610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.010882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.032112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:31.033873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:31.042070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4041/8048] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:53:31.046343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.056845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f22db6-c953-425d-aff4-0b99d9ace90f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.061770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.062438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.062718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.063018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.063693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:53:31.063967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.065658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.078047 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4008/8049] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:53:31.082166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.092593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd75e9-05c2-489c-9635-13c9b26f2637 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.098277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.099056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.099341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.099615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.100265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.102723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.208141 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4042/8050] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:31 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:53:31.209420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.220219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1df1f-7841-45f9-82fa-5ce35293d46f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.240943 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:31.280481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.282458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.282744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.283554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.284189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.286230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.396780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4009/8051] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:31 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:31.398093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.417438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb4b64-4558-47d4-9cb3-392293e21b10 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.424774 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.425452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.425735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.426005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.426651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.428245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.430717 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:31.439353 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4043/8052] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:31.443660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.454449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961360fb-863c-48ec-ab1b-54accd0e9ff0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.459785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.460388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.460669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.471551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.471551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.471551 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77db442-6543-45fc-a3fe-01df6161f60b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.475986 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4010/8053] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:53:31.480171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.490210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4555e9-e61d-4338-8778-c884b98703bb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.495338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.495993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.496269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.496540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] PATH_INFO: `/v3/projects/417533c97f0248fdb097b257103c090a/users/17bfcd6ee16747dfa93666f03b8a3795/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.518603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417533c97f0248fdb097b257103c090a, user_id=17bfcd6ee16747dfa93666f03b8a3795, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.521327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.607141 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4044/8054] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:31 2022] PUT /identity/v3/projects/417533c97f0248fdb097b257103c090a/users/17bfcd6ee16747dfa93666f03b8a3795/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:31.617004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.617283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.617662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.673847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] MFA Rules not processed for user `17bfcd6ee16747dfa93666f03b8a3795`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:31.675067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:31.743849 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4011/8055] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:31.757188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:31.759172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:31.836336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74c8d-4db6-47c9-a744-26b7859dc326 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:31.840490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:31.841287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:31.842658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:31.842923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:31.852752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:31.854359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:31.888072 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4045/8056] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:35.457894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:35.459975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:35.568527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97473a7-d646-4d67-bde0-b6003027b68f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:35.575440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:35.576073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:35.576354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:35.576628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:35.582306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:35.651904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:35.653764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496a7e1-a002-45d9-89c3-86df9f6eabfa service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:35.683652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4012/8057] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:42.294473 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:45.665968 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:46.449906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:46.451382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:46.616065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a498b49-a17d-4cd6-9328-d2d72924e232 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:46.622217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:46.622944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:46.623228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:46.623503 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] PATH_INFO: `/v3/users/a055ab10e28141bb91aaf53ca9869376` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:46.625323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a055ab10e28141bb91aaf53ca9869376)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:46.628032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:46.912320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a055ab10e28141bb91aaf53ca9869376'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:47.049417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a055ab10e28141bb91aaf53ca9869376'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:47.050016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a055ab10e28141bb91aaf53ca9869376'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:47.070529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a055ab10e28141bb91aaf53ca9869376'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:47.079121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a055ab10e28141bb91aaf53ca9869376'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:47.087314 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4046/8058] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:46 2022] DELETE /identity/v3/users/a055ab10e28141bb91aaf53ca9869376 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:47.092152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:47.092688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:47.092843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:47.115425 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:47.116864 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:47.209484 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4013/8059] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:47.224328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:47.224328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:47.326122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7659a2-b2bf-45f6-8edc-269a93072033 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:47.330658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:47.331300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:47.331759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:47.332190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:47.346598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:47.348673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:47.377901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4047/8060] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:48.215453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:48.217096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:48.273206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce933-866d-45c9-b782-471cf675bc2e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:48.284179 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:48.289773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:48.289773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:48.289773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] PATH_INFO: `/v3/projects/28c5cc5676cb4f5fb0736c7bae73e9a6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:48.289773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c5cc5676cb4f5fb0736c7bae73e9a6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:48.291075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:48.479197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c5cc5676cb4f5fb0736c7bae73e9a6', 'request_id': 'req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:48.488381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c5cc5676cb4f5fb0736c7bae73e9a6', 'request_id': 'req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:48.585689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c5cc5676cb4f5fb0736c7bae73e9a6', 'request_id': 'req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:48.616677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] The token cache is being invalidate because project 28c5cc5676cb4f5fb0736c7bae73e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:48.616975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:48.617703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-2f0a1f00-2f6e-446a-870b-6b3b68b1b598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:48.619666 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4014/8061] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:48 2022] DELETE /identity/v3/projects/28c5cc5676cb4f5fb0736c7bae73e9a6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:48.623396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:48.634460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c08f9-5306-4c90-b2e3-00fd2d713d38 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:48.654155 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:48.698065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:48.698799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:48.699151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:48.699522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] PATH_INFO: `/v3/users/940064bb22704b1fb4c0826be31b3aa1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:48.701204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=940064bb22704b1fb4c0826be31b3aa1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:48.703222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:48.913948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940064bb22704b1fb4c0826be31b3aa1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.014724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940064bb22704b1fb4c0826be31b3aa1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.015988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940064bb22704b1fb4c0826be31b3aa1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.029743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940064bb22704b1fb4c0826be31b3aa1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.037649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940064bb22704b1fb4c0826be31b3aa1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.043714 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4048/8062] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:53:48 2022] DELETE /identity/v3/users/940064bb22704b1fb4c0826be31b3aa1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:49.153797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:49.154112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:49.154388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:49.174489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] MFA Rules not processed for user `33a9a7ae4f5a42d7ac76baf67fdb7a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:49.175763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:49.233273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4015/8063] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:49.560914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:49.562356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:49.604728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:49.606383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:49.638769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95e0e3-0333-4e92-a275-4c1bc8d59c8c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:49.643927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:49.644544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:49.644822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:49.645093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:49.647771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:49.651546 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:49.664134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:49.665769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85677-8f88-4a4a-9f9f-f5eadf85cf6a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:49.680368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4049/8064] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:49.688829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e50ea-97d1-4a59-bc55-7fd2f3d52e95 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:49.693627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:49.694502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:49.694782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:49.695047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] PATH_INFO: `/v3/projects/df619aeccd51439992622e6b92ee815c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:49.696343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df619aeccd51439992622e6b92ee815c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:49.699787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:49.801700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df619aeccd51439992622e6b92ee815c', 'request_id': 'req-b8c71fcc-2226-46ef-bad7-75c9f3957236'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.809407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df619aeccd51439992622e6b92ee815c', 'request_id': 'req-b8c71fcc-2226-46ef-bad7-75c9f3957236'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.900201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df619aeccd51439992622e6b92ee815c', 'request_id': 'req-b8c71fcc-2226-46ef-bad7-75c9f3957236'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.915608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] The token cache is being invalidate because project df619aeccd51439992622e6b92ee815c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:53:49.915897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.916556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b8c71fcc-2226-46ef-bad7-75c9f3957236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:53:49.918213 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4016/8065] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:53:49 2022] DELETE /identity/v3/projects/df619aeccd51439992622e6b92ee815c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:53:49.923277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:49.923559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:49.923829 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:49.943846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:49.945069 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:49.993981 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:50.016482 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4050/8066] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:50.026261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.026620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.027111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.050032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:50.051285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:50.059869 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4017/8067] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:50.064636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.074778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c7bba-6297-4507-925a-59b26f806681 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.080018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.080626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.080936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.081213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.081901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:53:50.082204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.083794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.099920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4051/8068] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:53:50.101082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.111195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd816fe1-9f0b-41f3-a790-2861f5410b7e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.115991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.116601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.116880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.117158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.117822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.119797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.240556 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4018/8069] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:50 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:53:50.247008 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.265504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.268386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:50.280111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c09a5-8eaa-466c-88d2-3092b95552e0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.396034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443b073-4ffb-4dae-a9b9-5f0eb2718b38 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.404542 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.405824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.406108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.406389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.408607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.409228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.409521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.409794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.410656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.412416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:50.416437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.503654 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4052/8070] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:50 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:50.508276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.509970 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.510094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.520000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02f7c-c01e-4f32-9b26-ec541e418761 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.524465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4019/8071] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:50.524714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.525309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.525620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.525892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.526528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.528137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.541376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4053/8072] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:50.544952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.556781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf9e7-be54-4e5d-8235-b38a21d288e9 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.562426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.563203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.563780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.564102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.564782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.566731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b715c-1738-46f4-8835-ab2c9fb411c6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.581922 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4020/8073] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:53:50.582771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.593493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97083fa-2e32-48c4-aec9-a11cd181526f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.598887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.599534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.599818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.600092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] PATH_INFO: `/v3/projects/382d1c26a1d64ef182c763f2edb65f30/users/4e0f681a707548a39d85567c6eb85429/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.615377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382d1c26a1d64ef182c763f2edb65f30, user_id=4e0f681a707548a39d85567c6eb85429, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.618161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:50.726065 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4054/8074] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:50 2022] PUT /identity/v3/projects/382d1c26a1d64ef182c763f2edb65f30/users/4e0f681a707548a39d85567c6eb85429/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:50.736761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.737659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.737947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.776229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] MFA Rules not processed for user `4e0f681a707548a39d85567c6eb85429`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:50.777506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:50.846409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4021/8075] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:50.851759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:50.943222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fbba4-6198-420f-8ede-5b7ebb3e43d2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:50.948698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:50.949781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:50.955661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:50.955661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:50.955661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:50.955661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.057396 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4055/8076] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:53:50 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:51.061284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.072119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc6cec-ac4e-43fe-8724-22adb5f170ca None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.131465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.131932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.132211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.132485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.134394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.135316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.213286 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4022/8077] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:53:51 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:53:51.217723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.230547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475bd5-3b6f-47a3-a15f-6f970f57e881 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.238157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.239101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.239859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.239984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.240801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.242745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.274063 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4056/8078] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:51.278161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.290028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e479ba1-486e-4487-ba24-c2fba3a489ab admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.304702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.305522 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.305804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.306077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] PATH_INFO: `/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35/users/660d2295a987441581d7858166ff286a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.323753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb212d8d7e2487a9e6b067927fe5c35, user_id=660d2295a987441581d7858166ff286a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.326620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.385225 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:51.393116 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4023/8079] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:51 2022] PUT /identity/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35/users/660d2295a987441581d7858166ff286a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:53:51.397144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.408896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977d073-eae2-44d7-a5d3-51d55e67c8e1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.482753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.483286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.483618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.483906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.484710 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.487012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ea393-bee7-4214-994c-46ea20f6ad14 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.503312 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4057/8080] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:53:51.507389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.519757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a30c3-60ac-49ae-9d03-f0647ef2c67d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.527653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.528503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.528859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.529201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] PATH_INFO: `/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35/users/660d2295a987441581d7858166ff286a/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.531409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb212d8d7e2487a9e6b067927fe5c35, user_id=660d2295a987441581d7858166ff286a, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.534439 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.546966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4024/8081] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:53:51 2022] PUT /identity/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35/users/660d2295a987441581d7858166ff286a/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:53:51.558260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.558549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.558905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.576024 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:51.591101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] MFA Rules not processed for user `660d2295a987441581d7858166ff286a`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:53:51.592873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:51.758517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4058/8082] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:53:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:53:51.767560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:51.769414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:51.847568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3988-c4d2-4d24-a592-9b7d44f3aac3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:51.853649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:51.854938 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:51.855223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:51.855601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:51.930473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:51.931922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:51.941415 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4025/8083] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:52.488906 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:54.046680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:54.124635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d6b70-5237-4a52-b3bc-2e1dfedebc99 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:54.131294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:54.132025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:54.132378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:54.132664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:54.134717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:53:54.187117 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:53:54.261686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:54.263248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:54.281509 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4059/8084] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:53:57.353033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:53:57.370837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc53c-0c54-4949-b1fe-06b7d262521d service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:53:57.375079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:53:57.375754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:53:57.376584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:53:57.378674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:53:57.388021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:53:57.391729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad69ac1-035a-4a43-b265-afa2ea597b98 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:53:57.411115 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4026/8085] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:53:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:04.273420 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=17 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:07.399270 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=1,keystone:SELECT=56 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:08.238621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:08.317455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ecb23-178b-47bd-b0c3-611634ef60a2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:08.326213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:08.327160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:08.327651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:08.328133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] PATH_INFO: `/v3/users/4e0f681a707548a39d85567c6eb85429` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:08.329837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0f681a707548a39d85567c6eb85429)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:08.332015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:08.584466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0f681a707548a39d85567c6eb85429'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:08.671587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0f681a707548a39d85567c6eb85429'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:08.673185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0f681a707548a39d85567c6eb85429'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:08.714691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0f681a707548a39d85567c6eb85429'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:08.726255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0f681a707548a39d85567c6eb85429'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:08.740390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4060/8086] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:08 2022] DELETE /identity/v3/users/4e0f681a707548a39d85567c6eb85429 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:08.744939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:08.745479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:08.745778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:08.776671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:08.780564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:08.890483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4027/8087] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:08.971772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:08.973611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:09.107583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b17b44-a239-4af7-a467-7f6183085af1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:09.122933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:09.124851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:09.125846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:09.126962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:09.147811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:09.152486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:09.181645 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4061/8088] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:10.482532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:10.484135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:10.505482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbab046-eb67-4358-8c8b-ae0eb4f6d006 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:10.510958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:10.511706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:10.512192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:10.516269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] PATH_INFO: `/v3/projects/382d1c26a1d64ef182c763f2edb65f30` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:10.516269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382d1c26a1d64ef182c763f2edb65f30)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:10.516269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:10.676313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382d1c26a1d64ef182c763f2edb65f30', 'request_id': 'req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:10.691721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382d1c26a1d64ef182c763f2edb65f30', 'request_id': 'req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:10.777677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382d1c26a1d64ef182c763f2edb65f30', 'request_id': 'req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:10.791693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] The token cache is being invalidate because project 382d1c26a1d64ef182c763f2edb65f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:10.792077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:10.792833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:10.794642 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4028/8089] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:10 2022] DELETE /identity/v3/projects/382d1c26a1d64ef182c763f2edb65f30 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:10.799159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:10.809986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8dee8-7b5c-499d-a91d-93fd44b72ee3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:10.841178 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:10.882401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:10.883045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:10.883327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:10.883650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] PATH_INFO: `/v3/users/660d2295a987441581d7858166ff286a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:10.884815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660d2295a987441581d7858166ff286a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:10.886858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:11.115187 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660d2295a987441581d7858166ff286a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.196262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660d2295a987441581d7858166ff286a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.197465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660d2295a987441581d7858166ff286a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.218257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660d2295a987441581d7858166ff286a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.226205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-289b64eb-bb14-4417-90c7-baa995a7e5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660d2295a987441581d7858166ff286a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.232610 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4062/8090] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:10 2022] DELETE /identity/v3/users/660d2295a987441581d7858166ff286a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:11.712783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:11.714539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:11.729164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dd6e-e532-4e65-a82f-a3fa0a3eefa3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:11.792339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:11.793100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:11.793605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:11.793885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] PATH_INFO: `/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:11.795046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb212d8d7e2487a9e6b067927fe5c35)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:11.797130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:11.893975 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:11.910816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb212d8d7e2487a9e6b067927fe5c35', 'request_id': 'req-fb8b353f-eb70-4064-94dd-692a0e2cce71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:11.916725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb212d8d7e2487a9e6b067927fe5c35', 'request_id': 'req-fb8b353f-eb70-4064-94dd-692a0e2cce71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:12.020352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb212d8d7e2487a9e6b067927fe5c35', 'request_id': 'req-fb8b353f-eb70-4064-94dd-692a0e2cce71'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:12.034136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] The token cache is being invalidate because project 6eb212d8d7e2487a9e6b067927fe5c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:12.034426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:12.035216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fb8b353f-eb70-4064-94dd-692a0e2cce71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:12.036635 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4029/8091] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:11 2022] DELETE /identity/v3/projects/6eb212d8d7e2487a9e6b067927fe5c35 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:12.046146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.047560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.047887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.068274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:12.069528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:12.134538 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4063/8092] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:12.143823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.144123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.150132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.164483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:12.165711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:12.174438 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4030/8093] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:12.178629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.192474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb97a4-16ba-4aff-9af6-cd9f30af7247 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.197534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.198140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.198424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.198704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.199355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:54:12.199661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.201295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.214468 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4064/8094] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:54:12.219126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.228516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0afbb-5b90-4b55-a323-f36a32dd51fb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.233350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.234022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.234553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.235011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.236178 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.238182 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.332545 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4031/8095] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:12.336724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.347483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19511d4c-ec3e-4924-bd41-95177a08ccdc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.392236 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:12.424177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.425609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.426113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.426587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.427226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.429146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.520920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4065/8096] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:12.522335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.532639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e3cc-566d-44b1-9409-e26f09ce28b8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.537457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.538057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.538342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.538616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.539256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.540866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.555007 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4032/8097] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:12.556248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.567292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85838f9-78fa-4b2e-b310-8efda3406c05 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.572137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.572738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.573025 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.573450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.574319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.575966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ac675-fd05-4d05-b0ab-6136c19653f2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.587635 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4066/8098] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:12.592172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.605274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ceae8-982f-43e7-86d2-054dee16432c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.613303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.614290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.615117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.615678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] PATH_INFO: `/v3/projects/3998b7d3ed60468ca63818d0166cda27/users/260a13da9ff94b81b4cad53082c8a473/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.636285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3998b7d3ed60468ca63818d0166cda27, user_id=260a13da9ff94b81b4cad53082c8a473, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.641117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:12.729151 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4033/8099] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:12 2022] PUT /identity/v3/projects/3998b7d3ed60468ca63818d0166cda27/users/260a13da9ff94b81b4cad53082c8a473/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:12.740271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.741006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.741368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.773746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] MFA Rules not processed for user `260a13da9ff94b81b4cad53082c8a473`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:12.774977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:12.845953 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4067/8100] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:12.850697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:12.941290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf2a9c-6b9d-4690-ab9d-16e2bb6d360d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:12.946202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:12.946886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:12.947195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:12.947469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:12.948109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:12.950053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.073075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4034/8101] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:12 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:13.077409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.089057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21970258-8acc-4e2d-8a87-b57690731d51 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.162536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.166815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.166815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.166815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.166815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.166815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.247376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4068/8102] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:13 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:54:13.248663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.261690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4ed2b-f90f-40a2-b36b-3cd09c79191d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.266952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.270219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.270219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.270219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.270219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.270689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.282045 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4035/8103] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:13.288183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.300821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82d0cd-d0f3-4225-9bec-a02fb6e05545 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.306045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.306658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.306936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.307201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.307863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.309523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694b473-94dd-4703-a615-9cfaece1d76f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.322080 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4069/8104] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:13.330641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.340918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5644eb4-35a5-4718-8b8a-12072e2943ec admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.345907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.346558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.346839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.347115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] PATH_INFO: `/v3/projects/3863714c369144728b6840e7e118de52/users/639007f4f5974960bfd4e3d38844627b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.362994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3863714c369144728b6840e7e118de52, user_id=639007f4f5974960bfd4e3d38844627b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.365910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.443859 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:13.451174 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4036/8105] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:13 2022] PUT /identity/v3/projects/3863714c369144728b6840e7e118de52/users/639007f4f5974960bfd4e3d38844627b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:13.461490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.461839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.462048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.490918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] MFA Rules not processed for user `639007f4f5974960bfd4e3d38844627b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:13.492107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:13.496090 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:13.556651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4070/8106] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:13.562267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.631791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6e871-d6af-46cc-b758-25509012d619 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.637832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.639347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.639347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.639347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.640318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.642445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.754538 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4037/8107] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:13 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:13.755612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.766570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ab31-af7f-4a1e-af6a-ebfa56a07758 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.823898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.824558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.824855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.825131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.825823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.827855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.935024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4071/8108] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:13 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:13.938778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.949262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c734d61-82ec-4afc-8d52-6edbfba09467 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.953994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.966523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.966523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.966523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:13.966523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:13.966523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:13.968851 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4038/8109] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:13.973730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:13.984088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c479a-d7ea-4fbf-8195-33d5995a7d54 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:13.989211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:13.989936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:13.995042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:13.995042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] PATH_INFO: `/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5/users/7cfdf08523d74d10a64254a4bb0f7aaa/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:14.006046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc7f4555e97407eba0ccc14fa292ea5, user_id=7cfdf08523d74d10a64254a4bb0f7aaa, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:14.008719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:14.083541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4072/8110] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:13 2022] PUT /identity/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5/users/7cfdf08523d74d10a64254a4bb0f7aaa/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:14.087621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:14.098276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db86879-1478-486c-b2ef-ad157629563f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:14.158457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:14.159195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:14.159474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:14.159809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:14.160468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:14.162102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78cdb4-cbeb-48a1-9497-3484853f77c3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:14.178589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4039/8111] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:14.190737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:14.201059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7bcb-5ac8-425d-9ee2-f1c06c687503 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:14.205708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:14.206631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:14.206914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:14.207185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] PATH_INFO: `/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5/users/7cfdf08523d74d10a64254a4bb0f7aaa/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:14.209084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc7f4555e97407eba0ccc14fa292ea5, user_id=7cfdf08523d74d10a64254a4bb0f7aaa, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:14.211736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:14.222502 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4073/8112] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:14 2022] PUT /identity/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5/users/7cfdf08523d74d10a64254a4bb0f7aaa/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:14.232823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:14.233111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:14.233416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:14.263567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] MFA Rules not processed for user `7cfdf08523d74d10a64254a4bb0f7aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:14.264797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:14.365882 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4040/8113] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:14.376554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:14.378855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:14.450401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae1ee8-0a8d-4ffa-8273-ef7ac365061b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:14.454127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:14.455391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:14.455706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:14.456015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:14.465737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:14.467465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033b450-1d1d-4bfb-867d-37f142588249 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:14.472661 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:14.476833 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:14.478549 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4074/8114] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:15.534222 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:15.535668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:15.551014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14543d14-f847-40f6-a073-1ab2c99645c1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:15.554741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:15.555341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:15.555617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:15.555920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:15.626410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:15.631280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:15.639629 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4041/8115] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:22.976922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:22.977373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:22.977522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:23.029870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] MFA Rules not processed for user `f0f51fe515ee4375a252a8d8a98ec77b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:23.031113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:23.162962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4075/8116] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:25.639619 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=30 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:26.776067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:26.790549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e02e44-d439-4954-9b28-6455905c21bd service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:26.797257 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:26.798103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:26.799111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:26.799361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:26.872227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:26.874171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:26.886392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4042/8117] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:28.991482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:28.992929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:29.062147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a2312-e83e-4d52-8896-bbbcb7e0130e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:29.069386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:29.069669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:29.069920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:29.070174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:29.072098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:29.088439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:29.090000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913e3f-23da-4b03-8747-5296d5f13513 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:29.106462 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4076/8118] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:33.919459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:34.003546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da905247-e62d-4ec8-ae17-439169d23f55 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:34.009960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:34.011327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:34.011773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:34.012203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] PATH_INFO: `/v3/users/260a13da9ff94b81b4cad53082c8a473` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:34.013998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260a13da9ff94b81b4cad53082c8a473)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:34.016193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:34.192622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260a13da9ff94b81b4cad53082c8a473'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:34.193896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260a13da9ff94b81b4cad53082c8a473'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:34.204121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260a13da9ff94b81b4cad53082c8a473'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:34.206272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260a13da9ff94b81b4cad53082c8a473'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:34.283022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260a13da9ff94b81b4cad53082c8a473'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:34.307037 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4043/8119] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:33 2022] DELETE /identity/v3/users/260a13da9ff94b81b4cad53082c8a473 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:34.311615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:34.312126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:34.312126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:34.334403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:34.335936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:34.420705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4077/8120] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:54:34.432839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:34.434325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:34.461629 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:34.511790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167f68-78dd-402d-94c8-ed891c4f2a98 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:34.515997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:34.517602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:34.517891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:34.518172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:34.529201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:34.531078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:34.545524 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4044/8121] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:35.050788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:35.052264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:35.066550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a92c24-a3d1-4405-a9ad-9d8ac33b3ca7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:35.071527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:35.072165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:35.072451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:35.072728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] PATH_INFO: `/v3/projects/3998b7d3ed60468ca63818d0166cda27` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:35.075260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3998b7d3ed60468ca63818d0166cda27)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:35.077868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:35.211316 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:35.218668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3998b7d3ed60468ca63818d0166cda27', 'request_id': 'req-1c8afd92-f59b-4fa7-9569-bf12b643769e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.322745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3998b7d3ed60468ca63818d0166cda27', 'request_id': 'req-1c8afd92-f59b-4fa7-9569-bf12b643769e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.330248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3998b7d3ed60468ca63818d0166cda27', 'request_id': 'req-1c8afd92-f59b-4fa7-9569-bf12b643769e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.346589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] The token cache is being invalidate because project 3998b7d3ed60468ca63818d0166cda27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:35.347298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.348286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.350449 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4078/8122] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:35 2022] DELETE /identity/v3/projects/3998b7d3ed60468ca63818d0166cda27 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:35.354337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:35.364572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b4636-2463-48b2-af31-1407f07e40c9 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:35.455566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:35.456512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:35.457876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:35.458401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] PATH_INFO: `/v3/users/639007f4f5974960bfd4e3d38844627b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:35.460186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=639007f4f5974960bfd4e3d38844627b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:35.462401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:35.704537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639007f4f5974960bfd4e3d38844627b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.705319 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639007f4f5974960bfd4e3d38844627b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.718758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639007f4f5974960bfd4e3d38844627b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.719585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639007f4f5974960bfd4e3d38844627b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.781292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639007f4f5974960bfd4e3d38844627b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:35.811474 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4045/8123] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:35 2022] DELETE /identity/v3/users/639007f4f5974960bfd4e3d38844627b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:36.482343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:36.486398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:36.516296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8afd92-f59b-4fa7-9569-bf12b643769e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:36.646132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:36.646947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:36.647334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:36.647738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] PATH_INFO: `/v3/projects/3863714c369144728b6840e7e118de52` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:36.649172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3863714c369144728b6840e7e118de52)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:36.651429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:36.795409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3863714c369144728b6840e7e118de52', 'request_id': 'req-4d85778a-d202-47ae-85cc-59a83ab5e949'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:36.928684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3863714c369144728b6840e7e118de52', 'request_id': 'req-4d85778a-d202-47ae-85cc-59a83ab5e949'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:36.939740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3863714c369144728b6840e7e118de52', 'request_id': 'req-4d85778a-d202-47ae-85cc-59a83ab5e949'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:36.951726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] The token cache is being invalidate because project 3863714c369144728b6840e7e118de52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:36.956891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:36.956891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:36.956891 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4079/8124] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:36 2022] DELETE /identity/v3/projects/3863714c369144728b6840e7e118de52 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:36.964143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:36.971874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:36.996277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c1daf-7e4c-4236-ab7e-6ea27e166517 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:37.056063 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:37.078958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:37.080478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:37.081466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:37.082598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] PATH_INFO: `/v3/users/7cfdf08523d74d10a64254a4bb0f7aaa` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:37.086903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfdf08523d74d10a64254a4bb0f7aaa)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:37.089744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:37.333261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfdf08523d74d10a64254a4bb0f7aaa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:37.334667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfdf08523d74d10a64254a4bb0f7aaa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:37.346863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfdf08523d74d10a64254a4bb0f7aaa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:37.348330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfdf08523d74d10a64254a4bb0f7aaa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:37.446605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-45f62e4b-96b5-49e7-8408-2a91c3506b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfdf08523d74d10a64254a4bb0f7aaa'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:37.473071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4046/8125] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:36 2022] DELETE /identity/v3/users/7cfdf08523d74d10a64254a4bb0f7aaa => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:37.984751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:37.986276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:38.001928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85778a-d202-47ae-85cc-59a83ab5e949 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.070064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.071413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.071913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.072393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] PATH_INFO: `/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.073854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc7f4555e97407eba0ccc14fa292ea5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.076532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:38.079962 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:38.196405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc7f4555e97407eba0ccc14fa292ea5', 'request_id': 'req-18f6ec13-4eaf-4a75-96e5-7887e342adab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:38.289234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc7f4555e97407eba0ccc14fa292ea5', 'request_id': 'req-18f6ec13-4eaf-4a75-96e5-7887e342adab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:38.298738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc7f4555e97407eba0ccc14fa292ea5', 'request_id': 'req-18f6ec13-4eaf-4a75-96e5-7887e342adab'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:38.327448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] The token cache is being invalidate because project dfc7f4555e97407eba0ccc14fa292ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:38.327841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:38.328586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-18f6ec13-4eaf-4a75-96e5-7887e342adab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:38.330691 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4080/8126] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:37 2022] DELETE /identity/v3/projects/dfc7f4555e97407eba0ccc14fa292ea5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:38.336500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.337078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.337078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.360570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:38.362328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:38.488090 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4047/8127] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:38.489515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.490002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.490906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.518221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:38.519637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:38.530345 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4081/8128] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:54:38.538530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:38.555259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b2eb6-0855-4116-b14a-44c37d31e782 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.562700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.564126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.564653 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.565454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.567600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:54:38.567922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.569605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:38.584850 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4048/8129] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:54:38.588854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:38.602541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd35aa5-8d06-4742-934d-dd89736571c3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.607653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.608476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.608824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.609308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.610129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.612755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:38.716978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4082/8130] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:38 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:38.720975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:38.731089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6624-a5ff-4005-9f99-f9794fbc26d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.784835 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:38.805755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.807152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.807835 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.808268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.809811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.812973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:38.917528 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4049/8131] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:38 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:38.921523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:38.934959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3831fb-2a8c-43f0-b42f-1b7633e50a47 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.942600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.943768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.943768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.943978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.944691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.946395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:38.959531 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4083/8132] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:54:38.963211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:38.979737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027106e-e139-4124-87d5-d838f00be087 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:38.983635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:38.984322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:38.984608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:38.984884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:38.986220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:38.987955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d815b-6aae-475c-a2fe-44c87f90bb94 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:39.003472 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4050/8133] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:39.007612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:39.021962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa079-5cfd-4939-8063-45f13e309d00 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:39.038155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:39.038155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:39.038155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:39.038155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] PATH_INFO: `/v3/projects/f5e945919c054dfaa1fd2a2225db11cb/users/69e1c645b3bc444ba03cd2bdae31d123/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:39.057581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e945919c054dfaa1fd2a2225db11cb, user_id=69e1c645b3bc444ba03cd2bdae31d123, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:39.060919 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:39.146466 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4084/8134] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:39 2022] PUT /identity/v3/projects/f5e945919c054dfaa1fd2a2225db11cb/users/69e1c645b3bc444ba03cd2bdae31d123/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:39.257210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:39.257545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:39.258035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:39.292756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] MFA Rules not processed for user `69e1c645b3bc444ba03cd2bdae31d123`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:39.294363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:39.391465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4051/8135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:39.396116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:39.476797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629c4d-7571-411f-abe6-91d367546c82 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:39.482181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:39.482939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:39.483446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:39.483719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:39.484582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:39.487217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:39.605381 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4085/8136] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:39 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:54:39.609049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:39.621431 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed55f4-835e-48e1-a9d5-1c05a14bbd7e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:39.714779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:39.716230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:39.716944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:39.717430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:39.721945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:39.724097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:39.868415 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4052/8137] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:39 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:39.873235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:39.906461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856ae7-bd1b-46ff-a29c-fb76ee48817e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:39.915056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:39.918144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:39.920244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:39.920744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:39.933755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:39.944112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:39.971402 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4086/8138] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:39.981762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:39.990914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69add69-a793-44f0-8d6a-d5b95b7c08a2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:40.004469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:40.005274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:40.005465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:40.005715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:40.006642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:40.010419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee9604-691d-4d6a-8371-15df59a31277 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:40.033746 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4053/8139] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:40.038644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:40.045148 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:40.052384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54045c5-3975-4147-9248-dbf6b79ca5d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:40.065992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:40.067395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:40.067776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:40.068118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] PATH_INFO: `/v3/projects/8f93efcf4f9a40a5843ae6691110da7a/users/a4a9eb11fdc9415096f0445874f3bf5c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:40.088056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f93efcf4f9a40a5843ae6691110da7a, user_id=a4a9eb11fdc9415096f0445874f3bf5c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:40.096227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:40.245008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4087/8140] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:40 2022] PUT /identity/v3/projects/8f93efcf4f9a40a5843ae6691110da7a/users/a4a9eb11fdc9415096f0445874f3bf5c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:40.256186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:40.256553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:40.256899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:40.334645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] MFA Rules not processed for user `a4a9eb11fdc9415096f0445874f3bf5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:40.336801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:40.374694 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:40.464984 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4054/8141] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:40.469497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:40.617626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d208-f210-4d15-b9f3-f53de611a67e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:40.628199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:40.629197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:40.629197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:40.629409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:40.630031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:40.632017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:40.787534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4088/8142] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:40 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:40.792175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:40.807954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cf11a-2bb2-44f9-9dc3-b500dacbe0d6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:40.920117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:40.921363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:40.921765 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:40.922188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:40.923630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:40.926080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.049839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:41.050387 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4055/8143] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:40 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:41.062516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88760c3c-3bc6-46e2-9200-311fa5417312 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:41.068528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:41.069700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.070439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.070980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.071882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:41.073779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.093169 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4089/8144] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:41.096041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:41.108084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21689e-f4cf-4fcf-84f4-14093cc3d0c7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:41.116351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:41.117883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.118411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.118899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] PATH_INFO: `/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6/users/993b61d8fb584746af220a0736910bff/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.163223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2833d7ab9fec4cd39bdc956c24991ea6, user_id=993b61d8fb584746af220a0736910bff, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:41.167306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.301885 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4056/8145] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:41 2022] PUT /identity/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6/users/993b61d8fb584746af220a0736910bff/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:54:41.306265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:41.317214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cdddf-a3fe-4ee8-9d36-14746ec044cb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:41.414392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:41.415544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.415894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.416270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.417080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:41.419613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8b960-7eaa-431b-954a-6650bfad752a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.437374 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4090/8146] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:54:41.438284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:41.464512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79b72-8672-4545-aa77-82058b21574d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:41.475656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:41.480978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.482804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.483333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] PATH_INFO: `/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6/users/993b61d8fb584746af220a0736910bff/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.489097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2833d7ab9fec4cd39bdc956c24991ea6, user_id=993b61d8fb584746af220a0736910bff, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:41.493987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.514560 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4057/8147] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:41 2022] PUT /identity/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6/users/993b61d8fb584746af220a0736910bff/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:41.527317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412003-664d-462d-a980-c21b4f426756 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.527902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412003-664d-462d-a980-c21b4f426756 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.528330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412003-664d-462d-a980-c21b4f426756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.570590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3c412003-664d-462d-a980-c21b4f426756 None None] MFA Rules not processed for user `993b61d8fb584746af220a0736910bff`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:41.572304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c412003-664d-462d-a980-c21b4f426756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:41.631577 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:41.676809 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4091/8148] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:41.689377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:41.691465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:41.815413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be884-22c0-4367-a314-7b59ba8d042b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:41.819327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:41.819935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:41.820216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:41.820487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:41.834374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:41.836614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:41.850595 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4058/8149] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:42.041531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412003-664d-462d-a980-c21b4f426756 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:42.043307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3c412003-664d-462d-a980-c21b4f426756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:42.060469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412003-664d-462d-a980-c21b4f426756 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:42.065494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:42.067032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:42.067940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:42.068390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:42.175714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:42.177921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1619bd0-26e3-4ec1-9057-5e0df2d81b96 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:42.222009 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4092/8150] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:50.487858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:50.512740 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:50.573602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5260f9-a733-407e-bbdc-f19963da569f service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:50.580830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:50.581831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:50.582376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:50.582892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] PATH_INFO: `/v3/users/69e1c645b3bc444ba03cd2bdae31d123` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:50.584671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e1c645b3bc444ba03cd2bdae31d123)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:50.588303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:50.797511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e1c645b3bc444ba03cd2bdae31d123'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:50.798488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e1c645b3bc444ba03cd2bdae31d123'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:50.810730 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e1c645b3bc444ba03cd2bdae31d123'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:50.811762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e1c645b3bc444ba03cd2bdae31d123'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:50.928385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e1c645b3bc444ba03cd2bdae31d123'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:50.978538 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4059/8151] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:50 2022] DELETE /identity/v3/users/69e1c645b3bc444ba03cd2bdae31d123 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:50.983849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:50.984374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:50.984560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:51.023548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:51.028765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:51.158362 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4093/8152] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:51.165462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:51.167226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:51.261321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca3cf-8e86-40f7-ac45-b8e759646f1b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:51.271920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:51.271920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:51.271920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:51.271920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:51.285590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:51.287353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:51.309325 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4060/8153] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:51.809504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:51.810957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:51.830306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e373-8285-4e1f-bd75-fe61db1ebdb7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:51.838579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:51.838579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:51.838579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:51.838579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] PATH_INFO: `/v3/projects/f5e945919c054dfaa1fd2a2225db11cb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:51.840178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e945919c054dfaa1fd2a2225db11cb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:51.843277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:52.013515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e945919c054dfaa1fd2a2225db11cb', 'request_id': 'req-700610d7-5d67-43d6-bdd4-1237ae4a3f37'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.082535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e945919c054dfaa1fd2a2225db11cb', 'request_id': 'req-700610d7-5d67-43d6-bdd4-1237ae4a3f37'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.092169 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e945919c054dfaa1fd2a2225db11cb', 'request_id': 'req-700610d7-5d67-43d6-bdd4-1237ae4a3f37'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.100270 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:52.112441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] The token cache is being invalidate because project f5e945919c054dfaa1fd2a2225db11cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:52.112657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.113399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.115571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4094/8154] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:51 2022] DELETE /identity/v3/projects/f5e945919c054dfaa1fd2a2225db11cb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:52.124272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:52.135899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd1fe6-3942-45e7-8fe5-0f335c691f42 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:52.187963 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:52.226328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:52.226328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:52.226328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:52.226328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] PATH_INFO: `/v3/users/a4a9eb11fdc9415096f0445874f3bf5c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:52.226725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a9eb11fdc9415096f0445874f3bf5c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:52.227954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:52.493529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a9eb11fdc9415096f0445874f3bf5c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.494213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a9eb11fdc9415096f0445874f3bf5c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.507670 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a9eb11fdc9415096f0445874f3bf5c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.508473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a9eb11fdc9415096f0445874f3bf5c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.626634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a9eb11fdc9415096f0445874f3bf5c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:52.654825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4061/8155] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:52 2022] DELETE /identity/v3/users/a4a9eb11fdc9415096f0445874f3bf5c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:53.027522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:53.030792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:53.050254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700610d7-5d67-43d6-bdd4-1237ae4a3f37 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:53.122600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:53.123349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:53.123812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:53.124237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] PATH_INFO: `/v3/users/33a9a7ae4f5a42d7ac76baf67fdb7a2d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:53.126688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a9a7ae4f5a42d7ac76baf67fdb7a2d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:53.129864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:53.278343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:53.279995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:53.307946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a72b9d-db3a-4b7f-8950-780f0d5161cd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:53.316081 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:53.318672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:53.320035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:53.321701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] PATH_INFO: `/v3/projects/8f93efcf4f9a40a5843ae6691110da7a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:53.334697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f93efcf4f9a40a5843ae6691110da7a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:53.334697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:53.371013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a9a7ae4f5a42d7ac76baf67fdb7a2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.466351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f93efcf4f9a40a5843ae6691110da7a', 'request_id': 'req-b1d36183-f693-4325-a363-315596130c0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.468779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a9a7ae4f5a42d7ac76baf67fdb7a2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.469945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a9a7ae4f5a42d7ac76baf67fdb7a2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.473536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f93efcf4f9a40a5843ae6691110da7a', 'request_id': 'req-b1d36183-f693-4325-a363-315596130c0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.482798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a9a7ae4f5a42d7ac76baf67fdb7a2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.490613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-2a785fb9-4879-441c-91df-1eb333a3a2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a9a7ae4f5a42d7ac76baf67fdb7a2d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.496563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4095/8156] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:53 2022] DELETE /identity/v3/users/33a9a7ae4f5a42d7ac76baf67fdb7a2d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:53.501006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:53.501294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:53.502585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:53.520467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:53.521857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:53.541824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f93efcf4f9a40a5843ae6691110da7a', 'request_id': 'req-b1d36183-f693-4325-a363-315596130c0f'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.560379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] The token cache is being invalidate because project 8f93efcf4f9a40a5843ae6691110da7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:53.562035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.563256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.568110 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4062/8157] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:53 2022] DELETE /identity/v3/projects/8f93efcf4f9a40a5843ae6691110da7a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:54:53.570061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:53.571563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:53.600452 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4096/8158] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:54:53.611936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:53.614122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:53.649594 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:53.656312 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:53.697939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d36183-f693-4325-a363-315596130c0f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:53.704421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:53.704421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:53.704716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:53.704716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] PATH_INFO: `/v3/users/993b61d8fb584746af220a0736910bff` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:53.710558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ccd29-d568-41db-b5de-65df76a5fa46 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:53.711005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=993b61d8fb584746af220a0736910bff)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:53.713107 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:53.723239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:53.724035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:53.724396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:53.724753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:53.736087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:53.738085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:53.751297 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4097/8159] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:54:53.921125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993b61d8fb584746af220a0736910bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.922263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993b61d8fb584746af220a0736910bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.934007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993b61d8fb584746af220a0736910bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:53.934838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993b61d8fb584746af220a0736910bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.003295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:54.004901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:54.021397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993b61d8fb584746af220a0736910bff'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.022877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce309b8a-8c62-4981-8b71-09e1fae94818 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:54.036986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:54.038573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:54.038944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:54.039342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] PATH_INFO: `/v3/projects/735c13f1d49640319694d0a6a3a16519` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:54.040650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=735c13f1d49640319694d0a6a3a16519)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:54.043003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:54.051983 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4063/8160] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:53 2022] DELETE /identity/v3/users/993b61d8fb584746af220a0736910bff => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:54:54.189029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735c13f1d49640319694d0a6a3a16519', 'request_id': 'req-c7781c52-d4df-4827-9274-c08c58b2fe8c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.292406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735c13f1d49640319694d0a6a3a16519', 'request_id': 'req-c7781c52-d4df-4827-9274-c08c58b2fe8c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.302044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735c13f1d49640319694d0a6a3a16519', 'request_id': 'req-c7781c52-d4df-4827-9274-c08c58b2fe8c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.315796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] The token cache is being invalidate because project 735c13f1d49640319694d0a6a3a16519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:54.316021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.316721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.319152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4098/8161] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:54 2022] DELETE /identity/v3/projects/735c13f1d49640319694d0a6a3a16519 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:54:54.323260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:54.324886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:54.403631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102c52f-8350-4516-b92b-5c8c42f1cbcb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:54.462761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:54.463397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:54.463679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:54.463954 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] PATH_INFO: `/v3/users/81460822123b43b7b220512827c2f6db` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:54.465078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81460822123b43b7b220512827c2f6db)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:54.467285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:54.572363 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:54.581589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:54.583188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:54.596683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7781c52-d4df-4827-9274-c08c58b2fe8c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:54.601248 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:54.601906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:54.606685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:54.606685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] PATH_INFO: `/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:54.606685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2833d7ab9fec4cd39bdc956c24991ea6)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:54.606685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:54.658224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81460822123b43b7b220512827c2f6db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.659528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81460822123b43b7b220512827c2f6db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.667888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81460822123b43b7b220512827c2f6db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.668739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81460822123b43b7b220512827c2f6db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.729353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d028fcb3-d5cc-49a2-920f-75c5fb25c2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81460822123b43b7b220512827c2f6db'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.755811 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4064/8162] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:54:54 2022] DELETE /identity/v3/users/81460822123b43b7b220512827c2f6db => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:54:54.763356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2833d7ab9fec4cd39bdc956c24991ea6', 'request_id': 'req-f9f5aec1-edcb-4718-afe9-17760dfa008e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.872189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2833d7ab9fec4cd39bdc956c24991ea6', 'request_id': 'req-f9f5aec1-edcb-4718-afe9-17760dfa008e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.877573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2833d7ab9fec4cd39bdc956c24991ea6', 'request_id': 'req-f9f5aec1-edcb-4718-afe9-17760dfa008e'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.899439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] The token cache is being invalidate because project 2833d7ab9fec4cd39bdc956c24991ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:54.899439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.899439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f9f5aec1-edcb-4718-afe9-17760dfa008e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:54.899439 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4099/8163] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:54 2022] DELETE /identity/v3/projects/2833d7ab9fec4cd39bdc956c24991ea6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:54.902552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:54.902848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:54.903152 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:54.925633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:54.926878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:55.021381 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4065/8164] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:55.030221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.030506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.030780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.055358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:55.063714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:55.070870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4100/8165] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:55.074877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.095755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586f62e-739d-4804-bdd4-350026860dd8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.095755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.095755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.096788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.097138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.097905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:54:55.098411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.100582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.146551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4066/8166] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:54:55.147450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.160064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55721bce-38af-4996-a6e1-35ca39f6dc55 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.172154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.173664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.173943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.174211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.176903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.180202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.199071 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:55.263056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.264872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:55.278391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d68a2-58ff-4937-9533-4592a1508c15 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.289144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.290241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.290822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.297418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4101/8167] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:55 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:55.301846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.303188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] PATH_INFO: `/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.305581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d26ea46a2ef4babab9a27c8cd04dcbc)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.307540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.405476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec0f1-4e83-4e69-943d-f2ea7b05603b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.410715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.411331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.411607 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.411875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.412564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.414541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.449879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d26ea46a2ef4babab9a27c8cd04dcbc', 'request_id': 'req-a20fc090-dceb-4bb0-a5e6-572f93d86939'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:55.457436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d26ea46a2ef4babab9a27c8cd04dcbc', 'request_id': 'req-a20fc090-dceb-4bb0-a5e6-572f93d86939'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:55.517979 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4102/8168] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:55 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:54:55.522256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.533729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d59d9-7a58-45de-b3c3-22bd634e8c8d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.540958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d26ea46a2ef4babab9a27c8cd04dcbc', 'request_id': 'req-a20fc090-dceb-4bb0-a5e6-572f93d86939'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:55.562937 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] The token cache is being invalidate because project 6d26ea46a2ef4babab9a27c8cd04dcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:54:55.563376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:55.566116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:54:55.570796 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4067/8169] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:54:55 2022] DELETE /identity/v3/projects/6d26ea46a2ef4babab9a27c8cd04dcbc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:55.641877 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:55.653274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.654199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.655354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.655354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.656232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.658644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.676534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4103/8170] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:55.678008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.680575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:55.706806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc090-dceb-4bb0-a5e6-572f93d86939 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.717512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.719951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.719951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.719951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.721837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.724110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e04f5-bb3a-43bf-95cc-4ddb4d1e5374 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.743354 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4068/8171] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:55.745254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:55.758519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95828b30-84b0-4d86-83bc-680f1d0b3e4a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:55.765153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:55.767337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.767789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.768226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] PATH_INFO: `/v3/projects/9d6d765c81ad4b17bd8286f4d0ec78e9/users/b25f2e99b0b24ac5a6f1bf26de27eacb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:55.804341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6d765c81ad4b17bd8286f4d0ec78e9, user_id=b25f2e99b0b24ac5a6f1bf26de27eacb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:55.807121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:55.914221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4104/8172] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:55 2022] PUT /identity/v3/projects/9d6d765c81ad4b17bd8286f4d0ec78e9/users/b25f2e99b0b24ac5a6f1bf26de27eacb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:55.932506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:55.933442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:55.933779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.039664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] MFA Rules not processed for user `b25f2e99b0b24ac5a6f1bf26de27eacb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:56.045636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:56.206836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4069/8173] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:56.211283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:56.320374 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:56.331728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b1a3-a71c-406d-bc06-8f3a2558031f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:56.337130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:56.337856 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.338140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.338437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.339067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:56.341140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:56.476613 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4105/8174] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:56 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:56.480861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:56.493062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20731085-bc4e-4313-91e1-89d5a021ded5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:56.551790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:56.552478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.552758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.553031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.553696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:56.555589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:56.663439 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4070/8175] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:56 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:56.665259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:56.679649 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc550531-15f6-47f8-a06b-375c0e56ab48 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:56.684874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:56.685519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.691111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.691111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.691111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:56.691111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:56.701716 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4106/8176] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:56.705316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:56.716800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c227-2810-4e2f-a249-93d1dbfcd302 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:56.722117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:56.722733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.723015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.723288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.723931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:56.725565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2d690-31d9-45e6-b449-54bca02cbaaf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:56.741667 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4071/8177] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:56.742851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:56.766413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e574fa-9f21-4212-a266-2bda09b966ef admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:56.778081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:56.787826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.787826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.787826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] PATH_INFO: `/v3/projects/15b4ceae318d498280cadc960fe201dd/users/ae1a0c57135349e1a2498c4d2dda7298/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.803126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b4ceae318d498280cadc960fe201dd, user_id=ae1a0c57135349e1a2498c4d2dda7298, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:56.806065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:56.891113 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4107/8178] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:56 2022] PUT /identity/v3/projects/15b4ceae318d498280cadc960fe201dd/users/ae1a0c57135349e1a2498c4d2dda7298/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:56.907789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:56.916608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:56.916608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:56.945456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] MFA Rules not processed for user `ae1a0c57135349e1a2498c4d2dda7298`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:56.946698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:56.999482 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:57.024068 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4072/8179] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:57.028768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.096779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9524bf9-a018-4a7a-ad18-072903774a22 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.101627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.102226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.102519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.102789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.103425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.105354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.198841 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4108/8180] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:54:57 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:54:57.203037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.214007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223d3ab-4b68-4f82-a5d8-872ff054eb23 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.272800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.273317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.273621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.273889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.274501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.276398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.369966 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4073/8181] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:54:57 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:54:57.371192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.381715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7f116-cd27-46a4-b655-a30c21100a25 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.386388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.387026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.387304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.387571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.388231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.389847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.405591 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4109/8182] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:54:57.407988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.421133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c510-ece9-4702-b78b-95847f561fa8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.426001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.426655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.426931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.427201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] PATH_INFO: `/v3/projects/3ca11d8f912345588f848e4077d82bcb/users/8ca3a9d368ee44208ee2e945c8a6a61c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.441996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca11d8f912345588f848e4077d82bcb, user_id=8ca3a9d368ee44208ee2e945c8a6a61c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.444666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.523685 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4074/8183] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:57 2022] PUT /identity/v3/projects/3ca11d8f912345588f848e4077d82bcb/users/8ca3a9d368ee44208ee2e945c8a6a61c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:57.527653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.538529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb59d8-09b1-469f-82cc-992b587dfd46 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.599434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.600113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.600400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.600675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.601315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.602971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536df13-6d21-482c-b2e9-91b29fd3b142 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.616223 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4110/8184] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:54:57.617582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.628367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd97d4-bbd2-4f5c-9db8-403b13cbcea0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.633225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.633931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.634210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.634478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] PATH_INFO: `/v3/projects/3ca11d8f912345588f848e4077d82bcb/users/8ca3a9d368ee44208ee2e945c8a6a61c/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.636610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca11d8f912345588f848e4077d82bcb, user_id=8ca3a9d368ee44208ee2e945c8a6a61c, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.639291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.650458 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4075/8185] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:54:57 2022] PUT /identity/v3/projects/3ca11d8f912345588f848e4077d82bcb/users/8ca3a9d368ee44208ee2e945c8a6a61c/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:54:57.661794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.662088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.662359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.691962 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] MFA Rules not processed for user `8ca3a9d368ee44208ee2e945c8a6a61c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:54:57.693182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:57.698847 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:57.763962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4111/8186] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:54:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:54:57.777915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:54:57.780003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:54:57.846075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f279b-545e-4e44-ab09-5923ec0f5d19 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:54:57.849831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:54:57.850438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:54:57.850716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:54:57.850986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:54:57.902691 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:54:57.911096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:54:57.912518 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:54:57.921303 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4076/8187] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:01.154796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:01.162373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e22eff-52c5-452c-823b-cd12fb419aaa None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:01.168050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:01.169072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:01.169548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:01.169981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:01.253609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:01.253609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:01.263712 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4112/8188] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:03.128206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:03.139459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500fbdd-5825-4fca-a6b9-13841abc6284 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:03.143477 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:03.144103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:03.147677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:03.147677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:03.154441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:03.155891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63de05d-ed45-426c-a5f5-b2b25f4c6d94 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:03.167195 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4077/8189] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:05.812036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:05.813545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:05.887794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cabf-f52e-42d0-8830-fc79e2aa0b58 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:05.896721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:05.897443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:05.898188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:05.898188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] PATH_INFO: `/v3/users/17bfcd6ee16747dfa93666f03b8a3795` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:05.899222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bfcd6ee16747dfa93666f03b8a3795)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:05.901430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:06.088730 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:06.091308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bfcd6ee16747dfa93666f03b8a3795'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.179884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bfcd6ee16747dfa93666f03b8a3795'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.180632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bfcd6ee16747dfa93666f03b8a3795'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.193869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bfcd6ee16747dfa93666f03b8a3795'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.201168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bfcd6ee16747dfa93666f03b8a3795'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.207209 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4113/8190] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:05 2022] DELETE /identity/v3/users/17bfcd6ee16747dfa93666f03b8a3795 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:55:06.211874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:06.212428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:06.212428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:06.232462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:06.235561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:06.292839 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4078/8191] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:06.303518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:06.304974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:06.365135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd7bbe-9c0f-45ad-b3ff-5da4dbba1334 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:06.368669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:06.369269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:06.369577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:06.369850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:06.378801 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:06.380223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c6b8-6c4a-4774-b081-2580ebdad79f service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:06.389775 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4114/8192] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:06.679126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:06.680616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:06.706925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ad7ca-5c88-468d-9071-4e949af852a1 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:06.712680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:06.713247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:06.713769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:06.714012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] PATH_INFO: `/v3/projects/417533c97f0248fdb097b257103c090a` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:06.715155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=417533c97f0248fdb097b257103c090a)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:06.717393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:06.855427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417533c97f0248fdb097b257103c090a', 'request_id': 'req-661f0e93-7e4e-45e1-af89-1c47082f6a9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.861046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417533c97f0248fdb097b257103c090a', 'request_id': 'req-661f0e93-7e4e-45e1-af89-1c47082f6a9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.925647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417533c97f0248fdb097b257103c090a', 'request_id': 'req-661f0e93-7e4e-45e1-af89-1c47082f6a9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.937673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] The token cache is being invalidate because project 417533c97f0248fdb097b257103c090a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:06.938481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.939116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-661f0e93-7e4e-45e1-af89-1c47082f6a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:06.940838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4079/8193] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:06 2022] DELETE /identity/v3/projects/417533c97f0248fdb097b257103c090a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:06.945808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:06.946281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:06.946499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:06.969469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:06.971085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:07.033216 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4115/8194] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:07.041127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.041441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.041717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.061323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:07.062534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:07.070883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4080/8195] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:07.075174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.086549 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1e768-5178-4ce6-bce6-84cac628f71b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.091381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.092273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.092563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.092841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.093544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:55:07.093854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.095547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.113535 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4116/8196] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:55:07.117489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.126139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc5183-bfee-42c1-9a34-8e6d1fe1934f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.131139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.131770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.132352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.132469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.133071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.135059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.248365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4081/8197] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:55:07.253011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.263237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b26e3a-853a-4420-844c-ee77c7b54a32 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.314571 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:07.324333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.324943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.325224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.325524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.326160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.328100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.440769 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4117/8198] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:07.442507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.452963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a080fb-5b9e-4ed2-811f-54ded2f7c8ea admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.457479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.458093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.458345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.458613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.459242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.460837 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.470776 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4082/8199] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:07.476626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.487613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e9797-616d-4a76-baba-2192a1c1c89f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.492353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.493212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.493596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.493882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.494523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.496145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253daf02-247b-4192-8589-5863e584f871 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.507543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4118/8200] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:55:07.511774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.521883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b4fab-6e21-47f1-8298-5354cf3350cf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.529873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.529873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.529873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.529873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] PATH_INFO: `/v3/projects/02d6353282f34832bd3c88880a16f2bd/users/32194f6018b4481fa81eb36e0e3e4091/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.544699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d6353282f34832bd3c88880a16f2bd, user_id=32194f6018b4481fa81eb36e0e3e4091, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.548024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.635788 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:07.642275 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4083/8201] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:07 2022] PUT /identity/v3/projects/02d6353282f34832bd3c88880a16f2bd/users/32194f6018b4481fa81eb36e0e3e4091/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:07.652698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.652988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.653262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.684792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] MFA Rules not processed for user `32194f6018b4481fa81eb36e0e3e4091`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:07.684792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:07.752666 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4119/8202] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:07.757364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.822225 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f5645-e5da-471e-ae42-d99599ea75fc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:07.826921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:07.827528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:07.827815 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:07.828110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:07.829357 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:07.831301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:07.961592 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4084/8203] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:07.962625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:07.974561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490ff44-004d-46ad-9a33-6d13f4276e80 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.032383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.033040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.033326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.033625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.034249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.036183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.115711 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4120/8204] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:07 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:08.119674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:08.131095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a09088-4a99-47e8-9716-ed259c666286 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.135925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.136517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.136793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.137064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.137781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.139355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.149906 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4085/8205] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:08.153959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:08.163940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef0c26-f509-4108-856a-4a4beca1fb91 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.168493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.169127 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.169441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.169714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] PATH_INFO: `/v3/projects/fd74009e76b94a65b1c70c9038977214/users/c204a136a4de4cc2824131178905cad7/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.184905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd74009e76b94a65b1c70c9038977214, user_id=c204a136a4de4cc2824131178905cad7, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.187632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.258555 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4121/8206] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:08 2022] PUT /identity/v3/projects/fd74009e76b94a65b1c70c9038977214/users/c204a136a4de4cc2824131178905cad7/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:08.263279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:08.276349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78159d7-c612-4442-9c8a-1cd05b86e1ca admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.347995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.348617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.348901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.349177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.349863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.351540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146fa35-a305-47a4-899f-85f2ea8fbaa8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.369024 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4086/8207] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:08.370509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:08.381299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178d09e-ab2b-4adb-a1b9-fb76858a37c3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.386643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.387326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.387645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.387923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] PATH_INFO: `/v3/projects/fd74009e76b94a65b1c70c9038977214/users/c204a136a4de4cc2824131178905cad7/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.389992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd74009e76b94a65b1c70c9038977214, user_id=c204a136a4de4cc2824131178905cad7, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.392758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.404137 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4122/8208] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:08 2022] PUT /identity/v3/projects/fd74009e76b94a65b1c70c9038977214/users/c204a136a4de4cc2824131178905cad7/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:08.415602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.415892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.416169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.444055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] MFA Rules not processed for user `c204a136a4de4cc2824131178905cad7`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:08.445268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:08.503877 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:08.513851 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4087/8209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:08.525002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:08.526711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:08.541196 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:08.599490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755bc0-cec8-4e05-bbac-ce20d7127d69 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:08.603208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:08.603803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:08.604078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:08.604344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:08.613841 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:08.615258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3b9e4-b5ea-426c-ad8d-3bbdd4750c16 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:08.624562 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4123/8210] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:09.543113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:09.607696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860c610-8962-4819-ace6-70e8edf60186 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:09.612809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:09.613465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:09.613744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:09.614015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] PATH_INFO: `/v3/users/32194f6018b4481fa81eb36e0e3e4091` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:09.615110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32194f6018b4481fa81eb36e0e3e4091)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:09.617072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:09.808366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32194f6018b4481fa81eb36e0e3e4091'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:09.809023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32194f6018b4481fa81eb36e0e3e4091'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:09.817328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32194f6018b4481fa81eb36e0e3e4091'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:09.818324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32194f6018b4481fa81eb36e0e3e4091'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:09.899936 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32194f6018b4481fa81eb36e0e3e4091'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:09.917825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4088/8211] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:09 2022] DELETE /identity/v3/users/32194f6018b4481fa81eb36e0e3e4091 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:09.922419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:09.925572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:09.925572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:09.943510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:09.944712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:10.009005 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4124/8212] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:10.019416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:10.020867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:10.081894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac614022-0ab4-4f80-b3c7-02192556c6f1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:10.085711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:10.086412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:10.086713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:10.086969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:10.097077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:10.098543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:10.109401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4089/8213] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:10.493316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:10.494766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:10.507543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961830-9750-4586-a6c6-07ff62b2d87a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:10.512522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:10.513237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:10.513629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:10.513979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] PATH_INFO: `/v3/projects/02d6353282f34832bd3c88880a16f2bd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:10.515178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d6353282f34832bd3c88880a16f2bd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:10.517878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:10.617419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d6353282f34832bd3c88880a16f2bd', 'request_id': 'req-d669340c-3bd7-4c07-93fa-a94c639359b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:10.686009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d6353282f34832bd3c88880a16f2bd', 'request_id': 'req-d669340c-3bd7-4c07-93fa-a94c639359b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:10.693978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d6353282f34832bd3c88880a16f2bd', 'request_id': 'req-d669340c-3bd7-4c07-93fa-a94c639359b3'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:10.706056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] The token cache is being invalidate because project 02d6353282f34832bd3c88880a16f2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:10.706348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:10.707018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:10.708768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4125/8214] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:10 2022] DELETE /identity/v3/projects/02d6353282f34832bd3c88880a16f2bd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:10.712695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:10.723524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a8e6-99b9-4d75-a3fb-abda2a1b1de3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:10.734820 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:10.780684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:10.781266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:10.781638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:10.781906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] PATH_INFO: `/v3/users/c204a136a4de4cc2824131178905cad7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:10.783022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c204a136a4de4cc2824131178905cad7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:10.784912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:11.007427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c204a136a4de4cc2824131178905cad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.008197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c204a136a4de4cc2824131178905cad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.016285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c204a136a4de4cc2824131178905cad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.017034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c204a136a4de4cc2824131178905cad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.083376 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-fcbabc73-ff5b-429f-ba73-04630d37234a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c204a136a4de4cc2824131178905cad7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.118208 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4090/8215] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:10 2022] DELETE /identity/v3/users/c204a136a4de4cc2824131178905cad7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:11.552902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:11.554480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:11.569991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669340c-3bd7-4c07-93fa-a94c639359b3 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:11.597567 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:11.630595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:11.631234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:11.631625 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:11.631930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] PATH_INFO: `/v3/projects/fd74009e76b94a65b1c70c9038977214` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:11.633066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd74009e76b94a65b1c70c9038977214)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:11.635023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:11.770703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd74009e76b94a65b1c70c9038977214', 'request_id': 'req-7732ab16-c149-4a53-b860-9e42f303d660'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.855030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd74009e76b94a65b1c70c9038977214', 'request_id': 'req-7732ab16-c149-4a53-b860-9e42f303d660'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.862398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd74009e76b94a65b1c70c9038977214', 'request_id': 'req-7732ab16-c149-4a53-b860-9e42f303d660'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.872755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] The token cache is being invalidate because project fd74009e76b94a65b1c70c9038977214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:11.873045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.873715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-7732ab16-c149-4a53-b860-9e42f303d660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:11.875195 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4126/8216] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:11 2022] DELETE /identity/v3/projects/fd74009e76b94a65b1c70c9038977214 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:11.880784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:11.881615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:11.881891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:11.902122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:11.903306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:11.962749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4091/8217] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:11.970963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:11.971249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:11.971520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:11.992583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:11.993859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:12.002950 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4127/8218] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:12.007829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.019002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf6d6-8791-4c7c-9e78-40acbc82105e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.023728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.024352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.024634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.024909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.025764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:55:12.026073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.027846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.041273 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4092/8219] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:55:12.046012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.058097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa0783-8442-4ea3-8b1a-55ca0c4500b7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.063167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.063771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.064052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.064324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.064951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.066950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.192727 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4128/8220] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:12 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:12.196852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.207059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf282-a2b5-4c7c-9b62-6f0416d454bf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.226428 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:12.263153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.263756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.264040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.264320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.264941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.266868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.411975 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4093/8221] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:12 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:12.416648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.428433 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd970d4-98fc-4e5e-9806-8f945104c04b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.433627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.434236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.434618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.434818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.435415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.437154 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.448190 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4129/8222] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:12.456538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.467054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b336c7-b1ac-40f2-a1de-6dc2a4393fa9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.471748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.472335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.472643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.473296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.474141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.476188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1ae68-3b17-4931-90ad-52a2ca29354e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.487648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4094/8223] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:12.491961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.502782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8595d-5bee-47e3-a329-fbb7faadd8a7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.507394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.508322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.508467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.508657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] PATH_INFO: `/v3/projects/0dad22f1e14f4b4fb50c4cc733507a7c/users/2c8907cb2ce84edea8a5085e88086390/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.523975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dad22f1e14f4b4fb50c4cc733507a7c, user_id=2c8907cb2ce84edea8a5085e88086390, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.526711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.597221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4130/8224] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:12 2022] PUT /identity/v3/projects/0dad22f1e14f4b4fb50c4cc733507a7c/users/2c8907cb2ce84edea8a5085e88086390/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:12.607078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.607364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.607637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.637026 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] MFA Rules not processed for user `2c8907cb2ce84edea8a5085e88086390`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:12.638274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:12.702884 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4095/8225] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:12.707293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.759762 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:12.770343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a20d0-7fda-4b21-82fa-aef07ad6906e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.774951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.775544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.777600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.777600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.777600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.778616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:12.876029 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4131/8226] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:12 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:12.880119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:12.891028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5e304-a084-4b79-aa38-4e92683b0818 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:12.947892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:12.948503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:12.948806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:12.949080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:12.949741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:12.951707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.080191 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4096/8227] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:12 2022] POST /identity/v3/users => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:13.081673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.092454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952409-4028-43f7-93bf-7f732e2e6b93 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.097581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.098288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.098653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.098986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.099688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.101377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.113616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4132/8228] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:13.118027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.129123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc1932-bfdb-443d-ab1e-23571e6b3213 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.134227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.134875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.135181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.135457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] PATH_INFO: `/v3/projects/4181c349ddab49099de13dd40f25bb1f/users/fda45977217e4e4c93534aa7516d00d6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.152893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4181c349ddab49099de13dd40f25bb1f, user_id=fda45977217e4e4c93534aa7516d00d6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.155617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.159877 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:13.245111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.248698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.255183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4097/8229] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:13 2022] PUT /identity/v3/projects/4181c349ddab49099de13dd40f25bb1f/users/fda45977217e4e4c93534aa7516d00d6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:13.259614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.262304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0625ca-efa6-4bb9-bbd7-3243a424c188 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.339351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.341308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.342490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.343764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] PATH_INFO: `/v3/users/b25f2e99b0b24ac5a6f1bf26de27eacb` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.346291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25f2e99b0b24ac5a6f1bf26de27eacb)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.349558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.358535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a315a-efa1-46b4-b598-44cc904d460a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.364044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.368684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.368684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.368684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.368684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.368684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.391228 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4098/8230] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:55:13.393031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.404199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e196a-cfac-4ed6-b053-15d3efe993b9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.410692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.411342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.411621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.411894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] PATH_INFO: `/v3/projects/4181c349ddab49099de13dd40f25bb1f/users/fda45977217e4e4c93534aa7516d00d6/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.414012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4181c349ddab49099de13dd40f25bb1f, user_id=fda45977217e4e4c93534aa7516d00d6, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.416880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ded4d6-4333-4a93-9395-1f6298acff87 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.429169 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4099/8231] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:13 2022] PUT /identity/v3/projects/4181c349ddab49099de13dd40f25bb1f/users/fda45977217e4e4c93534aa7516d00d6/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:55:13.440757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.441807 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.442177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.476080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] MFA Rules not processed for user `fda45977217e4e4c93534aa7516d00d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:13.477982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.555819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25f2e99b0b24ac5a6f1bf26de27eacb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:13.556791 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4100/8232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:13.567838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.569289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.623362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25f2e99b0b24ac5a6f1bf26de27eacb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:13.624325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25f2e99b0b24ac5a6f1bf26de27eacb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:13.640439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25f2e99b0b24ac5a6f1bf26de27eacb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:13.663807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-02be2b7d-0b99-487a-8b1f-e3c6d39c90c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25f2e99b0b24ac5a6f1bf26de27eacb'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:13.670401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5c0ae-0140-46d5-a2af-ef4c6a029978 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.671000 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4133/8233] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:13 2022] DELETE /identity/v3/users/b25f2e99b0b24ac5a6f1bf26de27eacb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:55:13.675966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.676256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.676528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.695323 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:13.707970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:13.709236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.736014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.737434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.737875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.738298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.740692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.759538 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:13.780652 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4134/8234] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:13.790486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.793483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.816744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.816744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.826753 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4101/8235] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:13.855123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5f3f-d9b7-41a2-b771-a71ad2aa8563 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.859757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.860360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.861159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.861455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.871436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.872852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.881535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:13.881535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.883931 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4135/8236] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:13.894561 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649c29-b2b1-4375-8416-ff77192e69b2 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:13.898731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:13.899351 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:13.899630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:13.899927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:13.901741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:13.965986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:13.967708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:13.977979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4102/8237] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:14.039295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:14.040677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.117064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7a9fc-fa5d-4c2f-8332-f01945138f24 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:14.122656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:14.123343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:14.123634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:14.123979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:14.126344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.142372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:14.143785 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:14.157161 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4136/8238] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:14.379037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:14.382649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.395868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f84a-2cce-4d89-8894-a11e1a5f9274 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:14.402003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:14.402649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:14.402928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:14.403314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] PATH_INFO: `/v3/projects/9d6d765c81ad4b17bd8286f4d0ec78e9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:14.404381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6d765c81ad4b17bd8286f4d0ec78e9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:14.417589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:14.571828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6d765c81ad4b17bd8286f4d0ec78e9', 'request_id': 'req-97329842-a04c-45bb-b54e-b4f1781577f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:14.577666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6d765c81ad4b17bd8286f4d0ec78e9', 'request_id': 'req-97329842-a04c-45bb-b54e-b4f1781577f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:14.581803 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:14.697216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6d765c81ad4b17bd8286f4d0ec78e9', 'request_id': 'req-97329842-a04c-45bb-b54e-b4f1781577f7'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:14.711099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] The token cache is being invalidate because project 9d6d765c81ad4b17bd8286f4d0ec78e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:14.711209 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:14.711792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:14.713508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4103/8239] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:14 2022] DELETE /identity/v3/projects/9d6d765c81ad4b17bd8286f4d0ec78e9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:14.715765 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:14.717462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:14.717592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.718952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.732344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e89350-82e4-4502-a278-c1c43286b96d service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:14.785633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:14.786405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:14.786685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:14.786952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:14.790021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:14.791509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97329842-a04c-45bb-b54e-b4f1781577f7 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:14.796446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:14.797074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:14.797380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:14.797660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] PATH_INFO: `/v3/users/ae1a0c57135349e1a2498c4d2dda7298` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:14.798921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1a0c57135349e1a2498c4d2dda7298)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:14.800840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:14.802278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:14.803683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:14.815240 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4137/8240] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:15.027273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1a0c57135349e1a2498c4d2dda7298'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.028812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1a0c57135349e1a2498c4d2dda7298'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.042677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1a0c57135349e1a2498c4d2dda7298'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.043432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1a0c57135349e1a2498c4d2dda7298'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.105344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1a0c57135349e1a2498c4d2dda7298'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.124289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4104/8241] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:14 2022] DELETE /identity/v3/users/ae1a0c57135349e1a2498c4d2dda7298 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:15.296576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:15.298145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:15.313263 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf492-b412-49dc-8aec-5cdd018996f2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:15.338275 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:15.384285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:15.384901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:15.385300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:15.385468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:15.387327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:15.475398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:15.476872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:15.490920 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4138/8242] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:15.587421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:15.590960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:15.683470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4fe1d-c7fd-490e-8126-5f8cb9374e1d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:15.688280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:15.689155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:15.689556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:15.689929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] PATH_INFO: `/v3/projects/15b4ceae318d498280cadc960fe201dd` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:15.691575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b4ceae318d498280cadc960fe201dd)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:15.693503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:15.708147 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:15.821165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b4ceae318d498280cadc960fe201dd', 'request_id': 'req-ed9d7bdc-9f78-4001-9059-743a6131ae93'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.837918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b4ceae318d498280cadc960fe201dd', 'request_id': 'req-ed9d7bdc-9f78-4001-9059-743a6131ae93'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.979713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b4ceae318d498280cadc960fe201dd', 'request_id': 'req-ed9d7bdc-9f78-4001-9059-743a6131ae93'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.994248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] The token cache is being invalidate because project 15b4ceae318d498280cadc960fe201dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:15.994543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.995489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:15.996967 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4105/8243] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:15 2022] DELETE /identity/v3/projects/15b4ceae318d498280cadc960fe201dd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:16.001072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:16.013183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef29cd1-fd7c-42d2-b54e-2f66fe6164bc service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:16.071605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:16.072235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:16.072493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:16.072757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] PATH_INFO: `/v3/users/8ca3a9d368ee44208ee2e945c8a6a61c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:16.073878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca3a9d368ee44208ee2e945c8a6a61c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:16.075789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:16.294941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca3a9d368ee44208ee2e945c8a6a61c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:16.354177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca3a9d368ee44208ee2e945c8a6a61c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:16.354797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca3a9d368ee44208ee2e945c8a6a61c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:16.363576 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:16.368214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca3a9d368ee44208ee2e945c8a6a61c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:16.375141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-c32edec4-b360-43cf-b947-8f10999b70be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca3a9d368ee44208ee2e945c8a6a61c'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:16.381656 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4139/8244] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:15 2022] DELETE /identity/v3/users/8ca3a9d368ee44208ee2e945c8a6a61c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:16.807636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:16.809171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:16.840000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d7bdc-9f78-4001-9059-743a6131ae93 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:16.905291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:16.905987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:16.906318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:16.906592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] PATH_INFO: `/v3/projects/3ca11d8f912345588f848e4077d82bcb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:16.908372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca11d8f912345588f848e4077d82bcb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:16.910275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.022020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca11d8f912345588f848e4077d82bcb', 'request_id': 'req-d284e062-1608-46a6-9b24-942a15f9d486'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:17.027658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca11d8f912345588f848e4077d82bcb', 'request_id': 'req-d284e062-1608-46a6-9b24-942a15f9d486'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:17.128354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca11d8f912345588f848e4077d82bcb', 'request_id': 'req-d284e062-1608-46a6-9b24-942a15f9d486'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:17.142505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] The token cache is being invalidate because project 3ca11d8f912345588f848e4077d82bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:17.142774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:17.143402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d284e062-1608-46a6-9b24-942a15f9d486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:17.145864 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4106/8245] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:16 2022] DELETE /identity/v3/projects/3ca11d8f912345588f848e4077d82bcb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:17.150992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.151469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.151584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.183750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:17.185477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:17.247141 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4140/8246] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:17.256591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.256963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.257240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.278083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:17.279289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:17.288895 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4107/8247] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:17.292750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.303626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c9b4-1864-4ea2-b91a-158d29b0b6bd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.308338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.308938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.309268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.309719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.310439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:55:17.310742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.312327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.325891 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4141/8248] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:55:17.330760 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.341366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba0efc-5d71-4855-8c1b-30362bad6fdb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.347452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.348073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.348378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.348654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.349290 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.351230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.444703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4108/8249] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:17 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:17.448855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.459779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa025c1-b373-4c84-bcf2-d67dd223b215 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.518157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.518792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.519067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.519335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.520219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.522165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.616655 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4142/8250] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:17 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:55:17.620525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.627420 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:17.633023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba2517-8a69-467a-bfcc-84340d8ac08a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.638241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.638933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.639283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.639700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.640591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.642756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.654023 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4109/8251] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:17.662140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.674132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afc88a-8cd7-4abd-9035-0e7be36de249 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.682206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.685138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.685138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.685138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.685138 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.686651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c711a63-f689-4996-8216-dda7517f3e23 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.700053 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4143/8252] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:17.704539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.719298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470616bb-c6aa-4a0c-a5fd-beef58925fd5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:17.725168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:17.725517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.725843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.726133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] PATH_INFO: `/v3/projects/384d691c08fa4a48b57896d89f252526/users/7348b82c87cf428dad89bc4fbb6ac1c4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.742776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384d691c08fa4a48b57896d89f252526, user_id=7348b82c87cf428dad89bc4fbb6ac1c4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:17.745634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:17.843696 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4110/8253] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:17 2022] PUT /identity/v3/projects/384d691c08fa4a48b57896d89f252526/users/7348b82c87cf428dad89bc4fbb6ac1c4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:17.854028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a6f9-bc5a-4fb9-875a-e15156796786 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:17.854314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a6f9-bc5a-4fb9-875a-e15156796786 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:17.854584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a6f9-bc5a-4fb9-875a-e15156796786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:17.887016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ed99a6f9-bc5a-4fb9-875a-e15156796786 None None] MFA Rules not processed for user `7348b82c87cf428dad89bc4fbb6ac1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:17.888235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed99a6f9-bc5a-4fb9-875a-e15156796786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:17.935981 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:17.963845 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4144/8254] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:17.976692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:17.978470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:18.038449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af2971-fb70-4e30-888d-b6ce026009c1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:18.042189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:18.042787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:18.043061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:18.043349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:18.052289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:18.053838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:18.062876 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4111/8255] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:20.891831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6532-eb59-47f2-b603-9f063a10f56e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:20.892364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6532-eb59-47f2-b603-9f063a10f56e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:20.892803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e6532-eb59-47f2-b603-9f063a10f56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:20.912404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-956e6532-eb59-47f2-b603-9f063a10f56e None None] MFA Rules not processed for user `7348b82c87cf428dad89bc4fbb6ac1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:20.913712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-956e6532-eb59-47f2-b603-9f063a10f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:20.920532 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4145/8256] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:22.228537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:22.230013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:22.295789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a894922-203a-4985-bf50-7f6b32ebeab3 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:22.301017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:22.301661 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:22.301940 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:22.302210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] PATH_INFO: `/v3/users/2c8907cb2ce84edea8a5085e88086390` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:22.303320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8907cb2ce84edea8a5085e88086390)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:22.305211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:22.495942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8907cb2ce84edea8a5085e88086390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:22.496589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8907cb2ce84edea8a5085e88086390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:22.504078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8907cb2ce84edea8a5085e88086390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:22.504702 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8907cb2ce84edea8a5085e88086390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:22.577187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8907cb2ce84edea8a5085e88086390'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:22.585348 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:22.598723 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4112/8257] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:22 2022] DELETE /identity/v3/users/2c8907cb2ce84edea8a5085e88086390 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:22.603141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:22.603648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:22.603648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:22.623738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:22.624999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:22.684007 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4146/8258] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:22.694169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:22.695629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:22.757111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf80d-1284-4d13-9252-2ea77c0c0624 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:22.760772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:22.761468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:22.762002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:22.762494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:22.772496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:22.773950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:22.783409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4113/8259] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:23.247271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:23.248715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:23.262091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006c17f-157a-4f56-ac73-e7091c2b6dc6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:23.266694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:23.267330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:23.267614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:23.267922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] PATH_INFO: `/v3/projects/0dad22f1e14f4b4fb50c4cc733507a7c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:23.269178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dad22f1e14f4b4fb50c4cc733507a7c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:23.271119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:23.400458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dad22f1e14f4b4fb50c4cc733507a7c', 'request_id': 'req-5716770f-9a60-4694-bc3f-604f67ed4746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.468577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dad22f1e14f4b4fb50c4cc733507a7c', 'request_id': 'req-5716770f-9a60-4694-bc3f-604f67ed4746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.475880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dad22f1e14f4b4fb50c4cc733507a7c', 'request_id': 'req-5716770f-9a60-4694-bc3f-604f67ed4746'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.487083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] The token cache is being invalidate because project 0dad22f1e14f4b4fb50c4cc733507a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:23.487365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.487989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.489486 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4147/8260] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:23 2022] DELETE /identity/v3/projects/0dad22f1e14f4b4fb50c4cc733507a7c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:23.493588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:23.503476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cee35-720b-4418-86b8-314452068318 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:23.559869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:23.560488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:23.560767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:23.561043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] PATH_INFO: `/v3/users/fda45977217e4e4c93534aa7516d00d6` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:23.562199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda45977217e4e4c93534aa7516d00d6)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:23.564100 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:23.783334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda45977217e4e4c93534aa7516d00d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.783978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda45977217e4e4c93534aa7516d00d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.791131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda45977217e4e4c93534aa7516d00d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.791791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda45977217e4e4c93534aa7516d00d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.888051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-4b96d081-0b59-4bd0-a27c-1b847de1027c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda45977217e4e4c93534aa7516d00d6'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:23.912503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4114/8261] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:23 2022] DELETE /identity/v3/users/fda45977217e4e4c93534aa7516d00d6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:24.338901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:24.342592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:24.355784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716770f-9a60-4694-bc3f-604f67ed4746 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:24.414131 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:24.420826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:24.421484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:24.421768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:24.422039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] PATH_INFO: `/v3/projects/4181c349ddab49099de13dd40f25bb1f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:24.423170 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4181c349ddab49099de13dd40f25bb1f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:24.425168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:24.542079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4181c349ddab49099de13dd40f25bb1f', 'request_id': 'req-b7f4f145-9056-4432-ae3d-b5a660e02991'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:24.619471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4181c349ddab49099de13dd40f25bb1f', 'request_id': 'req-b7f4f145-9056-4432-ae3d-b5a660e02991'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:24.626837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4181c349ddab49099de13dd40f25bb1f', 'request_id': 'req-b7f4f145-9056-4432-ae3d-b5a660e02991'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:24.637602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] The token cache is being invalidate because project 4181c349ddab49099de13dd40f25bb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:24.637898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:24.638556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-b7f4f145-9056-4432-ae3d-b5a660e02991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:24.640053 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4148/8262] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:24 2022] DELETE /identity/v3/projects/4181c349ddab49099de13dd40f25bb1f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:24.645538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:24.646020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:24.646103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:24.668180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:24.669411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:24.675149 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:24.730399 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4115/8263] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:24.738189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:24.738470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:24.738741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:24.760855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:24.762314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:24.773875 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4149/8264] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:24.778236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:24.788679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c768e-3c7c-443c-8a01-82dc2ff763c7 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:24.793570 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:24.794172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:24.794473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:24.794750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:24.795397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:55:24.795699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:24.797286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:24.809166 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4116/8265] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:55:24.814410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:24.824456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c833a3-fcf6-43a2-adad-a0ff7f8ac900 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:24.830061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:24.830988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:24.831389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:24.831666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:24.832309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:24.835479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:24.953517 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4150/8266] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:24 2022] POST /identity/v3/projects => generated 407 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:24.958265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:24.969142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7eba0-dc99-4657-909c-c800e2e9cd64 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.030691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.031335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.031609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.031879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.032626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.035707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.056139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.058046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:25.122996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26520f7d-0ae5-428e-872f-e3c607176b9e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.130229 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4117/8267] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:24 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:55:25.130399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.130399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.130399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.130399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.136537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:25.136632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.144164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea00a-e1b8-474b-8bed-d4a0f4274ad0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.145778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.147450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.151586 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.152227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.152512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.152786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.153460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.155404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.159575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4151/8268] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:25.169400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4118/8269] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:25.176424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.185121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e83bf3-ea00-47e5-bcd2-284fd683cf10 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.190502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.191110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.191392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.191664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.192302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.194176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd32ec-369f-47e3-93ca-bbf5c9647187 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.205624 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4152/8270] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:25.209733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.220318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373642df-8ade-4eee-9b78-cc14ea20abe8 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.225181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.229239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.229239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.229239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] PATH_INFO: `/v3/projects/ec39d728606b4fa092ca8b883e72c53b/users/fbbee1046a2144daacab564dbef47ef3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.242118 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec39d728606b4fa092ca8b883e72c53b, user_id=fbbee1046a2144daacab564dbef47ef3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.244874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.312870 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4119/8271] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:25 2022] PUT /identity/v3/projects/ec39d728606b4fa092ca8b883e72c53b/users/fbbee1046a2144daacab564dbef47ef3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:25.324217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.324611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.324806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.356196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] MFA Rules not processed for user `fbbee1046a2144daacab564dbef47ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:25.357426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:25.397860 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:25.425805 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4153/8272] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:25.430260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.486267 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:25.497129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556286a3-7733-4037-91e7-1bbce9b06f63 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.502413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.503016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.503293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.503610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.504769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.506846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.615364 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4120/8273] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:25 2022] POST /identity/v3/projects => generated 405 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:25.619537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.630618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8eddb-57f0-4ea3-8790-191fb4e1bd4c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.686340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.686934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.687233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.687505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.688136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.690628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.786039 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4154/8274] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:25 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:25.787436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.797803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c2ec8-3a94-41b2-b85f-10b737a02384 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.803393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.803998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.804329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.804602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.805236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.806992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.817799 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4121/8275] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:25.822207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.832944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baa545-a426-472a-8ecd-158d944577ab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:25.837616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:25.838269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:25.838553 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:25.838820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] PATH_INFO: `/v3/projects/3a9b2dc8ea984f288e50b9a34f542170/users/4f22c6348dc04f2c822803bbe781a128/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:25.854246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9b2dc8ea984f288e50b9a34f542170, user_id=4f22c6348dc04f2c822803bbe781a128, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:25.857092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:25.943409 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4155/8276] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:25 2022] PUT /identity/v3/projects/3a9b2dc8ea984f288e50b9a34f542170/users/4f22c6348dc04f2c822803bbe781a128/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:25.947495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:25.958641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ec6b8-dccd-420d-81ca-6cbbf02b1527 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:26.019594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:26.020210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.020510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.020783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.021449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:26.023111 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da01af-a6f5-4480-979b-4eeb56545c09 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:26.033467 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4122/8277] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:26.037819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:26.049380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24aa8a-264d-4152-a0de-4a27a05a1594 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:26.054145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:26.059698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.059698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.059698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] PATH_INFO: `/v3/projects/3a9b2dc8ea984f288e50b9a34f542170/users/4f22c6348dc04f2c822803bbe781a128/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.059698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9b2dc8ea984f288e50b9a34f542170, user_id=4f22c6348dc04f2c822803bbe781a128, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:26.060331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:26.072376 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4156/8278] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:26 2022] PUT /identity/v3/projects/3a9b2dc8ea984f288e50b9a34f542170/users/4f22c6348dc04f2c822803bbe781a128/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:26.082241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.082526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.088447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.113403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] MFA Rules not processed for user `4f22c6348dc04f2c822803bbe781a128`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:26.114657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:26.124863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:26.127356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:26.201260 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4123/8279] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:26 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:26.212806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:26.214327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:26.225166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e32f5-f3d2-452e-9e4e-9ac82e2c4e3c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:26.231107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:26.231730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.232012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.232345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.234708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:26.252020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:26.254885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:26.273049 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:26.273681 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4157/8280] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:26.279057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49645afb-0d02-4b42-81a3-dae81603dcf3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:26.283499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:26.284183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.284529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.284860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.297902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:26.299969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:26.311605 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4124/8281] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:55:26.681155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:26.693985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35526f-049e-470c-a6e4-d4885e88f40c service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:26.697742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:26.701436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:26.701436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:26.701436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:26.712621 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:26.764618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:26.765981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04e93-205e-441f-94dd-3be190b5a6cd service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:26.777241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4158/8282] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:26 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:36.419241 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:36.785693 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=21 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:39.059680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:39.158251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94914e96-3209-4d26-8d73-586826069c7d service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:39.163335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:39.164265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:39.164720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:39.165249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] PATH_INFO: `/v3/users/fbbee1046a2144daacab564dbef47ef3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:39.166495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbee1046a2144daacab564dbef47ef3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:39.168805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:39.382899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbee1046a2144daacab564dbef47ef3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:39.383704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbee1046a2144daacab564dbef47ef3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:39.393615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbee1046a2144daacab564dbef47ef3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:39.394379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbee1046a2144daacab564dbef47ef3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:39.474056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbee1046a2144daacab564dbef47ef3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:39.492061 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4125/8283] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:39 2022] DELETE /identity/v3/users/fbbee1046a2144daacab564dbef47ef3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:39.496561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836063-83b8-495d-8660-204d51e3793c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:39.497268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836063-83b8-495d-8660-204d51e3793c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:39.497268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836063-83b8-495d-8660-204d51e3793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:39.517598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bf836063-83b8-495d-8660-204d51e3793c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:39.518925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf836063-83b8-495d-8660-204d51e3793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:39.585788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4159/8284] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:39.596457 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:39.597931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:39.660406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4953c-12a6-49d7-948c-7336e4780331 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:39.664271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:39.664985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:39.665379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:39.665788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:39.675637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:39.676966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:39.687215 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4126/8285] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:40.129074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836063-83b8-495d-8660-204d51e3793c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:40.130755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf836063-83b8-495d-8660-204d51e3793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:40.147530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836063-83b8-495d-8660-204d51e3793c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:40.154342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:40.155325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:40.155781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:40.156323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] PATH_INFO: `/v3/projects/ec39d728606b4fa092ca8b883e72c53b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:40.158932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec39d728606b4fa092ca8b883e72c53b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:40.163171 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:40.317574 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec39d728606b4fa092ca8b883e72c53b', 'request_id': 'req-a77bfa9d-4813-4c24-aa25-4851e1a8d075'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.385112 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec39d728606b4fa092ca8b883e72c53b', 'request_id': 'req-a77bfa9d-4813-4c24-aa25-4851e1a8d075'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.393189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec39d728606b4fa092ca8b883e72c53b', 'request_id': 'req-a77bfa9d-4813-4c24-aa25-4851e1a8d075'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.405288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] The token cache is being invalidate because project ec39d728606b4fa092ca8b883e72c53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:40.405605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.406254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.408627 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4160/8286] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:40 2022] DELETE /identity/v3/projects/ec39d728606b4fa092ca8b883e72c53b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:40.412581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:40.429520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57ebd-64f1-4fad-a63f-9246312f7397 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:40.446047 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:40.490144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:40.491751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:40.492358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:40.493271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] PATH_INFO: `/v3/users/4f22c6348dc04f2c822803bbe781a128` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:40.494611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f22c6348dc04f2c822803bbe781a128)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:40.496589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:40.661134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f22c6348dc04f2c822803bbe781a128'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.661134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f22c6348dc04f2c822803bbe781a128'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.669070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f22c6348dc04f2c822803bbe781a128'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.669916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f22c6348dc04f2c822803bbe781a128'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.722485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-914baca6-5a31-467e-87e7-8c09dd0ab889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f22c6348dc04f2c822803bbe781a128'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:40.743318 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4127/8287] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:55:40 2022] DELETE /identity/v3/users/4f22c6348dc04f2c822803bbe781a128 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:41.325631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:41.325631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:41.350510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bfa9d-4813-4c24-aa25-4851e1a8d075 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:41.411788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:41.412415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:41.412691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:41.412966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] PATH_INFO: `/v3/projects/3a9b2dc8ea984f288e50b9a34f542170` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:41.414104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9b2dc8ea984f288e50b9a34f542170)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:41.419994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:41.533362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:41.551028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9b2dc8ea984f288e50b9a34f542170', 'request_id': 'req-f8d845be-a474-4e5d-822c-b5c4b48bd534'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:41.628472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9b2dc8ea984f288e50b9a34f542170', 'request_id': 'req-f8d845be-a474-4e5d-822c-b5c4b48bd534'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:41.636358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9b2dc8ea984f288e50b9a34f542170', 'request_id': 'req-f8d845be-a474-4e5d-822c-b5c4b48bd534'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:41.648223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] The token cache is being invalidate because project 3a9b2dc8ea984f288e50b9a34f542170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:55:41.648514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:41.649178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f8d845be-a474-4e5d-822c-b5c4b48bd534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:55:41.650713 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4161/8288] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:55:41 2022] DELETE /identity/v3/projects/3a9b2dc8ea984f288e50b9a34f542170 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:41.655898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:41.656444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:41.656444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:41.678277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:41.679553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:41.748122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4128/8289] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:55:41.750159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc801-796c-4f19-b686-882d39609f7c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:41.750447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc801-796c-4f19-b686-882d39609f7c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:41.750719 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bc801-796c-4f19-b686-882d39609f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:41.772388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-699bc801-796c-4f19-b686-882d39609f7c None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:41.773415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-699bc801-796c-4f19-b686-882d39609f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:41.781556 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4162/8290] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:41.786507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:41.797088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131aad-9534-4227-8d9a-495bfe4a3756 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:41.801757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:41.802374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:41.802657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:41.802922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:41.803574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:55:41.804175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:41.805540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:41.818418 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4129/8291] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 01:55:41.822762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bc801-796c-4f19-b686-882d39609f7c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:41.833543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bc801-796c-4f19-b686-882d39609f7c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:41.838255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:41.838864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:41.839139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:41.839405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:41.840056 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:41.842527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:41.952657 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4163/8292] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:41.957474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:41.968309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac9d35-692e-4409-8b6a-b3fa1a26a91e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:41.995722 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:42.028976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:42.029360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.029651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.030018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.030689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:42.032836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:42.145703 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4130/8293] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:55:41 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:55:42.147761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:42.158848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aebece-00ba-4e1b-8798-5288502e16ae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:42.163826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:42.164543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.164846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.165114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.165805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:42.167411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:42.178358 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4164/8294] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:42.182478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:42.193952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667ce6-e0e9-4227-8cb1-4a2f6fb4c946 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:42.199316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:42.199986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.200339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.200578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.201215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:42.202848 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a34bcc-04d9-4b0b-a2d2-402f8e599121 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:42.216679 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4131/8295] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:55:42.217920 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:42.227998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c91132-3ac7-460d-b68b-3d0409b60dae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:42.232587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:42.233235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.233551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.233828 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] PATH_INFO: `/v3/projects/f2ff01ab68984f7391a0ea06abf7cd5a/users/15f32436904e401585b5ec64a128f585/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.250021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff01ab68984f7391a0ea06abf7cd5a, user_id=15f32436904e401585b5ec64a128f585, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:42.253487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:42.315315 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4165/8296] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:55:42 2022] PUT /identity/v3/projects/f2ff01ab68984f7391a0ea06abf7cd5a/users/15f32436904e401585b5ec64a128f585/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:55:42.327044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.327328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.327632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.362219 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] MFA Rules not processed for user `15f32436904e401585b5ec64a128f585`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:55:42.365396 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:42.441890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4132/8297] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:55:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:55:42.453178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:55:42.454916 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:55:42.514888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22565d27-d5d7-4c6b-a79b-9f6ac59036c8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:55:42.518598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:55:42.519200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:55:42.519481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:55:42.519754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:55:42.528037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:55:42.529489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:55:42.538230 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4166/8298] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:55:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:55:52.438201 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:55:52.534321 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:16.019131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:16.020605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:16.132920 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f383a54-99e5-4220-9e0c-5e695bc71ba0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:16.142364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:16.145467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:16.145467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:16.145467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:16.145467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:16.258485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:16.260155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:16.269983 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4133/8299] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:56:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:56:24.124696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:24.126686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:24.243102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e520e4-da10-495d-a3d8-f61ef70b34ee service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:24.252878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:24.252878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:24.252878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:24.252878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:24.253278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:24.267147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:24.268729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5965427-35b1-4fcf-913f-224d2b0eca84 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:24.282079 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4167/8300] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:26.266668 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=63 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:31.718713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:31.796124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca0b45-b20d-4088-8804-16d46e813cea service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:31.802825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:31.804538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:31.805127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:31.805593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] PATH_INFO: `/v3/users/15f32436904e401585b5ec64a128f585` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:31.807003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f32436904e401585b5ec64a128f585)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:31.809085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:32.054743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f32436904e401585b5ec64a128f585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:32.060538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f32436904e401585b5ec64a128f585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:32.067868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f32436904e401585b5ec64a128f585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:32.068927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f32436904e401585b5ec64a128f585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:32.177321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f32436904e401585b5ec64a128f585'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:32.255039 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4134/8301] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:56:31 2022] DELETE /identity/v3/users/15f32436904e401585b5ec64a128f585 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:56:32.259822 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:32.260303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:32.261167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:32.337641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:32.339130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:32.463354 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4168/8302] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:56:32.476109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:32.478401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:32.610426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9aa8f-8c94-4e62-951f-5b872ee3a6ed admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:32.644018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:32.644841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:32.646075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:32.647606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:32.672689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:32.673426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f3e83-1347-4fab-b423-38ee5f8ad3be service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:32.699883 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4135/8303] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:56:33.337156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:33.338825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:33.365518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83afe16-6342-4a7b-9558-8433ceac8598 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:33.378122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:33.378918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:33.379373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:33.379804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] PATH_INFO: `/v3/projects/f2ff01ab68984f7391a0ea06abf7cd5a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:33.382047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ff01ab68984f7391a0ea06abf7cd5a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:33.384620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:33.564807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ff01ab68984f7391a0ea06abf7cd5a', 'request_id': 'req-81a856fb-37f0-435c-96db-61aac0b754b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:33.659269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ff01ab68984f7391a0ea06abf7cd5a', 'request_id': 'req-81a856fb-37f0-435c-96db-61aac0b754b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:33.666483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ff01ab68984f7391a0ea06abf7cd5a', 'request_id': 'req-81a856fb-37f0-435c-96db-61aac0b754b7'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:33.681185 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] The token cache is being invalidate because project f2ff01ab68984f7391a0ea06abf7cd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:56:33.681525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:33.682510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-81a856fb-37f0-435c-96db-61aac0b754b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:33.691410 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4169/8304] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:56:33 2022] DELETE /identity/v3/projects/f2ff01ab68984f7391a0ea06abf7cd5a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:56:33.694345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:33.694345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:33.695737 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:33.754544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:33.755803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:33.779204 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:33.842613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:33.843061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:33.843458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:33.854237 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4136/8305] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:56:33.887014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:33.888271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:33.913050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:33.918166 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4170/8306] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:56:33.926069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6b022-7b12-4e47-81a7-d230f7f3b23a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:33.936299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:33.936919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:33.937430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:33.937726 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:33.942346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:56:33.942346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:33.942346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:33.965548 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4137/8307] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:56:33.970471 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:33.993454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e96e2-cfc1-4510-825f-f376859d08de None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:33.999642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:34.000512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.000814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.001090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.001811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:34.003757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215217c-88a0-4d91-bf83-73e3a6f5c2b3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:34.012193 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:34.150542 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4171/8308] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:56:34.154717 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:34.187276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c2ebf-8e8c-4666-bd4f-c98caada7ddf admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:34.289434 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.289743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.290030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.326072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] MFA Rules not processed for user `f0f51fe515ee4375a252a8d8a98ec77b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:34.327403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:34.327825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:34.328921 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.329610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.330217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.331274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:34.333774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:34.414544 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4172/8309] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:56:34.450748 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4138/8310] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:56:34 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:56:34.451720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:34.492603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cab137-ebfa-432f-8514-d36201652a9a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:34.501963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:34.502772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.502997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.503208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.503854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:34.505779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:34.529776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4173/8311] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:56:34.533995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:34.548633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceb07c-6226-4559-abf3-3a08882132d4 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:34.564728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:34.565625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.565916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.566302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.567347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:34.569251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c7ff8-cb42-4051-92d7-243b20531779 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:34.602999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4139/8312] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:56:34.607181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:34.620034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84998739-66a8-4293-a21a-cf208986c735 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:34.627500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:34.628298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.628681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.629060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] PATH_INFO: `/v3/projects/16e74f9a5a914061a76393f9dc4f7e52/users/26ef44f9372f4100aff26d5a4cbad0dd/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.651757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e74f9a5a914061a76393f9dc4f7e52, user_id=26ef44f9372f4100aff26d5a4cbad0dd, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:34.659260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:34.780899 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4174/8313] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:56:34 2022] PUT /identity/v3/projects/16e74f9a5a914061a76393f9dc4f7e52/users/26ef44f9372f4100aff26d5a4cbad0dd/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:56:34.792738 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:34.793385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:34.793385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:34.826343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] MFA Rules not processed for user `26ef44f9372f4100aff26d5a4cbad0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:34.827666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:34.936588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4140/8314] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:56:34.949804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:34.952542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:35.026210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343beb-ad19-4474-8ccf-62d4a78a6af4 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:35.036655 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:35.037312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:35.037705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:35.038507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:35.051461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:35.054113 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:35.074062 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4175/8315] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:35.341135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:35.342582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:35.385630 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:35.444185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860fcc4-be24-434c-a108-98bd1a8b0853 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:35.453735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:35.455163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:35.455493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:35.456273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:35.458575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:35.481004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:35.482963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0aca4-c901-4889-b35a-f9455e352653 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:35.496930 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4141/8316] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:42.710193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:42.788511 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:42.796212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5d50e-cd67-4451-b336-03a5ea82b521 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:42.801282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:42.802003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:42.802353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:42.802690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] PATH_INFO: `/v3/users/26ef44f9372f4100aff26d5a4cbad0dd` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:42.810261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ef44f9372f4100aff26d5a4cbad0dd)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:42.813808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:43.034041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ef44f9372f4100aff26d5a4cbad0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:43.124748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ef44f9372f4100aff26d5a4cbad0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:43.128609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ef44f9372f4100aff26d5a4cbad0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:43.150814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ef44f9372f4100aff26d5a4cbad0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:43.160947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ef44f9372f4100aff26d5a4cbad0dd'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:43.168345 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4176/8317] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:56:42 2022] DELETE /identity/v3/users/26ef44f9372f4100aff26d5a4cbad0dd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:56:43.172959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:43.173559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:43.173691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:43.195902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:43.197272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:43.266837 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4142/8318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:56:43.277641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:43.279312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:43.348711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc1784-7285-4684-af6e-ced24ee7693b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:43.352581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:43.353264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:43.353748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:43.354093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:43.364333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:43.366325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c205ec-49b4-4726-9555-3ef7b81a2cbf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:43.376057 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4177/8319] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:43.844276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:43.846124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:43.863968 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19aeb2-c974-4284-bb1b-1816d2623920 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:43.871098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:43.872718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:43.873220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:43.873741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] PATH_INFO: `/v3/projects/16e74f9a5a914061a76393f9dc4f7e52` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:43.875460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e74f9a5a914061a76393f9dc4f7e52)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:43.878091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.033745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e74f9a5a914061a76393f9dc4f7e52', 'request_id': 'req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:44.039946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e74f9a5a914061a76393f9dc4f7e52', 'request_id': 'req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:44.125065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e74f9a5a914061a76393f9dc4f7e52', 'request_id': 'req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:44.137055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] The token cache is being invalidate because project 16e74f9a5a914061a76393f9dc4f7e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:56:44.137371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:44.138132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8e6cfd76-d8e2-4a59-8c8b-33d8f1ad8cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:56:44.139749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4143/8320] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:56:43 2022] DELETE /identity/v3/projects/16e74f9a5a914061a76393f9dc4f7e52 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:56:44.144644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.151438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.151438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.165965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:44.167192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:44.229569 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4178/8321] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:56:44.237557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c27e-080d-4647-a347-49616268da75 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.238047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c27e-080d-4647-a347-49616268da75 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.238148 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c27e-080d-4647-a347-49616268da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.258036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8725c27e-080d-4647-a347-49616268da75 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:44.259253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8725c27e-080d-4647-a347-49616268da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:44.267564 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4144/8322] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:56:44.272235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.282144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae455f-20c4-4d9d-ac25-4c8de1a57864 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.290348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.291024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.291365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.291701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.292380 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:56:44.292675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.294293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.306261 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4179/8323] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:56:44.310719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c27e-080d-4647-a347-49616268da75 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.320153 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c27e-080d-4647-a347-49616268da75 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.324882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.325507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.325790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.326063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.326692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.328592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.432755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4145/8324] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:56:44 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:56:44.436847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.447770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087280ef-8222-4980-83b7-ee6dfb8adc18 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.452373 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:44.513257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.513912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.514191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.514457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.515129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.517026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.605606 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4180/8325] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:56:44 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:56:44.606969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.612580 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:44.617977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2cce9-6ae1-4591-a5e8-fdb06fbaa2c9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.622658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.623253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.623747 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.629156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.629156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.629156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.637403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4146/8326] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:56:44.641314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.653754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ca03-2908-4fad-9375-0f2294ada042 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.658876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.659288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.659485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.659669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.660332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.662139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.673383 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4181/8327] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:56:44.677778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.688450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea20b03-3a98-46eb-9d5a-7fc8fde40803 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.693226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.694407 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.694688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.694960 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] PATH_INFO: `/v3/projects/d875e17616f24f518dffe463da324933/users/80d5cd8b57e64f47ad69ab8345a60a5b/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.714885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d875e17616f24f518dffe463da324933, user_id=80d5cd8b57e64f47ad69ab8345a60a5b, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.717904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96e0a-eb26-434b-9757-632cec3b86d4 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.750402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.752163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:44.809467 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4147/8328] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:56:44 2022] PUT /identity/v3/projects/d875e17616f24f518dffe463da324933/users/80d5cd8b57e64f47ad69ab8345a60a5b/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:56:44.821127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.821503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.821900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.836144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaa337-9d45-4579-91f1-5242caf88435 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:44.880082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] MFA Rules not processed for user `80d5cd8b57e64f47ad69ab8345a60a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:56:44.901858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:44.930832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:44.930832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:44.930832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:44.930832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:44.931210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:44.948022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:44.949737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:44.968050 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4182/8329] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:44.980085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4148/8330] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:56:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:56:44.992278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:44.994065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:45.010686 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:45.071562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590ea0-0454-4f55-9464-df7142985c45 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:45.076319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:45.076933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:45.077208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:45.077506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:45.095065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:45.096573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:45.113488 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4183/8331] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:56:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:56:54.976952 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=46,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:55.103628 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=22 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:56:55.635350 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:56:55.636762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:56:55.711378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac387b7d-f989-4aac-8829-69a5a4cc0446 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:56:55.716645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:56:55.718577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:56:55.718577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:56:55.718577 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:56:55.726230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:56:55.727852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:56:55.735963 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4149/8332] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:56:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:57:05.348414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:57:05.350477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:05.428398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b09a8-32ee-4c95-969e-3efb88aff7a4 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:57:05.434116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:57:05.434722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:05.434999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:05.435271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:05.436994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:05.451693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:57:05.453265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:57:05.466662 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4184/8333] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:57:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:57:05.732623 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=32 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:11.442910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:57:11.461112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e516a-bb81-4e12-a351-1d4611cf4029 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:57:11.467175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:57:11.467780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:11.468060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:11.468330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:11.470085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:11.531131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:57:11.532710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:57:11.541795 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4150/8334] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:57:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:57:15.461427 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=32 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:18.615243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:57:18.616658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:18.634581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809f616-15c0-4d92-ad1b-ebd065b48b54 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:57:18.640039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:57:18.640675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:18.640952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:18.641245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:18.642968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:18.717387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:57:18.719192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083746a2-8da2-4fd8-aa3b-d08f481e4dff service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:57:18.730798 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4185/8335] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:57:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:57:21.537472 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=28 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:23.140897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:57:23.156852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf5af0-84a2-4cdb-a584-974737ee52cb service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:57:23.163197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:57:23.163824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:23.164108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:23.164423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:23.166787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:23.184476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:57:23.186235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:57:23.201227 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4151/8336] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:57:28.725230 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=30 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:33.193381 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:57:52.052590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:52.052590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:52.052590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:52.085776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] MFA Rules not processed for user `f0f51fe515ee4375a252a8d8a98ec77b`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:57:52.087329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:52.096444 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4186/8337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:57:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:57:52.610346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:57:52.612697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:52.711171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad8491-b8e0-4d26-85f0-cc64c492fb49 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:57:52.716190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:57:52.717014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:57:52.717415 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:57:52.717790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:57:52.719713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:57:52.736639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:57:52.739063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e25964-9824-490f-8668-05f629defe73 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:57:52.754299 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4152/8338] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:57:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:00.753600 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:00.821862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864baf9a-d6fe-4ce7-b7af-48d8ea3b0c4a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:00.827181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:00.828435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:00.828435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:00.828832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] PATH_INFO: `/v3/users/80d5cd8b57e64f47ad69ab8345a60a5b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:00.830174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d5cd8b57e64f47ad69ab8345a60a5b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:00.832457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:01.035776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d5cd8b57e64f47ad69ab8345a60a5b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:01.112807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d5cd8b57e64f47ad69ab8345a60a5b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:01.113492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d5cd8b57e64f47ad69ab8345a60a5b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:01.129906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d5cd8b57e64f47ad69ab8345a60a5b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:01.139270 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d5cd8b57e64f47ad69ab8345a60a5b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:01.151257 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4187/8339] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:58:00 2022] DELETE /identity/v3/users/80d5cd8b57e64f47ad69ab8345a60a5b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:01.153001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:01.153855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:01.154352 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:01.178554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:01.180138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:01.258591 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4153/8340] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:01.268278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:01.269848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:01.351313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779385a-57eb-40eb-a0b4-e4065931d835 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:01.354983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:01.355650 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:01.356016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:01.356350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:01.365959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:01.367928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f653e3-fb2b-4281-9aa8-e71061349ecd service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:01.378947 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4188/8341] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:01.962294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:01.964342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:01.978657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501bc3-9bd6-4c13-8873-99163108ad6b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:01.983806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:01.984463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:01.984743 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:01.985015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] PATH_INFO: `/v3/projects/d875e17616f24f518dffe463da324933` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:01.986241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d875e17616f24f518dffe463da324933)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:01.988487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.118748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd875e17616f24f518dffe463da324933', 'request_id': 'req-06c541ca-67db-4233-bfc1-8fe4a0426e5d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:02.124600 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd875e17616f24f518dffe463da324933', 'request_id': 'req-06c541ca-67db-4233-bfc1-8fe4a0426e5d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:02.201996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd875e17616f24f518dffe463da324933', 'request_id': 'req-06c541ca-67db-4233-bfc1-8fe4a0426e5d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:02.214005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] The token cache is being invalidate because project d875e17616f24f518dffe463da324933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:58:02.214297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:02.215188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-06c541ca-67db-4233-bfc1-8fe4a0426e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:02.216708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4154/8342] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:58:01 2022] DELETE /identity/v3/projects/d875e17616f24f518dffe463da324933 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:02.222818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.223302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.223392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.244636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:02.245871 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:02.255998 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:02.305928 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4189/8343] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:02.314035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.314360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.314699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.337593 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:02.338809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:02.355187 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4155/8344] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:02.355334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.365032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba3342-ec12-471d-ab97-dba1d4d8e912 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.370724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.371657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.371984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.372262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.372940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:58:02.373242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.375184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.389374 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4190/8345] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:58:02.392621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.402458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf4b95-9542-40ca-9de9-846e25367a98 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.407183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.407778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.408076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.408330 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.408974 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.410929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.490109 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:02.501034 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4156/8346] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:58:02 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:58:02.502157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.512404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae42bd-4407-4565-9711-0e251613eedd admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.570277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.570964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.571239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.571505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.572144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.574081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.650514 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4191/8347] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:58:02 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:58:02.651668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.663101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237147bc-148d-4075-9c76-a293526bc5a9 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.669900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.670483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.670758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.671076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.671719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.673325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.688032 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4157/8348] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:02.689316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.699689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346aed43-05e1-44a9-a222-e28065941692 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.704891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.705542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.705818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.706085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.706742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.708323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b23bc0-331a-425d-b8fe-866d9ad16b8d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.720373 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4192/8349] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:02.724568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.735579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be2a3-056c-42e1-ad75-a8063f3d8439 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:02.740452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:02.741246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.741745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.742286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] PATH_INFO: `/v3/projects/5d62bd8787df4d238b2368fd62b8bd4b/users/d74ad82a7150426793ef888762ffbd21/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.757841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d62bd8787df4d238b2368fd62b8bd4b, user_id=d74ad82a7150426793ef888762ffbd21, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:02.760459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:02.854780 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4158/8350] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:58:02 2022] PUT /identity/v3/projects/5d62bd8787df4d238b2368fd62b8bd4b/users/d74ad82a7150426793ef888762ffbd21/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:58:02.859712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:02.860006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:02.860287 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:02.893243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:02.894869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:02.964404 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4193/8351] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:02.974271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:02.976292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:03.056047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a4db-5529-49bb-be0d-fdffa55df84f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:03.059810 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:03.060429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:03.060708 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:03.060971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:03.073578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:03.075959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba568d5-1393-426a-b1d9-8eb0a1e4e82c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:03.087075 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4159/8352] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:04.461735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:04.461735 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:04.491819 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:04.572602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559ddd-f4da-4bfc-8941-8929711da776 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:04.578065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:04.578714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:04.579454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:04.579454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:04.581324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:04.600653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:04.603034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:04.621504 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4194/8353] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:10.475579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:10.476500 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:10.476778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:10.517753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] MFA Rules not processed for user `d74ad82a7150426793ef888762ffbd21`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:10.521328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:10.602532 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4160/8354] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:10.604623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:10.618397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56d0b0-6075-4ab2-9dab-c0b39ffaa24c service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:10.623714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:10.624343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:10.624922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:10.624922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:10.625628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:10.627558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:10.727625 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4195/8355] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:58:10 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:58:10.731401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:10.751567 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cfcc8-ee1d-4077-8e11-54a3991d0064 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:10.757010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:10.759509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:10.760158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:10.760680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:10.761952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:10.766032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a79cd-4943-416e-b89c-d67081b0b256 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:10.781247 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4161/8356] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:10.785188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:10.796312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd2660-7ded-47fb-ac7f-4a259c8eb334 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:10.801485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:10.802325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:10.802771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:10.803209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] PATH_INFO: `/v3/system/users/4628c4a737ff4d709f9f7b5efdb6f729/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:10.820027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4628c4a737ff4d709f9f7b5efdb6f729, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:10.823059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:10.912441 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4196/8357] 10.222.0.13 () {60 vars in 1378 bytes} [Sun Oct 30 01:58:10 2022] PUT /identity/v3/system/users/4628c4a737ff4d709f9f7b5efdb6f729/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:58:10.929838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:10.930362 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:10.930745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:10.962831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] MFA Rules not processed for user `4628c4a737ff4d709f9f7b5efdb6f729`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:10.964411 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:11.039004 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:11.132138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4162/8358] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:10 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 30 01:58:11.135907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:11.258323 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ee6af-2718-4183-8539-fe5dbeb2353f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:11.283449 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:11.298506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4628c4a737ff4d709f9f7b5efdb6f729', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:11.299583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:11.299865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:11.300135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] PATH_INFO: `/v3/services` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:11.301360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:11.302209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:11.309564 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4197/8359] 10.222.0.13 () {58 vars in 1110 bytes} [Sun Oct 30 01:58:11 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:11.313714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:11.425187 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32905e02-fe93-4a59-9b8c-374849316163 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:11.463537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4628c4a737ff4d709f9f7b5efdb6f729', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:11.464923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:11.464923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:11.465188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] PATH_INFO: `/v3/limits` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:11.465624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:11.467620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 30 01:58:11.514084 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: ERROR keystone.server.flask.application Oct 30 01:58:11.515805 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4163/8360] 10.222.0.13 () {60 vars in 1126 bytes} [Sun Oct 30 01:58:11 2022] POST /identity/v3/limits => generated 124 bytes in 202 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 30 01:58:11.520738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:11.638699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31cf0a-49f2-4606-b779-15821ea9c880 None tempest-ImageQuotaTest-315848985-system-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:11.683045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4628c4a737ff4d709f9f7b5efdb6f729', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:11.683795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:11.684255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:11.684591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:11.689805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:11.691337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:11.698939 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4198/8361] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:58:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:58:11.705472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:11.727443 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:11.816163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950b70-26b9-4c3b-8e02-b520e959ba3c None tempest-ImageQuotaTest-315848985-system-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:11.858183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4628c4a737ff4d709f9f7b5efdb6f729', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:11.858929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:11.859266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:11.859539 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:11.860155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:11.861227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:11.866923 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4164/8362] 10.222.0.13 () {58 vars in 1137 bytes} [Sun Oct 30 01:58:11 2022] GET /identity/v3/registered_limits => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:58:16.104986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:16.116497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbfa24-3b37-4c8a-9870-1ea918faf6e4 None tempest-ImageQuotaTest-315848985-system-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:16.121523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:16.122156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:16.122437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:16.122708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] PATH_INFO: `/v3/users/d74ad82a7150426793ef888762ffbd21` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:16.123900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74ad82a7150426793ef888762ffbd21)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:16.125996 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:16.313224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74ad82a7150426793ef888762ffbd21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.315769 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:16.418796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74ad82a7150426793ef888762ffbd21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.419459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74ad82a7150426793ef888762ffbd21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.434611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74ad82a7150426793ef888762ffbd21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.441799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74ad82a7150426793ef888762ffbd21'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.450270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4199/8363] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:58:16 2022] DELETE /identity/v3/users/d74ad82a7150426793ef888762ffbd21 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:16.708372 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:16.710321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:16.783126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee7e65-21d7-42e0-bdb7-d23a06d27beb None tempest-ImageQuotaTest-315848985-system-admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:16.787679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:16.788301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:16.788582 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:16.789403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] PATH_INFO: `/v3/projects/5d62bd8787df4d238b2368fd62b8bd4b` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:16.790525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d62bd8787df4d238b2368fd62b8bd4b)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:16.792414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:16.912789 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:16.925914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d62bd8787df4d238b2368fd62b8bd4b', 'request_id': 'req-07be096d-f700-4ca5-b291-723202348d8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:16.931993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d62bd8787df4d238b2368fd62b8bd4b', 'request_id': 'req-07be096d-f700-4ca5-b291-723202348d8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.010071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d62bd8787df4d238b2368fd62b8bd4b', 'request_id': 'req-07be096d-f700-4ca5-b291-723202348d8b'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.022677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] The token cache is being invalidate because project 5d62bd8787df4d238b2368fd62b8bd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:58:17.022958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.023612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-07be096d-f700-4ca5-b291-723202348d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.025149 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4165/8364] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:58:16 2022] DELETE /identity/v3/projects/5d62bd8787df4d238b2368fd62b8bd4b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:17.029288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.041183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6210e3-aa73-473a-805b-10d83caac9cc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.098798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.099335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.099609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.099877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] PATH_INFO: `/v3/users/4628c4a737ff4d709f9f7b5efdb6f729` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.100970 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4628c4a737ff4d709f9f7b5efdb6f729)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.102907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.293688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4628c4a737ff4d709f9f7b5efdb6f729'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.363718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4628c4a737ff4d709f9f7b5efdb6f729'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.364307 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4628c4a737ff4d709f9f7b5efdb6f729'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.377092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4628c4a737ff4d709f9f7b5efdb6f729'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.384320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-93dec269-7454-4ff5-a0af-81de0f2bf7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4628c4a737ff4d709f9f7b5efdb6f729'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:58:17.390384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4200/8365] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:58:17 2022] DELETE /identity/v3/users/4628c4a737ff4d709f9f7b5efdb6f729 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 01:58:17.396684 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.397056 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.397424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.418965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:17.421468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:17.479953 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4166/8366] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:58:17.488250 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.488733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.489013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.509793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:17.513273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:17.519307 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4201/8367] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:17.523700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.533643 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fa9a4-7c89-4e86-9729-434a0822faa6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.538524 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.540251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.540536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.540809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.541489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:58:17.541795 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.543432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.556890 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4167/8368] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:58:17.565070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.574350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d5a09-420b-4e63-a3f6-a48ef1f6384e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.579265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.579868 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.580149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.580426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.581055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.583076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.656272 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4202/8369] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:58:17 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:58:17.660476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.671156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bd47f-7020-47f2-84a2-8af8903e5137 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.728773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.729424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.729686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.729959 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.730580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.732509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.822289 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4168/8370] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:58:17 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:58:17.826840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.837165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b94fa-5f3c-469d-a2ad-10e11352ce9f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.842032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.842621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.842897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.843165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.843797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.845402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.848588 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:17.855673 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4203/8371] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 01:58:17.859445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.871628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cca3d-0fae-4da3-a2db-5b3c0d40136d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.875562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.876166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.876449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.876724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.877382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.879009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1305e-b17a-4068-877b-972a42fc93fd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:17.894599 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4169/8372] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:17.897467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:17.915367 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aac3d-2591-4a84-af1f-da5966dd9833 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:17.916179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:17.917090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:17.917508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:17.917904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] PATH_INFO: `/v3/projects/815809ec42e44bce9da3c4e354b425bf/users/685162cc09ea436baabe059b9b346ef1/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:17.933742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815809ec42e44bce9da3c4e354b425bf, user_id=685162cc09ea436baabe059b9b346ef1, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:17.938356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:18.039385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4204/8373] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:58:17 2022] PUT /identity/v3/projects/815809ec42e44bce9da3c4e354b425bf/users/685162cc09ea436baabe059b9b346ef1/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:18.044528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7051-acbc-48dc-9e5c-6bb4b83074bd None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:18.044819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7051-acbc-48dc-9e5c-6bb4b83074bd None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:18.045092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f7051-acbc-48dc-9e5c-6bb4b83074bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:18.064985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-096f7051-acbc-48dc-9e5c-6bb4b83074bd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:18.066317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-096f7051-acbc-48dc-9e5c-6bb4b83074bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:18.086309 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:18.126276 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4170/8374] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:18.136437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:18.138220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:18.198368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024634e-c4f3-469d-8ffa-0c8a8305cea1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:18.202036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:18.202757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:18.203041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:18.203312 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:18.212389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:18.213932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:18.223773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4205/8375] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:23.932053 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:23.932629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:23.932629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:23.976232 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] MFA Rules not processed for user `685162cc09ea436baabe059b9b346ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:23.977669 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:24.058941 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4171/8376] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:24.063227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.074139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89acced-29f4-4dbd-9d55-dafe54b1ec37 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.078935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.079547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.079823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.080095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.080728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.083177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.173068 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4206/8377] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:58:24 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:58:24.173410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.183913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed029-eb63-4d1b-8aa1-463df535916b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.245495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.246132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.246409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.246681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.247802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.249790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.357425 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4172/8378] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:58:24 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:58:24.363585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.373557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333ad5-87e4-47aa-8a8a-74400abe74cb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.378701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.386646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.386646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.386646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.386646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.386646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.393523 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4207/8379] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:24.398009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.412307 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e29e-aaa9-4e38-9e41-1588f51946c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.418068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.418735 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.419042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.419286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] PATH_INFO: `/v3/projects/e3da7787fe0d4195a3035bd650008c65/users/30f55452aa494d76ae1c78dbb983d870/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.436843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3da7787fe0d4195a3035bd650008c65, user_id=30f55452aa494d76ae1c78dbb983d870, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.439871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.545392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4173/8380] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:58:24 2022] PUT /identity/v3/projects/e3da7787fe0d4195a3035bd650008c65/users/30f55452aa494d76ae1c78dbb983d870/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:24.549191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.560885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01477ef9-0a44-490d-b06c-6c8557780a39 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.618022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.618624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.618925 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.619192 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.619816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.621485 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ae54-d58d-4a9d-88a4-88636625ad92 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.631417 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4208/8381] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:58:24.636244 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:24.646694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd3a2b-1ecf-46f3-acf8-393c6e7a5551 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:24.651361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:24.652089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:24.652374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:24.652645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] PATH_INFO: `/v3/projects/e3da7787fe0d4195a3035bd650008c65/users/30f55452aa494d76ae1c78dbb983d870/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:24.654727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3da7787fe0d4195a3035bd650008c65, user_id=30f55452aa494d76ae1c78dbb983d870, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:24.657877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:24.672503 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4174/8382] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:58:24 2022] PUT /identity/v3/projects/e3da7787fe0d4195a3035bd650008c65/users/30f55452aa494d76ae1c78dbb983d870/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:58:30.701898 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:30.702942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:30.703405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:30.752803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] MFA Rules not processed for user `30f55452aa494d76ae1c78dbb983d870`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:58:30.752803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:30.780103 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:30.831451 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4209/8383] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:58:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:58:30.845827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:30.847695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:30.859358 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:30.938554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb2e44-054b-4523-af0a-523a16d9b437 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:30.942657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:30.946662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:30.946662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:30.946662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:31.023989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:31.025917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:31.038082 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4175/8384] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:41.026919 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=17 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:41.055915 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=54 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:58:49.502218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:49.503661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:49.567544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778d826-e026-44fb-9690-b14af40bb3f4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:49.571149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:49.571747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:49.572040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:49.572311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:49.574001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:49.652045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:49.653505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:49.667546 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4210/8385] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:58:55.917201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:58:55.930979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcaeff-842f-43df-9e00-3dba93234eba service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:58:55.934740 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:58:55.935354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:58:55.935637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:58:55.935915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:58:55.937923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:58:55.955698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:58:55.957142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:58:55.974138 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4176/8386] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:58:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:58:59.659818 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=54 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:02.912047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:02.913627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:02.987168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27673dd-dc57-473e-a76d-9990dd271cb3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:02.992231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:02.992833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:02.993115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:02.993423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:03.001595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:03.003202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:03.012322 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4211/8387] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 01:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 01:59:05.963784 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:13.008546 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=32 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:32.664323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:32.680562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506fb00-0dd5-4f2c-87b2-f7d9052fabe7 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:32.684946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:32.686198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:32.686645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:32.687207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:32.689380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:32.704158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:32.706346 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73bfca-49b7-4378-8a81-35e6faa300e9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:32.723189 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4177/8388] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:59:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:59:40.970291 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:40.972693 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:41.050010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6951-d68f-4909-9eb3-dea2ef3c02a1 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:41.055189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:41.055806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:41.056081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:41.056349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] PATH_INFO: `/v3/users/f0f51fe515ee4375a252a8d8a98ec77b` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:41.057504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f51fe515ee4375a252a8d8a98ec77b)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:41.059401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:41.222489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f51fe515ee4375a252a8d8a98ec77b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:41.340119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f51fe515ee4375a252a8d8a98ec77b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:41.341236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f51fe515ee4375a252a8d8a98ec77b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:41.357230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f51fe515ee4375a252a8d8a98ec77b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:41.365094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f51fe515ee4375a252a8d8a98ec77b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:41.372194 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4212/8389] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:59:40 2022] DELETE /identity/v3/users/f0f51fe515ee4375a252a8d8a98ec77b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:41.376984 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:41.377871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:41.378161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:41.406611 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:41.407911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:41.481395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4178/8390] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:59:41.491534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:41.493024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:41.563208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfa29-bba1-4e94-bc4c-d300585ce3a5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:41.567104 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:41.567712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:41.567988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:41.568401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:41.577783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:41.579231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:41.589391 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4213/8391] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:59:41.861878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:41.863691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:41.886478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc376c-0968-4702-8048-b66f0edd2a38 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:41.898549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:41.900067 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:41.900353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:41.900630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] PATH_INFO: `/v3/projects/f2bf165fe12748b29e66ea4f61364aef` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:41.901973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bf165fe12748b29e66ea4f61364aef)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:41.903949 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:42.030062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bf165fe12748b29e66ea4f61364aef', 'request_id': 'req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.036317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bf165fe12748b29e66ea4f61364aef', 'request_id': 'req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.156628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bf165fe12748b29e66ea4f61364aef', 'request_id': 'req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.168519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] The token cache is being invalidate because project f2bf165fe12748b29e66ea4f61364aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:59:42.170374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.170374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.171269 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4179/8392] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:59:41 2022] DELETE /identity/v3/projects/f2bf165fe12748b29e66ea4f61364aef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:42.174990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:42.184949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e9e2-7109-4e1b-842d-89fcac8efdba service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:42.202957 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:42.246524 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:42.247400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:42.247906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:42.248786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] PATH_INFO: `/v3/users/1c171756ca034defa78c77d149f59d86` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:42.250352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c171756ca034defa78c77d149f59d86)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:42.255814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:42.500723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c171756ca034defa78c77d149f59d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.574101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c171756ca034defa78c77d149f59d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.574800 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c171756ca034defa78c77d149f59d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.589885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c171756ca034defa78c77d149f59d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.597446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-6794556b-ef56-4f18-bbbb-0b81225665de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c171756ca034defa78c77d149f59d86'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:42.604619 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4214/8393] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 01:59:42 2022] DELETE /identity/v3/users/1c171756ca034defa78c77d149f59d86 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:42.917358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:42.919007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:42.945513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ffe57-57d2-4a8f-97ba-b08ef7ed1df2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.016683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.017628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.018078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.018599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] PATH_INFO: `/v3/projects/5645b1258faf4b1483556cea1d3197c3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.019922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5645b1258faf4b1483556cea1d3197c3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.022668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.035863 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:43.205972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5645b1258faf4b1483556cea1d3197c3', 'request_id': 'req-69ed2428-a349-4679-9328-c50d601cb9c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:43.214188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5645b1258faf4b1483556cea1d3197c3', 'request_id': 'req-69ed2428-a349-4679-9328-c50d601cb9c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:43.345388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5645b1258faf4b1483556cea1d3197c3', 'request_id': 'req-69ed2428-a349-4679-9328-c50d601cb9c5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:43.357261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] The token cache is being invalidate because project 5645b1258faf4b1483556cea1d3197c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 01:59:43.357609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:43.358285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-69ed2428-a349-4679-9328-c50d601cb9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 01:59:43.359764 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4180/8394] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 01:59:42 2022] DELETE /identity/v3/projects/5645b1258faf4b1483556cea1d3197c3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:43.366923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.367442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.368516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.391670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:43.392858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:43.463620 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4215/8395] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:59:43.472003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.472298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.472578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.501916 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:43.503213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:43.512737 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4181/8396] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 01:59:43.518030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.531606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9dc4-b011-4899-9ee0-c65edd143e58 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.536762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.537577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.537884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.538181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.538832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 01:59:43.539133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.540729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.553960 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4216/8397] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 01:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 01:59:43.559532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.569756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364d33a-8e7c-4253-b777-6350900a4643 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.574697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.575332 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.575607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.575890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.577156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.578626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.676647 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4182/8398] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:59:43 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 01:59:43.678322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.688603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bfda1-b8cd-4284-88b8-5d960ea63c6b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.729890 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:43.762234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.763403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.763848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.764283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.765063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.767792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.885892 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4217/8399] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:59:43 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:59:43.889875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.916409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b28da-7187-4052-93be-81ddbced2859 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.921140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.921766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.922034 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.922303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.922933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.924525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.936887 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4183/8400] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:59:43.941183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.951661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799df3-3705-474c-81a4-5dd9d4f2ea4c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.956481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.957114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.957421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.957701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:43.958337 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:43.960440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b17b0-f593-4abd-87eb-3be199882a12 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:43.972323 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4218/8401] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:59:43.975578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:43.986120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0859f-1d3b-4ad7-b8a4-8ae0be3d4ecc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:43.990868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:43.991550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:43.991826 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:43.992099 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] PATH_INFO: `/v3/projects/e5ce9157c6054134a5da1ff5ea5041aa/users/264018faacc64b96bf084c4a4ea99623/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:44.007932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ce9157c6054134a5da1ff5ea5041aa, user_id=264018faacc64b96bf084c4a4ea99623, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:44.010691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:44.115747 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4184/8402] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:59:43 2022] PUT /identity/v3/projects/e5ce9157c6054134a5da1ff5ea5041aa/users/264018faacc64b96bf084c4a4ea99623/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:44.123279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27336d-80c4-4176-8572-dd86c632b6fd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:44.123562 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27336d-80c4-4176-8572-dd86c632b6fd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:44.123839 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27336d-80c4-4176-8572-dd86c632b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:44.148846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9e27336d-80c4-4176-8572-dd86c632b6fd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:44.150119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9e27336d-80c4-4176-8572-dd86c632b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:44.219540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4219/8403] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:59:44.226980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:44.228793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:44.294006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae03f-1e5c-4605-8c82-14b88c507cc3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:44.298224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:44.298910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:44.299302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:44.299641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:44.317206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:44.317206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:44.328409 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4185/8404] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 01:59:50.967259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:50.973775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:50.973775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.013053 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] MFA Rules not processed for user `264018faacc64b96bf084c4a4ea99623`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:51.015874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:51.137840 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4220/8405] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:59:51.143986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.155704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5fde6-8eed-419b-afc3-e12c8b73b337 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.164658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.165853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.166126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.166597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.168011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.170333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.274109 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4186/8406] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 01:59:51 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:59:51.275695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.287641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9377b13-e204-4e64-8e94-1f7d89ac6a47 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.328275 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:51.355515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.356275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.356614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.356956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.357736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.359851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.467427 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4221/8407] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 01:59:51 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 01:59:51.476796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.483303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3914-d6d6-4a67-ba63-3175b1a37046 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.488055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.488654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.488930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.489200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.489861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.491966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.502865 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4187/8408] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:59:51.512277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.522406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5afc1-f27e-45aa-ada2-cd3ef6a49917 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.527175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.527802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.528110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.528384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] PATH_INFO: `/v3/projects/d34dd5457509403092ddffb5289fcbc9/users/8444f27f53f342d6afff548d2caf79a9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.544728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34dd5457509403092ddffb5289fcbc9, user_id=8444f27f53f342d6afff548d2caf79a9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.547677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.619384 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4222/8409] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:59:51 2022] PUT /identity/v3/projects/d34dd5457509403092ddffb5289fcbc9/users/8444f27f53f342d6afff548d2caf79a9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:51.623469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.637203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fa0af-7628-409a-b472-bc5b5031771e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.643137 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:59:51.702200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.702812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.703093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.703363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.704025 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.705780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3483f-dd9a-48b4-9bfc-76163ac06b42 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.716465 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4188/8410] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 01:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 01:59:51.720956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:51.733269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a8d39-2f6e-450c-942f-7ee2c14e5fbb admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:51.738377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:51.739139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:51.739421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:51.739695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] PATH_INFO: `/v3/projects/d34dd5457509403092ddffb5289fcbc9/users/8444f27f53f342d6afff548d2caf79a9/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:51.742224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34dd5457509403092ddffb5289fcbc9, user_id=8444f27f53f342d6afff548d2caf79a9, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:51.744928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:51.759994 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4223/8411] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 01:59:51 2022] PUT /identity/v3/projects/d34dd5457509403092ddffb5289fcbc9/users/8444f27f53f342d6afff548d2caf79a9/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 01:59:58.392607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a323-1fa0-448b-8398-3524d0ca158c None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:58.393328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a323-1fa0-448b-8398-3524d0ca158c None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:58.393771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4a323-1fa0-448b-8398-3524d0ca158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:58.434173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4fc4a323-1fa0-448b-8398-3524d0ca158c None None] MFA Rules not processed for user `8444f27f53f342d6afff548d2caf79a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:58.435434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4fc4a323-1fa0-448b-8398-3524d0ca158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:58.517782 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4189/8412] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 01:59:58.535437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 01:59:58.538207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:58.695139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c0ba-3b5f-4969-b265-fa682cfeb0d8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 01:59:58.702395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 01:59:58.703083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:58.703458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:58.703732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:58.715202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 01:59:58.716824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eff13-f34a-425a-a3f9-f729e1482368 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 01:59:58.728007 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4224/8413] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 01:59:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 01:59:58.797188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 01:59:58.797504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 01:59:58.797834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 01:59:58.831899 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] MFA Rules not processed for user `264018faacc64b96bf084c4a4ea99623`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 01:59:58.833124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 01:59:58.905704 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4190/8414] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 01:59:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:00:08.722628 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:08.894146 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=85 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:13.529402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:13.529941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:13.529941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:13.550273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] MFA Rules not processed for user `264018faacc64b96bf084c4a4ea99623`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:00:13.551636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:13.559543 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4225/8415] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:00:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:00:13.813204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:13.878581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a502-97ab-4fe0-a0ca-e0264b4fbbc6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:13.883188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:13.884252 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:13.884502 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:13.884856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:13.887151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:13.906771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:13.908359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:13.922084 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4191/8416] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:00:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:00:18.162684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:18.164285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:18.281148 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f4c8-5ef7-45d7-b333-fe8b0e40dc63 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:18.291941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:18.292576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:18.292938 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:18.293235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:18.296972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:18.420020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:18.421744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:18.433587 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4226/8417] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:00:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:00:23.921174 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=26 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:28.429050 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=51 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:28.882882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:28.884487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:28.919245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672533b6-6cf1-4f3f-a001-ee41c93083e5 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:28.927204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:28.946068 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:28.952365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:28.952365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:28.953850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:29.003659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:29.006139 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:29.024192 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4192/8418] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:00:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:00:39.016401 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:42.927449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:42.938590 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:43.025153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a274aa-9c53-4031-b5ab-cd966d6ef0d5 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:43.030846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:43.031459 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:43.031743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:43.032006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:43.035340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:43.056412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:43.062173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:43.065067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:43.093390 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4227/8419] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:00:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:00:43.157298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce405e-6cab-4fa2-80ce-7a09cbaa5987 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:43.162772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:43.167645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:43.167645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:43.167645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] PATH_INFO: `/v3/users/264018faacc64b96bf084c4a4ea99623` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:43.167645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264018faacc64b96bf084c4a4ea99623)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:43.167645 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:43.392951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264018faacc64b96bf084c4a4ea99623'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:43.393648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264018faacc64b96bf084c4a4ea99623'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:43.400640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264018faacc64b96bf084c4a4ea99623'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:43.401260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264018faacc64b96bf084c4a4ea99623'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:43.492646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264018faacc64b96bf084c4a4ea99623'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:43.514561 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4193/8420] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:00:43 2022] DELETE /identity/v3/users/264018faacc64b96bf084c4a4ea99623 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:00:43.797906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:43.809302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d209ec-2bfc-4d32-84ec-6a3c38cadebc service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:43.890176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:43.891343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:43.891728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:43.892098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] PATH_INFO: `/v3/projects/e5ce9157c6054134a5da1ff5ea5041aa` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:43.893531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ce9157c6054134a5da1ff5ea5041aa)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:43.895561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:44.008398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ce9157c6054134a5da1ff5ea5041aa', 'request_id': 'req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.068689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ce9157c6054134a5da1ff5ea5041aa', 'request_id': 'req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.076024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ce9157c6054134a5da1ff5ea5041aa', 'request_id': 'req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.087755 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] The token cache is being invalidate because project e5ce9157c6054134a5da1ff5ea5041aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:00:44.088797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.088797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.090276 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4228/8421] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:00:43 2022] DELETE /identity/v3/projects/e5ce9157c6054134a5da1ff5ea5041aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:00:44.094297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:44.095722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:44.109573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f252-10fd-4e2b-8a15-5f2377631d49 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:44.197948 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:44.198498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:44.198777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:44.199062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] PATH_INFO: `/v3/users/8444f27f53f342d6afff548d2caf79a9` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:44.200573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8444f27f53f342d6afff548d2caf79a9)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:44.202525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:44.228242 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:44.439466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8444f27f53f342d6afff548d2caf79a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.440334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8444f27f53f342d6afff548d2caf79a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.448728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8444f27f53f342d6afff548d2caf79a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.449311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8444f27f53f342d6afff548d2caf79a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.521966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b1a9d5d0-b08f-4614-915b-cb8261ef983b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8444f27f53f342d6afff548d2caf79a9'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:44.543144 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4194/8422] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:00:44 2022] DELETE /identity/v3/users/8444f27f53f342d6afff548d2caf79a9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:00:44.936492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:44.936492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:44.950807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70db1-9159-4dfc-ac12-e1f7e848e4e5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:44.971603 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:45.018726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.019352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.053116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.053116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] PATH_INFO: `/v3/projects/d34dd5457509403092ddffb5289fcbc9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.053116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34dd5457509403092ddffb5289fcbc9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.053116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:45.243964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34dd5457509403092ddffb5289fcbc9', 'request_id': 'req-623a2239-7c42-46fe-8db0-af523c18f0c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:45.338547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34dd5457509403092ddffb5289fcbc9', 'request_id': 'req-623a2239-7c42-46fe-8db0-af523c18f0c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:45.347998 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34dd5457509403092ddffb5289fcbc9', 'request_id': 'req-623a2239-7c42-46fe-8db0-af523c18f0c5'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:45.369750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] The token cache is being invalidate because project d34dd5457509403092ddffb5289fcbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:00:45.370054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:45.370781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-623a2239-7c42-46fe-8db0-af523c18f0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:00:45.372787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4229/8423] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:00:44 2022] DELETE /identity/v3/projects/d34dd5457509403092ddffb5289fcbc9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:00:45.377628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.378086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.378249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.400462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:00:45.402338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:45.478454 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4195/8424] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:00:45.485875 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.486163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.486443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.506638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:00:45.507786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:45.516087 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4230/8425] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:00:45.520746 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:45.530533 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a4e7c-42c2-441f-a61b-468ec7306611 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:45.535121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.536256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.536532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.536802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.537536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:00:45.537834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.539420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:45.551395 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4196/8426] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:00:45.555956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:45.567285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5683ee-d70f-47ad-981a-8277efbb8468 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:45.572355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.573231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.573627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.573979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.574781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.576965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:45.723199 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4231/8427] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:00:45 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:00:45.728575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:45.739185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dc22-9cdd-4e68-83d0-ea84fb3f508b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:45.799449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.800071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.800349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.800666 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.801303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.803300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:45.922682 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4197/8428] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:00:45 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:00:45.927226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:45.938639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac2cbf-e361-48b5-b2cc-6535b4763e67 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:45.943779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.944383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.944661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.944959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.945626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.947244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:45.958217 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4232/8429] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:00:45.974377 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:45.984516 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249781-8e23-4595-9dbd-3d4a0d2c8159 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:45.989285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:45.989911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:45.990201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:45.993245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:45.993245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:45.993245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8950-26ad-4299-962c-72a205111fca admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:46.003367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4198/8430] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:00:46.007964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:46.019164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36201fad-a800-4754-976b-ceec54e3cb04 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:46.026222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:46.026894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:46.027234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:46.027465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] PATH_INFO: `/v3/projects/99e1cde224c845caaa743246e60e338d/users/a0ec990e687d427d88dcf9879a1d5b0c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:46.048398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e1cde224c845caaa743246e60e338d, user_id=a0ec990e687d427d88dcf9879a1d5b0c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:46.051237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:46.123297 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4233/8431] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:00:46 2022] PUT /identity/v3/projects/99e1cde224c845caaa743246e60e338d/users/a0ec990e687d427d88dcf9879a1d5b0c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:00:46.128503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62e4c-fbb1-440d-be6f-c47768632d30 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:46.129311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62e4c-fbb1-440d-be6f-c47768632d30 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:46.129618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62e4c-fbb1-440d-be6f-c47768632d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:46.139553 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:46.160117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-34d62e4c-fbb1-440d-be6f-c47768632d30 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:00:46.162021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-34d62e4c-fbb1-440d-be6f-c47768632d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:46.231542 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4199/8432] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:00:46.237799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:46.239995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:46.301886 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:46.311582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bf2d5-8adf-43b5-b69e-928c89bdc5ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:46.321197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:46.322020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:46.322339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:46.322651 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:46.335279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:46.337001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:46.353767 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4234/8433] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:00:52.148789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:52.149292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:52.149504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:52.185599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:00:52.186800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:00:52.334140 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4200/8434] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:00:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:00:52.339214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:52.353068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa400d8-63a1-4a21-bd27-b398cfb6f444 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:52.358681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:52.359413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:52.359696 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:52.359963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:52.360591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:52.362523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:52.498984 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4235/8435] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:00:52 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:00:52.503036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:52.516659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fe579-8dff-4e0b-8e48-c0852021bbee None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:52.581399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:52.584662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:52.584662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:52.584662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:52.584662 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:52.589849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:52.731268 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4201/8436] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:00:52 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:00:52.732457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:52.743993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab69da-b1cc-4107-b92d-7e3a1a8d901b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:52.753026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:52.753897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:52.754183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:52.754453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:52.755098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:52.758927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:52.782592 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4236/8437] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:00:52.786990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:52.798427 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707791a-c9bf-4178-8e18-5fdc84e8816f admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:52.804562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:52.805236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:52.805553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:52.805833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] PATH_INFO: `/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608/users/dcc9df7a7df54db28eaea2083bfdac26/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:52.838503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=649b53bd6b754cdd85af4b1b4c3ae608, user_id=dcc9df7a7df54db28eaea2083bfdac26, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:52.841127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:52.942896 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:00:52.963731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4202/8438] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:00:52 2022] PUT /identity/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608/users/dcc9df7a7df54db28eaea2083bfdac26/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:00:52.967849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:52.980491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6f7ef-5412-4eea-97f0-88131bafd13a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:53.055834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:53.057137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:53.057670 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:53.058144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:53.059146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:53.060876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6b44d-8008-40f2-9639-91a509ccad55 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:53.076084 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4237/8439] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:00:53.077547 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:00:53.089023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb9e9-d0b3-4648-b431-3379c5e2a19b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:00:53.093686 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:00:53.094356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:00:53.094635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:00:53.094904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] PATH_INFO: `/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608/users/dcc9df7a7df54db28eaea2083bfdac26/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:00:53.096839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649b53bd6b754cdd85af4b1b4c3ae608, user_id=dcc9df7a7df54db28eaea2083bfdac26, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:00:53.100401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:00:53.125483 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4203/8440] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:00:53 2022] PUT /identity/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608/users/dcc9df7a7df54db28eaea2083bfdac26/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:01:00.400375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:00.403009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:00.405283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:00.443519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] MFA Rules not processed for user `dcc9df7a7df54db28eaea2083bfdac26`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:00.445461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:00.527518 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4238/8441] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:01:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:00.548340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:01:00.550637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:00.626958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54a9ef-d16e-439a-a4dc-3ade0c0873c0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:01:00.631323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:01:00.632010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:00.632358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:00.632696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:00.651093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:01:00.651093 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4bae-9bfd-4d1f-ac82-1cf170d4a204 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:01:00.668687 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4204/8442] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:01:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:01:00.912816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:01:00.927725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0b399-3f40-4468-af52-a09c2e500d31 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:01:00.932087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:01:00.932809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:00.933195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:00.933694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:00.973836 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:01.000648 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:01:01.002129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cbe18-2d97-4c13-ad01-c5076bc23dec service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:01:01.012589 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4239/8443] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:01:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:01:04.013764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:04.016604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:04.016604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:04.038429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:04.040305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:04.048771 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4205/8444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:08.633044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f274b-6667-4f09-826b-184d657f6a9f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:08.633537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f274b-6667-4f09-826b-184d657f6a9f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:08.633738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f274b-6667-4f09-826b-184d657f6a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:08.697506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-739f274b-6667-4f09-826b-184d657f6a9f None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:08.709628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-739f274b-6667-4f09-826b-184d657f6a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:08.820290 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4240/8445] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 02:01:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:08.841754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:01:08.853133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c2f6c-bbc2-4258-8061-d3530a14eabb None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:01:08.858972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:01:08.859876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:08.860230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:08.860566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:08.863140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:08.885181 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:01:08.887001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:01:08.904180 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4206/8446] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:01:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:01:11.556845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee6a8-9fb3-41ac-8df6-6b7b0d82e238 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:11.557311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee6a8-9fb3-41ac-8df6-6b7b0d82e238 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:11.557701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee6a8-9fb3-41ac-8df6-6b7b0d82e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:11.579842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-126ee6a8-9fb3-41ac-8df6-6b7b0d82e238 None None] MFA Rules not processed for user `685162cc09ea436baabe059b9b346ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:11.581738 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-126ee6a8-9fb3-41ac-8df6-6b7b0d82e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:11.644308 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4241/8447] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:01:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:16.420444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:01:16.422690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:16.509825 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde85d-7135-456a-a16a-640c5f97669b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:01:16.515659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:01:16.516279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:16.516579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:16.516853 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:16.519097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:16.606908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:01:16.608830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:01:16.618322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4207/8448] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:01:21.637094 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=69 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:26.614715 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:32.962123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5e7f-ce9a-4f24-9977-6e957c0b74ed None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:32.962606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5e7f-ce9a-4f24-9977-6e957c0b74ed None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:32.962721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb5e7f-ce9a-4f24-9977-6e957c0b74ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:32.993451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-63cb5e7f-ce9a-4f24-9977-6e957c0b74ed None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:32.994667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-63cb5e7f-ce9a-4f24-9977-6e957c0b74ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:33.014747 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4242/8449] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 02:01:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:33.020657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:01:33.032777 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd9e01-c971-46db-a4f5-f9ee6a1096c8 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:01:33.037562 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:01:33.038164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:33.038446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:33.038720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:33.040437 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:33.123962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:01:33.125446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:01:33.136038 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4208/8450] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:01:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:01:43.012905 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=13 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:43.131435 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=38 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:01:44.714715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:01:44.715208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:01:44.715298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:01:44.734965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:01:44.736208 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:01:44.743691 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4243/8451] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:01:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:01:54.729109 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:10.321044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:10.322464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:10.440541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484864bb-6975-4791-ae3f-f4c30d515127 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:10.446272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:10.446879 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:10.447157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:10.447424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:10.449175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:10.464127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:10.465822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac2fee-9a7c-41fe-a0df-32ff15dd40d9 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:10.478991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4209/8452] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:02:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:02:20.472007 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=51 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:21.732540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:21.734914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:21.836677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27eeb0f-4bb1-424a-9f1d-7e3468c8282b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:21.841425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:21.841989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:21.842266 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:21.842537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] PATH_INFO: `/v3/users/7348b82c87cf428dad89bc4fbb6ac1c4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:21.843705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7348b82c87cf428dad89bc4fbb6ac1c4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:21.845638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:21.979368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7348b82c87cf428dad89bc4fbb6ac1c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.062519 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7348b82c87cf428dad89bc4fbb6ac1c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.063403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7348b82c87cf428dad89bc4fbb6ac1c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.076806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7348b82c87cf428dad89bc4fbb6ac1c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.083837 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7348b82c87cf428dad89bc4fbb6ac1c4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.090310 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4244/8453] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:02:21 2022] DELETE /identity/v3/users/7348b82c87cf428dad89bc4fbb6ac1c4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:02:22.095470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:22.095929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:22.096016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:22.127723 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:02:22.129051 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:22.194574 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4210/8454] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:02:22.204861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:22.206336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:22.264378 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:22.278732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9319a5-ecd8-4388-9d75-4e117a839679 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:22.282984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:22.283638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:22.286940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:22.286940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:22.293781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:22.295211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:22.305179 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4245/8455] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:02:22.567526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:22.569089 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:22.587358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898946b-acd1-4af6-8a29-7c6e02929080 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:22.589204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:22.589951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:22.590298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:22.590663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] PATH_INFO: `/v3/projects/384d691c08fa4a48b57896d89f252526` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:22.591981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=384d691c08fa4a48b57896d89f252526)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:22.595286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:22.720342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384d691c08fa4a48b57896d89f252526', 'request_id': 'req-31ab96fb-81d2-4685-851f-574435692f9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.727054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384d691c08fa4a48b57896d89f252526', 'request_id': 'req-31ab96fb-81d2-4685-851f-574435692f9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.799265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384d691c08fa4a48b57896d89f252526', 'request_id': 'req-31ab96fb-81d2-4685-851f-574435692f9a'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.810905 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] The token cache is being invalidate because project 384d691c08fa4a48b57896d89f252526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:02:22.811193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.811890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:02:22.813586 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4211/8456] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:02:22 2022] DELETE /identity/v3/projects/384d691c08fa4a48b57896d89f252526 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:02:32.364687 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=8 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:32.807706 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:40.733893 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:40.735711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:40.825407 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed950838-979e-42fc-b4bc-1b9c35d9cc35 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:40.900029 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:40.900736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:40.901296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:40.901569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:40.903637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:40.918904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:40.920504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:40.934448 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4246/8457] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:02:50.927438 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=66 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:02:58.463943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:02:58.465515 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:58.552413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab96fb-81d2-4685-851f-574435692f9a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:02:58.557801 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:02:58.558999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:02:58.559284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:02:58.559556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:02:58.561397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:02:58.585045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:02:58.585045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:02:58.599694 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4212/8458] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:02:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:03:02.856299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:02.858022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:02.930087 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d1832-a60f-4669-85ae-fff942c0218f service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:02.934754 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:02.935377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:02.935726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:02.935997 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] PATH_INFO: `/v3/users/685162cc09ea436baabe059b9b346ef1` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:02.937159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=685162cc09ea436baabe059b9b346ef1)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:02.939145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:03.087573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685162cc09ea436baabe059b9b346ef1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:03.142179 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685162cc09ea436baabe059b9b346ef1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:03.142834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685162cc09ea436baabe059b9b346ef1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:03.156402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685162cc09ea436baabe059b9b346ef1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:03.163843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685162cc09ea436baabe059b9b346ef1'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:03.170038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4247/8459] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:03:02 2022] DELETE /identity/v3/users/685162cc09ea436baabe059b9b346ef1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:03:04.161038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:04.175441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051911f-9ef7-436d-9af4-481a51f46da7 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:04.256913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:04.257681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:04.257965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:04.258239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] PATH_INFO: `/v3/projects/815809ec42e44bce9da3c4e354b425bf` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:04.259404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=815809ec42e44bce9da3c4e354b425bf)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:04.261311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:04.359734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815809ec42e44bce9da3c4e354b425bf', 'request_id': 'req-752ee331-af56-43e1-a845-f13cfe981a68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.365575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815809ec42e44bce9da3c4e354b425bf', 'request_id': 'req-752ee331-af56-43e1-a845-f13cfe981a68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.415706 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815809ec42e44bce9da3c4e354b425bf', 'request_id': 'req-752ee331-af56-43e1-a845-f13cfe981a68'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.427839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] The token cache is being invalidate because project 815809ec42e44bce9da3c4e354b425bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:03:04.441050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.441050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.441050 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4213/8460] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:03:04 2022] DELETE /identity/v3/projects/815809ec42e44bce9da3c4e354b425bf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:03:04.441394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:04.441394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:04.449914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91e6a7-f99d-444a-8ccd-6f02d287b0ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:04.514083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:04.514722 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:04.515001 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:04.515275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] PATH_INFO: `/v3/users/30f55452aa494d76ae1c78dbb983d870` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:04.516890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f55452aa494d76ae1c78dbb983d870)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:04.519024 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:04.547737 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:04.687246 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f55452aa494d76ae1c78dbb983d870'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.821546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f55452aa494d76ae1c78dbb983d870'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.822131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f55452aa494d76ae1c78dbb983d870'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.835744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f55452aa494d76ae1c78dbb983d870'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.842855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f55452aa494d76ae1c78dbb983d870'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:04.849310 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4248/8461] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:03:04 2022] DELETE /identity/v3/users/30f55452aa494d76ae1c78dbb983d870 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:03:05.126797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:05.128289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:05.142950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ee331-af56-43e1-a845-f13cfe981a68 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:05.162124 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:05.208675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:05.209228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:05.209552 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:05.210105 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] PATH_INFO: `/v3/projects/e3da7787fe0d4195a3035bd650008c65` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:05.211321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3da7787fe0d4195a3035bd650008c65)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:05.213266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:05.337844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3da7787fe0d4195a3035bd650008c65', 'request_id': 'req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:05.343414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3da7787fe0d4195a3035bd650008c65', 'request_id': 'req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:05.409851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3da7787fe0d4195a3035bd650008c65', 'request_id': 'req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:05.422114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] The token cache is being invalidate because project e3da7787fe0d4195a3035bd650008c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:03:05.423019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:05.423664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f11daab3-dcaa-41ec-8a6d-7a22e7b6d4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:03:05.425148 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4214/8462] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:03:05 2022] DELETE /identity/v3/projects/e3da7787fe0d4195a3035bd650008c65 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:03:05.950155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:05.953417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:06.052398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315624b-9a81-4494-9f81-f948b524dbab admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:06.113640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:06.114294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:06.114605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:06.114846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:06.116582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:06.130527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:06.132125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:06.145020 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4249/8463] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:03:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:03:15.418850 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:16.137738 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=78,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:17.303579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfe94-cf3e-4913-9ca2-f61f15a435ac None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:17.304072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfe94-cf3e-4913-9ca2-f61f15a435ac None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:17.304164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfe94-cf3e-4913-9ca2-f61f15a435ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:17.325947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3f4cfe94-cf3e-4913-9ca2-f61f15a435ac None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:03:17.327154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3f4cfe94-cf3e-4913-9ca2-f61f15a435ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:17.381485 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4215/8464] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:03:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:03:17.669512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:17.671026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:17.726044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239ebe-b676-461a-a88f-e676fcf275c9 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:17.729474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:17.730064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:17.730339 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:17.730608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:17.732300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:17.744332 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:17.745763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:17.756576 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4250/8465] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:03:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:03:18.152059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:18.155772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:18.155772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:18.204994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:03:18.206256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:18.215271 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4216/8466] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:03:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:03:18.228262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:18.229749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:18.247779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26526613-05f1-4655-8f6c-372b1c82eb6c service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:18.252653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:18.253282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:18.253594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:18.253863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:18.262405 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:18.263976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:18.273435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4251/8467] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:03:28.202586 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=38 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:28.269486 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=32 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:03:49.901123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:03:49.910829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb29d0-119d-4eac-b57b-0abca8547d0d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:03:49.914722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a410860-5706-408c-b919-8268e220568c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:03:49.915401 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410860-5706-408c-b919-8268e220568c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:03:49.915751 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410860-5706-408c-b919-8268e220568c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:03:49.916094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410860-5706-408c-b919-8268e220568c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:03:49.917884 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7a410860-5706-408c-b919-8268e220568c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:03:50.011154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410860-5706-408c-b919-8268e220568c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:03:50.012579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a410860-5706-408c-b919-8268e220568c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:03:50.026621 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4217/8468] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:03:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:04:00.019179 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=42 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:02.579207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:04:02.580640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:04:02.599422 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb60bb4-0f8a-47ec-b35c-1672ac4e6132 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:04:02.605205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:04:02.605927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:04:02.606219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:04:02.606486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:04:02.608294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:04:02.623402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:04:02.625172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b97246-02af-4ac8-93cf-5dc662ea1f9c service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:04:02.638038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4252/8469] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:04:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:04:12.631061 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:41.701771 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:04:41.702303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:04:41.702303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:04:41.721640 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:04:41.722823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:04:41.730127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4218/8470] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:04:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:04:42.627659 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0eed-4eb2-425c-87cc-1bd43a7ed147 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:04:42.628129 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0eed-4eb2-425c-87cc-1bd43a7ed147 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:04:42.628424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0eed-4eb2-425c-87cc-1bd43a7ed147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:04:42.649640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2e2c0eed-4eb2-425c-87cc-1bd43a7ed147 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:04:42.650932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2e2c0eed-4eb2-425c-87cc-1bd43a7ed147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:04:42.659578 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4253/8471] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:04:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:04:42.671523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:04:42.686558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59bac-456a-46d9-9723-389d484516f6 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:04:42.691442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:04:42.692037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:04:42.692310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:04:42.692579 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:04:42.700729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:04:42.702296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b6e9e-8dc1-4d8d-90b7-06682a9f4df8 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:04:42.712025 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4219/8472] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:04:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:04:52.643605 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:04:52.707955 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:04.057983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:05:04.058521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:05:04.058629 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:05:04.109887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:05:04.111091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:05:04.177418 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4254/8473] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:05:04.331419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aedab-3cb3-4d57-b3a1-f43e61b2c3ad None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:05:04.332024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aedab-3cb3-4d57-b3a1-f43e61b2c3ad None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:05:04.332024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aedab-3cb3-4d57-b3a1-f43e61b2c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:05:04.374599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5e4aedab-3cb3-4d57-b3a1-f43e61b2c3ad None None] MFA Rules not processed for user `88425fb345824272be839024c9316741`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:05:04.376086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e4aedab-3cb3-4d57-b3a1-f43e61b2c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:05:04.445747 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4220/8474] 10.222.0.13 () {58 vars in 1040 bytes} [Sun Oct 30 02:05:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:05:04.454594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:05:04.464615 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13ebe-986c-489c-a01b-447a2e0b9026 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:05:04.469646 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:05:04.470343 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:05:04.470688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:05:04.471031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:05:04.480155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:05:04.483300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:05:04.491024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4255/8475] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:05:06.025581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:05:06.026172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:05:06.026172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:05:06.046430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:05:06.047614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:05:06.054892 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4221/8476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:05:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:05:09.408763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:05:09.418505 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dcd7c-a00a-4ce2-8a36-733f60be013f service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:05:09.422462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:05:09.423214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:05:09.423556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:05:09.423914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:05:09.425748 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:05:09.439675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:05:09.441234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:05:09.453788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4256/8477] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:05:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:05:16.041541 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=38 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:05:19.446883 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=52 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:01.682608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:06:01.698890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31342a1-b57c-4151-b4ed-952ca2cee161 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:06:01.704449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:06:01.705070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:01.705359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:01.705644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:01.707756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:06:01.718466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:06:01.720049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:06:01.728929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4222/8478] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:06:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:06:02.840678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:06:02.857935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4e51-ca53-4ae1-af26-2b887b0e8a39 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:06:02.863762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:06:02.864620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:02.864906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:02.865174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:02.867026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:06:02.883991 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:06:02.885965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1cc38-c223-4587-a332-a75c0d6d4fe0 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:06:02.907426 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4257/8479] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:06:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:06:10.185174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:06:10.194496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4d03-e440-402a-9bbe-99ccf0900b5e service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:06:10.198057 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:06:10.198654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:10.198931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:10.199224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:10.200902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:06:10.214173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:06:10.215589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:06:10.226652 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4223/8480] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:06:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:06:12.895872 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:20.220006 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=12 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:23.541050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b89c-203c-42fd-9bdd-bdd3f15c91f3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:23.541572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b89c-203c-42fd-9bdd-bdd3f15c91f3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:23.541680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b89c-203c-42fd-9bdd-bdd3f15c91f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:23.562394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3d77b89c-203c-42fd-9bdd-bdd3f15c91f3 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:06:23.563581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3d77b89c-203c-42fd-9bdd-bdd3f15c91f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:06:23.571195 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4258/8481] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:06:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:06:23.714588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:06:23.737882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070da87b-4727-4eed-b104-15e43b7fba46 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:06:23.743354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:06:23.743966 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:23.744242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:23.744521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:23.752969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:06:23.754647 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:06:23.763403 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4224/8482] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:06:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 02:06:33.557165 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:33.760140 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=10 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:06:47.349608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:06:47.350132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:06:47.350244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:06:47.370834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:06:47.372005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:06:47.378705 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4259/8483] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:06:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:06:57.364996 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:07:09.893414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:07:09.894993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:07:09.906786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c85b10-3193-4dfc-9e41-63d8f234a282 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:07:09.910566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:07:09.911168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:07:09.911444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:07:09.911713 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:07:09.913534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:07:09.975983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:07:09.977438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:07:09.987534 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4225/8484] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:07:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:07:14.310265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:07:14.311680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:07:14.329501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81328c6-e8de-40b8-9185-dce703ceb5f4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:07:14.334469 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:07:14.335068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:07:14.335349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:07:14.335620 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:07:14.337293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:07:14.350930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:07:14.352497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:07:14.365149 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4260/8485] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:07:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:07:19.983202 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=30 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:07:24.358672 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:08:08.469480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:08:08.484779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7911-0acf-42de-9e72-92172cf56e66 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:08:08.489990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:08:08.490595 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:08:08.490880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:08:08.491143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:08:08.502334 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:08:08.503894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94a63c-8f5b-4148-b88d-260e88f9241d service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:08:08.516825 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4226/8486] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:08:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:08:18.509624 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:37.255757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:09:37.265035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62444a0-ba59-45b0-99d3-c8716b049092 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:09:37.268689 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:09:37.269275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:37.269610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:37.270267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:37.283872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:09:37.285295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:09:37.299327 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4261/8487] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:09:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:09:44.517989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22b1c-9695-4978-a7e0-d0ad7ed7e6e1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:44.518568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22b1c-9695-4978-a7e0-d0ad7ed7e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:44.518568 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee22b1c-9695-4978-a7e0-d0ad7ed7e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:44.538596 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4ee22b1c-9695-4978-a7e0-d0ad7ed7e6e1 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:09:44.539774 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4ee22b1c-9695-4978-a7e0-d0ad7ed7e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:09:44.549003 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4227/8488] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 30 02:09:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:09:44.561614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:09:44.575236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322bee3-2efe-4f06-87c3-c0d70de8b119 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:09:44.580466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:09:44.581046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:44.581322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:44.581614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:44.589907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:09:44.591467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:09:44.601676 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4262/8489] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:09:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:09:45.238180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808fe90-3596-4b8d-aa11-8922bba6962b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:45.238180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808fe90-3596-4b8d-aa11-8922bba6962b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:45.238180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808fe90-3596-4b8d-aa11-8922bba6962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:45.253680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-3808fe90-3596-4b8d-aa11-8922bba6962b None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:09:45.256184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3808fe90-3596-4b8d-aa11-8922bba6962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:09:45.261775 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4228/8490] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:09:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:09:45.818863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:09:45.828593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07010dd-5560-4dd3-96dc-9b8907a510f9 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:09:45.832381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:09:45.832972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:45.833255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:45.833557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:45.843385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:09:45.844789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:09:45.855118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4263/8491] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:09:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:09:47.575278 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881cfb-95b5-411d-b2fc-94886901771e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:47.576024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881cfb-95b5-411d-b2fc-94886901771e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:47.576230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9881cfb-95b5-411d-b2fc-94886901771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:47.596564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e9881cfb-95b5-411d-b2fc-94886901771e None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:09:47.597892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9881cfb-95b5-411d-b2fc-94886901771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:09:47.606513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4229/8492] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 02:09:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:09:47.613362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:09:47.625325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a92e8-a342-418f-a5b0-ad32ed76f2bc service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:09:47.630481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:09:47.631224 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:47.631571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:47.631830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:47.640566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:09:47.646102 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:09:47.651957 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4264/8493] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:09:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:09:48.744863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:48.745270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:48.745270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:48.765510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:09:48.766750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:09:48.775392 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4230/8494] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Oct 30 02:09:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:09:48.787807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:09:48.801096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2509-d606-499f-ba97-d566c393c3cb service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:09:48.806074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:09:48.806674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:09:48.806935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:09:48.807203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:09:48.815905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:09:48.817482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:09:48.827101 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4265/8495] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:09:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:09:58.759796 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=12 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:09:58.822836 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=30 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:10:06.500402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:10:06.515127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b5f63-8c07-4b67-ac1a-8c5ae2b04dc5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:10:06.521175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:10:06.521812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:10:06.522094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:10:06.522367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:10:06.534229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:10:06.535798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea60a3c-abcf-45d0-84a6-3aa6de3a4bb5 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:10:06.548643 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4231/8496] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:10:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:10:16.541938 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:11:13.953089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:11:13.962300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3fbb4-0938-46cd-bfb2-6c6441f5903c service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:11:13.965944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:11:13.966533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:11:13.966810 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:11:13.967081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:11:13.976935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:11:13.978388 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:11:13.989737 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4266/8497] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:11:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:11:23.982831 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:10.534370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026c7c-d22a-4322-8cd7-50854948518d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:10.534370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026c7c-d22a-4322-8cd7-50854948518d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:10.534893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3026c7c-d22a-4322-8cd7-50854948518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:10.604190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d3026c7c-d22a-4322-8cd7-50854948518d None None] MFA Rules not processed for user `135b054aaaae4c84b280fe4e9908e240`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:10.605419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3026c7c-d22a-4322-8cd7-50854948518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:10.686459 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4232/8498] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 30 02:12:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:10.692435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:10.711564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90750d-1b05-4e8f-beae-701d0051226e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:10.715060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:10.715669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:10.715946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:10.716218 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:10.738831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:10.740249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:10.766413 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4267/8499] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:13.912255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a486da-5f14-4ae4-9588-41ee15392b46 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:13.912724 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a486da-5f14-4ae4-9588-41ee15392b46 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:13.912845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a486da-5f14-4ae4-9588-41ee15392b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:13.951680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-43a486da-5f14-4ae4-9588-41ee15392b46 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:13.952878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-43a486da-5f14-4ae4-9588-41ee15392b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:13.977022 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4233/8500] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Oct 30 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:13.990106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:13.999591 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fe910-b847-4e33-bb06-334b16c48f78 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:14.003818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:14.004490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:14.004835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:14.005172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:14.012528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:14.013989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ee5a-4877-40f1-90d5-1aff09adeaeb service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:14.022055 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4268/8501] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:23.965775 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=68 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:24.018545 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=30 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:41.289385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4e7c-82eb-4cb6-b119-1cc818a240db None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.289894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4e7c-82eb-4cb6-b119-1cc818a240db None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.289999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef4e7c-82eb-4cb6-b119-1cc818a240db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.331121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bfef4e7c-82eb-4cb6-b119-1cc818a240db None None] MFA Rules not processed for user `a0ec990e687d427d88dcf9879a1d5b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:41.332317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bfef4e7c-82eb-4cb6-b119-1cc818a240db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:41.339235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4234/8502] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:41.379092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.379653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.379653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.417764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:41.419156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:41.445762 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4269/8503] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:41.451578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515ba2-d282-4764-9e3c-ec3427f7e6fc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.451860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515ba2-d282-4764-9e3c-ec3427f7e6fc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.452136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515ba2-d282-4764-9e3c-ec3427f7e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.471779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-89515ba2-d282-4764-9e3c-ec3427f7e6fc None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:41.472969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-89515ba2-d282-4764-9e3c-ec3427f7e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:41.482901 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4235/8504] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:12:41.496097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:41.505358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76297e85-e7f5-4cf4-bf19-face070e7686 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:41.508917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:41.509537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.509891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.510157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.520089 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:41.521527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:41.532044 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4270/8505] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:41.819882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632bdf5-996a-4134-8579-334d02713911 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.824131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632bdf5-996a-4134-8579-334d02713911 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.824131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632bdf5-996a-4134-8579-334d02713911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.852476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e632bdf5-996a-4134-8579-334d02713911 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:41.853690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e632bdf5-996a-4134-8579-334d02713911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:41.860631 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4236/8506] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:41.872040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:41.881572 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11c32-8ffd-4aad-8ff6-68b1cfbbccb1 service cinder] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:41.885404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:41.886000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:41.886274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:41.886537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:41.893797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:41.895202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:41.903533 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4271/8507] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:42.678441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e77a-060f-47b1-97e9-bc4f55712952 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:42.679739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e77a-060f-47b1-97e9-bc4f55712952 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:42.679739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268e77a-060f-47b1-97e9-bc4f55712952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:42.712550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b268e77a-060f-47b1-97e9-bc4f55712952 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:42.713788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b268e77a-060f-47b1-97e9-bc4f55712952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:42.732659 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4237/8508] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 02:12:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:42.739022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:42.751483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594d2db-e00a-4b3e-9607-64706a402cc0 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:42.756476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:42.757181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:42.757497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:42.757767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:42.766671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:42.768244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:42.777866 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4272/8509] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:45.899055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7532a6-7d73-4491-9a07-9bfd0fbef641 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:45.899458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7532a6-7d73-4491-9a07-9bfd0fbef641 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:45.899602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7532a6-7d73-4491-9a07-9bfd0fbef641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:45.922389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7f7532a6-7d73-4491-9a07-9bfd0fbef641 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:45.923608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f7532a6-7d73-4491-9a07-9bfd0fbef641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:45.930563 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4238/8510] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 30 02:12:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:12:45.942091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:45.952139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679604a-2102-4f63-8bdb-261cae653078 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:45.955830 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:45.956427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:45.956700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:45.956964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:45.965048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:45.967230 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:45.977873 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4273/8511] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:46.925716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355fc0-c56c-4b1a-97e5-0697672c7d88 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:46.926214 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355fc0-c56c-4b1a-97e5-0697672c7d88 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:46.926296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355fc0-c56c-4b1a-97e5-0697672c7d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:46.949530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-ec355fc0-c56c-4b1a-97e5-0697672c7d88 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:12:46.951009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ec355fc0-c56c-4b1a-97e5-0697672c7d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:12:46.961071 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4239/8512] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:12:46.976814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:12:46.991987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec15a6-f25b-42bb-a14c-10bce84eb6a2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:12:46.997569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:12:46.998161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:12:46.998456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:12:46.998728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:12:47.007759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:12:47.009320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:12:47.020282 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4274/8513] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:12:56.943256 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=40 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:12:57.016073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=46 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:13:01.643223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:13:01.643734 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:13:01.643851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:13:01.663961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:13:01.665207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:13:01.674976 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4240/8514] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:13:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:13:01.687394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:13:01.698933 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64ca4-2bc3-418d-8219-3f348bbe26d4 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:13:01.704557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:13:01.705145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:13:01.705465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:13:01.705739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:13:01.714640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:13:01.716283 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:13:01.726483 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4275/8515] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:13:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:13:03.822638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:13:03.832462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ebd39-5674-4205-9b25-d7480bbc0851 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:13:03.836130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:13:03.836729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:13:03.837006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:13:03.837280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:13:03.846946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:13:03.848367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:13:03.876234 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4241/8516] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:13:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:13:11.722251 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:13:13.873370 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=16 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:14.461235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:14.527576 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997aab-0161-40b3-9b62-6dc38dcb4ddb service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:14.532558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:14.533156 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:14.533462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:14.533731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:14.542698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:14.550971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593cfd4-a448-4fb4-b9b8-f8436cc12b1b service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:14.554728 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4276/8517] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:15:16.698189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:16.709297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30af0-b96e-4181-a600-c71138c55713 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:16.715104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:16.715749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:16.716028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:16.716305 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:16.724564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:16.726366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:16.735973 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4242/8518] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:15:24.549849 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=32 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:25.774305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:25.775845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:25.776279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:25.819272 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:25.820490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:25.898348 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4277/8519] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:15:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:25.910286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:25.922483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45a90-11e3-42c0-9764-91f730dbf1e6 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:25.927912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:25.929038 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:25.929382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:25.929664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:25.938414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:25.939998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeff02-8884-4aa7-a081-c160fe91e02d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:25.951426 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4243/8520] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:15:35.597229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:35.651634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647db465-ef03-4e64-8e66-abd05c879d46 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:35.655206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:35.655806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:35.656088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:35.656356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:35.658150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:35.756909 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:35.756909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:35.756909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:35.776506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4278/8521] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:15:35.947144 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=12 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:39.352877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:39.353511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:39.353511 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:39.394952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:39.396221 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:39.404996 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4244/8522] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:15:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:39.416694 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:39.428888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efda54e-161c-4e45-ab48-16be1f3589a3 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:39.434088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a365-717b-4141-b205-9683cf19465d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:39.434692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a365-717b-4141-b205-9683cf19465d service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:39.435164 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a365-717b-4141-b205-9683cf19465d service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:39.435278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a365-717b-4141-b205-9683cf19465d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:39.444085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a365-717b-4141-b205-9683cf19465d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:39.445891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a365-717b-4141-b205-9683cf19465d service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:39.455616 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4279/8523] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:15:42.920201 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:42.921950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:42.939064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c02b-0c45-4d0d-b9a2-6ba7c66c9012 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:42.944353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:42.945143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:42.945601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:42.945965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] PATH_INFO: `/v3/users/a0ec990e687d427d88dcf9879a1d5b0c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:42.947465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ec990e687d427d88dcf9879a1d5b0c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:42.949813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:43.171325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ec990e687d427d88dcf9879a1d5b0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.171981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ec990e687d427d88dcf9879a1d5b0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.184665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ec990e687d427d88dcf9879a1d5b0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.185507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ec990e687d427d88dcf9879a1d5b0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.276342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ec990e687d427d88dcf9879a1d5b0c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.295136 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4245/8524] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:15:42 2022] DELETE /identity/v3/users/a0ec990e687d427d88dcf9879a1d5b0c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:15:43.557729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a365-717b-4141-b205-9683cf19465d service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:43.569497 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a365-717b-4141-b205-9683cf19465d service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:43.636632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:43.637282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:43.637585 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:43.637854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] PATH_INFO: `/v3/projects/99e1cde224c845caaa743246e60e338d` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:43.638964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e1cde224c845caaa743246e60e338d)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:43.641530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:43.785409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e1cde224c845caaa743246e60e338d', 'request_id': 'req-595f3b8d-90de-421c-a312-17d887ff48e0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.841570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e1cde224c845caaa743246e60e338d', 'request_id': 'req-595f3b8d-90de-421c-a312-17d887ff48e0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.848140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e1cde224c845caaa743246e60e338d', 'request_id': 'req-595f3b8d-90de-421c-a312-17d887ff48e0'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.858772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] The token cache is being invalidate because project 99e1cde224c845caaa743246e60e338d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:15:43.859054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.859690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:43.861175 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4280/8525] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:15:43 2022] DELETE /identity/v3/projects/99e1cde224c845caaa743246e60e338d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:15:43.865114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:43.866505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:43.879478 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20c86-3ac6-4fad-a222-26b3743947d6 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:43.936889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:43.937540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:43.937816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:43.938091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] PATH_INFO: `/v3/users/dcc9df7a7df54db28eaea2083bfdac26` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:43.951560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc9df7a7df54db28eaea2083bfdac26)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:43.953505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:44.098711 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:44.101841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc9df7a7df54db28eaea2083bfdac26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.102493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc9df7a7df54db28eaea2083bfdac26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.109588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc9df7a7df54db28eaea2083bfdac26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.110217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc9df7a7df54db28eaea2083bfdac26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.173050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-dd6123a4-beb9-40a1-9d0e-bb658b3ab3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc9df7a7df54db28eaea2083bfdac26'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.191994 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4246/8526] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:15:43 2022] DELETE /identity/v3/users/dcc9df7a7df54db28eaea2083bfdac26 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:15:44.421012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:44.422527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:44.435739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f3b8d-90de-421c-a312-17d887ff48e0 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:44.493979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:44.494609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:44.494887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:44.495159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] PATH_INFO: `/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:44.496265 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=649b53bd6b754cdd85af4b1b4c3ae608)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:44.498226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:44.504373 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:44.591470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649b53bd6b754cdd85af4b1b4c3ae608', 'request_id': 'req-949e568c-648d-4510-b9e1-6f617ff87e7b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.669744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649b53bd6b754cdd85af4b1b4c3ae608', 'request_id': 'req-949e568c-648d-4510-b9e1-6f617ff87e7b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.676416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649b53bd6b754cdd85af4b1b4c3ae608', 'request_id': 'req-949e568c-648d-4510-b9e1-6f617ff87e7b'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.687458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] The token cache is being invalidate because project 649b53bd6b754cdd85af4b1b4c3ae608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:15:44.687745 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.688404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-949e568c-648d-4510-b9e1-6f617ff87e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:15:44.689929 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4281/8527] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:15:44 2022] DELETE /identity/v3/projects/649b53bd6b754cdd85af4b1b4c3ae608 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:15:54.230652 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:54.610031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:54.610249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:54.610503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:54.657321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:54.658545 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:54.684300 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:54.719297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4247/8528] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:54.730778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:54.732884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:54.732884 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:54.751204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:54.752403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:54.760779 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4282/8529] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:54.765556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:54.775873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcd607-83e1-4891-994f-0d80f16aba82 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:54.780381 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:54.780969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:54.781245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:54.781544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:54.782176 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:15:54.782498 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:54.784085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:54.795326 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4248/8530] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:15:54.803571 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:54.812575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4256d8-077b-4e59-a8b5-6cb719d07b18 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:54.817417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:54.818006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:54.818285 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:54.819047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:54.819717 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:54.821634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:54.917720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4283/8531] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:15:54 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:15:54.921945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:54.931973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596c065-3013-4d78-8c52-c0e2816f08d3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:54.987680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:54.988277 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:54.988549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:54.988817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:54.989468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:54.991355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.064494 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4249/8532] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:15:54 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:15:55.068870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.079850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0fa36-5b0d-4e51-b2e4-a7798b5720e2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.084551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.085177 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.086120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.086411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.087031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.088604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.098489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4284/8533] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:15:55.102629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.112691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3868a7-8493-4b4f-ae75-1221c9ad5dbd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.118114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.121145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.121145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.121145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.121145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.121572 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b60b4-10c4-42c0-8b22-6962ae828ee8 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.132644 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4250/8534] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:15:55.136682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.146612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3775-70d3-471e-9b3a-830620d90880 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.151153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.151793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.152072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.152344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] PATH_INFO: `/v3/projects/49f019b35dd8401eb575d5cde596857f/users/0512b272391943fd80ee839e49e88834/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.167122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f019b35dd8401eb575d5cde596857f, user_id=0512b272391943fd80ee839e49e88834, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.169787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.247883 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4285/8535] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:15:55 2022] PUT /identity/v3/projects/49f019b35dd8401eb575d5cde596857f/users/0512b272391943fd80ee839e49e88834/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:15:55.259906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.260419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.260541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.288160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] MFA Rules not processed for user `0512b272391943fd80ee839e49e88834`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:55.289442 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:55.322029 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:55.353634 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4251/8536] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:15:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:55.364383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.424778 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48e547-a48d-4b59-a06a-309465313db6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.429863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.430454 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.430733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.430999 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.431621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.433523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.515766 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4286/8537] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:15:55 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:15:55.519852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.530622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b962cbb-d557-4fbd-bd93-a66666d3969a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.586862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.587451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.587757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.588029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.588642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.590599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.675745 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4252/8538] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:15:55 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:15:55.680234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.690480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f29d3-b2cb-4e0d-83e2-4110041fc399 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.695480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.696071 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.696354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.696623 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.697255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.698877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.709776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4287/8539] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:15:55.713874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.723904 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df62d-4167-46e0-9e26-c5436298e5aa admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.729018 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.729691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.729973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.730242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] PATH_INFO: `/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f/users/851873e133da4c18b468c4e9e6412033/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.745591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a53f6832f6c4f7db11a0ba1c3992a7f, user_id=851873e133da4c18b468c4e9e6412033, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.748323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.818220 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4253/8540] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:15:55 2022] PUT /identity/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f/users/851873e133da4c18b468c4e9e6412033/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:15:55.822119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.832047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61057e-1327-4566-a731-19521a44d89f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.888161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.888764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.889043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.889363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.890011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.891618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5506f0-11c1-4f38-9492-e30e3e03b8e3 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.894073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:55.902837 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4288/8541] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:15:55.907012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:55.917896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db054-682f-4863-8f5e-92f9aa37bc92 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:55.922664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:55.923310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.923587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.923857 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] PATH_INFO: `/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f/users/851873e133da4c18b468c4e9e6412033/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.925889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a53f6832f6c4f7db11a0ba1c3992a7f, user_id=851873e133da4c18b468c4e9e6412033, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:55.928456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1e8b9-d0fd-4deb-a601-ebd1d1464991 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:55.938449 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4254/8542] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:15:55 2022] PUT /identity/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f/users/851873e133da4c18b468c4e9e6412033/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:15:55.948596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:55.948883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:55.949155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:55.977783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] MFA Rules not processed for user `851873e133da4c18b468c4e9e6412033`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:55.978979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:56.045667 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4289/8543] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:15:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:56.058719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:56.059005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:56.059284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:56.078470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] MFA Rules not processed for user `0512b272391943fd80ee839e49e88834`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:15:56.079657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:56.133109 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4255/8544] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:15:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:15:56.148189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:56.149685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:56.223968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068094f6-be0b-43a3-a44c-c877b3c20de9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:56.230432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:56.231020 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:56.231294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:56.231558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:56.239311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:56.240885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:56.250213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4290/8545] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:15:57.052371 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:15:57.053876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:57.089760 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:15:57.124841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7344c35-2c68-45ba-a471-0f52ca87cf53 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:15:57.129814 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:15:57.130416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:15:57.130697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:15:57.130971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:15:57.133208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:15:57.144831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:15:57.146420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b14d17-53e6-4eb6-a053-9b8d0d28806a service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:15:57.156781 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4256/8546] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:15:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:06.245838 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=69 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:07.152725 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=18 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:08.909151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:08.920816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481833ab-6228-4588-b0ff-83660a37d294 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:08.926237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:08.926849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:08.927124 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:08.927393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:08.935341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:08.936930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:08.946838 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4291/8547] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:08.962080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f470e-0aab-4e1d-981c-fb3cbc51cbe0 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:08.962614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f470e-0aab-4e1d-981c-fb3cbc51cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:08.962798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f470e-0aab-4e1d-981c-fb3cbc51cbe0 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:08.963995 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4257/8548] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 02:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 02:16:08.968425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 02:16:08.979878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:08.988289 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f829998-37c9-40df-9bff-3bd442d39978 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:08.992790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851873e133da4c18b468c4e9e6412033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:08.993424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:08.993706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:08.993980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] PATH_INFO: `/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:08.995100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a53f6832f6c4f7db11a0ba1c3992a7f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:08.996848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:08.998462 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4292/8549] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 02:16:08 2022] GET /identity/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f => generated 389 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:16:09.391233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b1ee-461e-46ec-bd64-15466ca4dfb5 None None] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:09.391521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b1ee-461e-46ec-bd64-15466ca4dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:09.391796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81b1ee-461e-46ec-bd64-15466ca4dfb5 None None] PATH_INFO: `/` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:09.393134 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4258/8550] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 30 02:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 30 02:16:09.397684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Authenticating service token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 30 02:16:09.410037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:09.418594 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ceb2-cfd0-4f28-b2d6-0b29ef534cf8 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:09.423039 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '851873e133da4c18b468c4e9e6412033', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:09.423641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:09.423923 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:09.424193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] PATH_INFO: `/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:09.425274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a53f6832f6c4f7db11a0ba1c3992a7f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:09.427067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c842188-ece3-49bb-93bc-01538e7ffb06 tempest-ServersAdminNegativeTestJSON-98777390 tempest-ServersAdminNegativeTestJSON-98777390-project-admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:09.429118 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4293/8551] 10.222.0.13 () {58 vars in 1443 bytes} [Sun Oct 30 02:16:09 2022] GET /identity/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f => generated 389 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:16:13.549316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b1ee-461e-46ec-bd64-15466ca4dfb5 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:13.614676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81b1ee-461e-46ec-bd64-15466ca4dfb5 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:13.619762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:13.620380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:13.620659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:13.620932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] PATH_INFO: `/v3/users/0512b272391943fd80ee839e49e88834` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:13.622064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0512b272391943fd80ee839e49e88834)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:13.623967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:13.792270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0512b272391943fd80ee839e49e88834'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:13.792867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0512b272391943fd80ee839e49e88834'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:13.799996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0512b272391943fd80ee839e49e88834'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:13.800639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0512b272391943fd80ee839e49e88834'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:13.857871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0512b272391943fd80ee839e49e88834'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:13.875388 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4259/8552] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:16:13 2022] DELETE /identity/v3/users/0512b272391943fd80ee839e49e88834 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:16:13.880005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:13.880542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:13.881128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:13.900864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:13.902099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:13.959008 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4294/8553] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:16:13.969282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:13.970819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:14.027872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16713a88-d1c4-47e5-ba3e-fbc9dc157b18 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:14.031571 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:14.032168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:14.032444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:14.032711 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:14.042193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:14.043648 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:14.052905 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4260/8554] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:16:14.283030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:14.284618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:14.296786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16a527-4d59-42d7-9c65-4c88020be561 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:14.301400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:14.302030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:14.302309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:14.302588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] PATH_INFO: `/v3/projects/49f019b35dd8401eb575d5cde596857f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:14.303690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f019b35dd8401eb575d5cde596857f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:14.305795 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:14.415095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f019b35dd8401eb575d5cde596857f', 'request_id': 'req-ba66002a-7ba9-4dca-8440-b2739a524302'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.497787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f019b35dd8401eb575d5cde596857f', 'request_id': 'req-ba66002a-7ba9-4dca-8440-b2739a524302'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.504501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f019b35dd8401eb575d5cde596857f', 'request_id': 'req-ba66002a-7ba9-4dca-8440-b2739a524302'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.515654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] The token cache is being invalidate because project 49f019b35dd8401eb575d5cde596857f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:16:14.515936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.516551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.518062 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4295/8555] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:16:14 2022] DELETE /identity/v3/projects/49f019b35dd8401eb575d5cde596857f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:16:14.522027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:14.532599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3807cfc-3876-42f1-846c-2dda76055b1f service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:14.551187 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:14.589195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:14.589847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:14.590122 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:14.590393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] PATH_INFO: `/v3/users/851873e133da4c18b468c4e9e6412033` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:14.591493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851873e133da4c18b468c4e9e6412033)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:14.593432 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:14.751635 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851873e133da4c18b468c4e9e6412033'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.752440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851873e133da4c18b468c4e9e6412033'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.759989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851873e133da4c18b468c4e9e6412033'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.760624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851873e133da4c18b468c4e9e6412033'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.811468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-28294015-89bc-452b-94ec-13883a86cae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851873e133da4c18b468c4e9e6412033'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:14.831220 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4261/8556] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:16:14 2022] DELETE /identity/v3/users/851873e133da4c18b468c4e9e6412033 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:16:15.219403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.220864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:15.236294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66002a-7ba9-4dca-8440-b2739a524302 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.287143 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:15.295528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.296151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.296429 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.296700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] PATH_INFO: `/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.297903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a53f6832f6c4f7db11a0ba1c3992a7f)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.299782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.395234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'request_id': 'req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:15.458105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'request_id': 'req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:15.465016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a53f6832f6c4f7db11a0ba1c3992a7f', 'request_id': 'req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:15.475632 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] The token cache is being invalidate because project 8a53f6832f6c4f7db11a0ba1c3992a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:16:15.475913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:15.477060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9cdb54a6-cbb9-48e3-bd95-401fd1b61212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:16:15.478563 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4296/8557] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:16:15 2022] DELETE /identity/v3/projects/8a53f6832f6c4f7db11a0ba1c3992a7f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:16:15.484360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.484649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.484925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.504228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:15.505483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:15.563388 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4262/8558] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:15.571746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.572094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.572371 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.592357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:15.593593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:15.603488 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4297/8559] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:15.607680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.617416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ece71-0c62-48c0-b93f-2f9fabafd322 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.621993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.622588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.622872 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.623143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.623785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:16:15.624086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.625704 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.636993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4263/8560] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:16:15.640980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.650864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e4c26-9a8f-4cf8-b209-8eb221809cf9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.655500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.656088 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.656369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.656642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.657279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.659197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.739302 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4298/8561] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:16:15 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:16:15.743535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.754119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3709f4-5a9b-406b-8226-af24f36ef0a1 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.781470 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:15.811402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.812022 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.812302 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.812598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.813213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.815397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.887657 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4264/8562] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:16:15 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:16:15.891498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.903009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f92f7-e09d-47c5-bb44-8356332289d9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.907595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.908181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.908489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.908758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.909421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.911065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.920916 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4299/8563] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 30 02:16:15.925070 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.935141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bbc4-b2cb-4369-9dc4-a7d86abd5186 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.939763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.940609 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.940881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.941151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.941811 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.943403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa2e3-9509-4522-b9c0-442ec5e36fae admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:15.954400 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4265/8564] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:16:15.958474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:15.969086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd08cb-8d1a-42ac-a0cf-9596824cca81 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:15.973674 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:15.974308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:15.974587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:15.974859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] PATH_INFO: `/v3/projects/52cb154d20324ed9815f877d58472dc3/users/9885dc064e3c46f6a7f9c19659ae96b3/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:15.989255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cb154d20324ed9815f877d58472dc3, user_id=9885dc064e3c46f6a7f9c19659ae96b3, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:15.991914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:16.098455 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4300/8565] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:16:15 2022] PUT /identity/v3/projects/52cb154d20324ed9815f877d58472dc3/users/9885dc064e3c46f6a7f9c19659ae96b3/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:16:16.103907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f10f6-9aa6-4091-a2aa-e083033ddee7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:16.104200 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f10f6-9aa6-4091-a2aa-e083033ddee7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:16.104480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f10f6-9aa6-4091-a2aa-e083033ddee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:16.123885 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-5d8f10f6-9aa6-4091-a2aa-e083033ddee7 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:16.125080 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5d8f10f6-9aa6-4091-a2aa-e083033ddee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:16.182888 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4266/8566] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:16.192860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:16.194563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:16.250918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3000e-f81a-4e0f-a0a5-6acd63447b07 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:16.254606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:16.255203 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:16.255482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:16.255753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:16.265396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:16.266818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0b923-eb2b-4c81-a7a0-0709607fb84a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:16.276492 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4301/8567] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:16:21.847792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:21.848367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:21.848367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:21.878714 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] MFA Rules not processed for user `9885dc064e3c46f6a7f9c19659ae96b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:21.879923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:21.946743 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4267/8568] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:21.957983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9543b0-616b-49a2-9433-5edf196661c0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:21.958530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9543b0-616b-49a2-9433-5edf196661c0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:21.958530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9543b0-616b-49a2-9433-5edf196661c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:21.978770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-dd9543b0-616b-49a2-9433-5edf196661c0 None None] MFA Rules not processed for user `9885dc064e3c46f6a7f9c19659ae96b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:21.979973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dd9543b0-616b-49a2-9433-5edf196661c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:21.987100 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4302/8569] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:22.001298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:22.002779 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:22.044727 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:22.076489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b9708-6647-453b-8a3e-6a2e8de971b9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:22.082045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:22.082651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:22.082931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:22.083203 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:22.092083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:22.093712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:22.103127 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4268/8570] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:31.972362 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:32.120014 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=17 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:37.300491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8cf6c-f13b-459c-a89f-4131572f879e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.301026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8cf6c-f13b-459c-a89f-4131572f879e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.301026 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8cf6c-f13b-459c-a89f-4131572f879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:37.320969 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7be8cf6c-f13b-459c-a89f-4131572f879e None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:37.322206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7be8cf6c-f13b-459c-a89f-4131572f879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:37.329489 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4303/8571] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:37.342109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:37.343530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:37.356314 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5be5-c928-48b1-a9f3-88b81c72c711 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:37.359969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:37.360544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.360806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.361079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:37.368364 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:37.369892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:37.377690 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4269/8572] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:37.530947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-376f-4af1-ac2a-4de26d84957e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.531233 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-376f-4af1-ac2a-4de26d84957e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.531510 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5d0b1-376f-4af1-ac2a-4de26d84957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:37.551749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-11d5d0b1-376f-4af1-ac2a-4de26d84957e None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:37.552955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-11d5d0b1-376f-4af1-ac2a-4de26d84957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:37.615024 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4304/8573] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:37.626482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:37.627951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:37.643235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b85a0-f562-40c9-a903-ff060ca4f464 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:37.649015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:37.649658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.649983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.650298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:37.659079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:37.660694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:37.670446 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4270/8574] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:37.941180 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.941509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.941786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:37.962049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:37.963264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:37.972477 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4305/8575] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:16:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:37.983327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:37.992935 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac81112-95de-42ca-8a3e-bb167be4beb4 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:37.996527 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:37.997114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:37.997424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:37.997696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:38.008280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:38.009787 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5205-419b-4ceb-a6a5-41a8a3dcec9a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:38.020708 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4271/8576] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:45.015667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:45.025701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da9c83-8008-4b8d-ab0d-eda0ceb1532e None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:45.029191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:45.029812 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:45.030095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:45.030364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:45.032050 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 30 02:16:45.040220 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 203, in _is_valid_token Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 30 02:16:45.041425 n-d-master-1 devstack@keystone.service[82035]: ERROR keystone.server.flask.application Oct 30 02:16:45.042106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4306/8577] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:45 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 30 02:16:45.106054 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519454-5d43-4bed-8d27-8ec0dbb2caff None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:45.106540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519454-5d43-4bed-8d27-8ec0dbb2caff None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:45.106664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519454-5d43-4bed-8d27-8ec0dbb2caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:45.127012 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-76519454-5d43-4bed-8d27-8ec0dbb2caff None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:45.128206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-76519454-5d43-4bed-8d27-8ec0dbb2caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:45.135121 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4272/8578] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:16:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:45.144690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:45.154450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dea6a-99f7-485f-b92b-6ba0d0f3d0c2 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:45.158101 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:45.158692 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:45.158972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:45.159244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:45.166465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:45.167880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483754-3ac1-400d-8df7-cff318e83814 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:45.176051 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4307/8579] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:16:46.546860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:46.547384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:46.547384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:46.566575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:46.567761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:46.577386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4273/8580] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 30 02:16:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:46.582890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:46.583368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:46.583474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:46.603316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:16:46.604480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:16:46.613768 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4308/8581] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:16:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:16:46.624773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:16:46.633775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417f4e2-1065-42d2-af35-9f73632edc99 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:16:46.637267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:16:46.637893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:16:46.638166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:16:46.638434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:16:46.648317 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:16:46.649788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d84d-ef6f-4158-adef-f9e32bbb408c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:16:46.660248 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4274/8582] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:16:56.597647 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=46 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:16:56.655597 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=30 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:15.515806 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:15.524894 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a5b50-3f5e-4280-ac62-1740fc141e44 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:15.528901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:15.529529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:15.529807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:15.530072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:15.531771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:15.540873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:15.542913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:15.550575 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4309/8583] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:17:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:17:25.547236 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:27.242216 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:27.243197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:27.243692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:27.276161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:27.284280 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:27.293839 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4275/8584] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:17:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:27.304899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:27.318772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519aea7-b146-47a0-b3ba-b77290af7b24 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:27.324675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:27.328675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:27.328675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:27.328675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:27.334373 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:27.335947 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:27.345571 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4310/8585] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:17:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:17:27.360510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:27.372166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0171c-2e07-435a-9bf4-f89667bd412b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:27.382858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:27.382858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:27.382858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:27.382858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] PATH_INFO: `/v3/users/9885dc064e3c46f6a7f9c19659ae96b3` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:27.383282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9885dc064e3c46f6a7f9c19659ae96b3)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:27.383282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:27.510017 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9885dc064e3c46f6a7f9c19659ae96b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:27.511076 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9885dc064e3c46f6a7f9c19659ae96b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:27.518322 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9885dc064e3c46f6a7f9c19659ae96b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:27.518976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9885dc064e3c46f6a7f9c19659ae96b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:27.570213 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-72ac062f-3aab-4c58-8dce-4993bf35eccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9885dc064e3c46f6a7f9c19659ae96b3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:27.588339 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4276/8586] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:17:27 2022] DELETE /identity/v3/users/9885dc064e3c46f6a7f9c19659ae96b3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:17:27.813047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:27.832160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39429a-7dab-4185-83cc-ebcfbc861412 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:27.894737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:27.895286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:27.895567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:27.895833 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] PATH_INFO: `/v3/projects/52cb154d20324ed9815f877d58472dc3` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:27.896986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cb154d20324ed9815f877d58472dc3)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:27.898901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:27.976336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cb154d20324ed9815f877d58472dc3', 'request_id': 'req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:28.038968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cb154d20324ed9815f877d58472dc3', 'request_id': 'req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:28.045964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cb154d20324ed9815f877d58472dc3', 'request_id': 'req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:28.056567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] The token cache is being invalidate because project 52cb154d20324ed9815f877d58472dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:17:28.056820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:28.057472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-8a08ed21-4fc9-4de5-ad1d-91603c3d397d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:17:28.058942 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4311/8587] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:17:27 2022] DELETE /identity/v3/projects/52cb154d20324ed9815f877d58472dc3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:17:28.064196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.064483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.064753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.083736 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:28.084917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:28.141773 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4277/8588] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:28.150937 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.151231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.151525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.171704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:28.172905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:28.181506 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4312/8589] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:28.185809 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.195888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165ddab-0b1a-41a3-8faf-722c87243f2e None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.200847 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.201497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.201780 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.202055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.202705 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:17:28.203009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.204691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.217026 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4278/8590] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:17:28.221403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.231333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95933683-7a50-4cd1-a335-fd72fdfea5a6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.236043 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.236642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.236926 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.237201 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.237922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.243737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.316718 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4313/8591] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:17:28 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:17:28.319205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.330094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160142-dcf6-4c8d-b2e5-edbd34d74a1c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.376266 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:28.385490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.387090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.387090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.387090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.387391 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.389173 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.489965 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4279/8592] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:17:28 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:17:28.494034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.504317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0da36-685c-49cc-97d7-520568a9dce8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.508903 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.509530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.510302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.510579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.511205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.512862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.522946 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4314/8593] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:17:28.527440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.537420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7780df9-981c-4b94-80b8-8aac729bf12b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.542023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.542608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.542886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.543161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.543789 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.545399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba7689-c663-4a28-a23f-5d601ff6ff4a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.555822 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4280/8594] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:17:28.559885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.570305 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23227d1-cf84-49cd-bdfc-9b82c9a842fc admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.575466 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.576100 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.576382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.576660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] PATH_INFO: `/v3/projects/5c755ba9d0c1434c9e73634c2cc4a80a/users/65b8f0f9740b44d59ca2617609cac5ab/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.591782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c755ba9d0c1434c9e73634c2cc4a80a, user_id=65b8f0f9740b44d59ca2617609cac5ab, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.594496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.656123 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4315/8595] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:17:28 2022] PUT /identity/v3/projects/5c755ba9d0c1434c9e73634c2cc4a80a/users/65b8f0f9740b44d59ca2617609cac5ab/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:17:28.661460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6c66-6967-4df0-a9dd-28350ea72a04 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.661808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6c66-6967-4df0-a9dd-28350ea72a04 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.662079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6c66-6967-4df0-a9dd-28350ea72a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.681004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-291f6c66-6967-4df0-a9dd-28350ea72a04 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:28.682237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-291f6c66-6967-4df0-a9dd-28350ea72a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:28.740572 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4281/8596] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:28.750684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:28.752361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:28.767380 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:28.810311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba459f1-4b0e-4e15-923b-44994c3c3445 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:28.814264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:28.814867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:28.815330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:28.815759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:28.827452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:28.827452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff628ff-cffe-45d3-8019-0e90c5d3bea2 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:28.836321 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4316/8597] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:17:33.850753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a721-da94-4117-996b-206d66665e63 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:33.851671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a721-da94-4117-996b-206d66665e63 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:33.851981 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669a721-da94-4117-996b-206d66665e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:33.882205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2669a721-da94-4117-996b-206d66665e63 None None] MFA Rules not processed for user `65b8f0f9740b44d59ca2617609cac5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:33.883451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2669a721-da94-4117-996b-206d66665e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:33.951096 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4282/8598] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:33.963306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:33.964123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:33.964398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:33.984444 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] MFA Rules not processed for user `65b8f0f9740b44d59ca2617609cac5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:17:33.985687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:33.992963 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4317/8599] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:17:34.006806 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669a721-da94-4117-996b-206d66665e63 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:34.008241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2669a721-da94-4117-996b-206d66665e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:34.073616 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:34.090101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669a721-da94-4117-996b-206d66665e63 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:34.096104 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:34.096728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:34.097010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:34.097281 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:34.106833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:34.109063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:34.118420 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4283/8600] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:17:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:17:41.673848 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:17:41.675242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:41.686874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89b2f6-a25e-4064-b324-cea1ceb1270c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:17:41.690586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:17:41.691172 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:17:41.691445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:17:41.691712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:17:41.693369 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:17:41.705913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:17:41.707313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:17:41.718429 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4318/8601] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:17:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:17:44.153114 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:17:51.713741 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=29 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:22.614537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:18:22.624421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eab23-03cf-4f9a-914d-f6392d0518ab service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:18:22.628132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:18:22.628804 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:22.629163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:22.629550 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:22.631430 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:22.641583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:18:22.642859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:18:22.652076 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4284/8602] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:18:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:18:23.055512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:18:23.066983 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4293e-79b4-45f2-a010-ca42d5304592 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:18:23.073059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:18:23.073808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:23.074076 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:23.074280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:23.075982 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:23.089157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:18:23.090777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7580b-7d6d-40fb-a9d0-d4ae058a5d09 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:18:23.100962 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4319/8603] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:18:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:18:29.329988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:18:29.332323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:29.349142 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4bc5-fa8c-486d-9bb9-6f664dd0c75c service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:18:29.355693 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:18:29.356310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:29.356592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:29.356869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:29.358676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:29.371676 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:18:29.383163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:18:29.383933 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4285/8604] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:18:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:18:32.246652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:32.247259 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:32.247443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:32.267913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] MFA Rules not processed for user `65b8f0f9740b44d59ca2617609cac5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:18:32.269115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:32.276324 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4320/8605] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:18:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:18:32.529360 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:18:32.538468 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081e7f-373d-4b5d-acec-787102b62120 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:18:32.543009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:18:32.544683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:32.544683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:32.544683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:32.546096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:32.555882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:18:32.557472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:18:32.565624 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4286/8606] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:18:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:18:32.937210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:18:32.938631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:33.014245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16e4b3-bc27-4bbf-b293-c713b1b2d8d4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:18:33.019225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:18:33.019803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:18:33.020081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:18:33.020350 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:18:33.022086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:18:33.034118 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:18:33.035731 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:18:33.045894 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4321/8607] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:18:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:18:42.562206 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=18 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:18:43.042276 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=41 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:37.088298 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:37.102873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73ef03-d4be-4ee3-bb7b-02f05bc5e3f8 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:37.107917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:37.108766 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:37.109079 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:37.109497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] PATH_INFO: `/v3/users/65b8f0f9740b44d59ca2617609cac5ab` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:37.110718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b8f0f9740b44d59ca2617609cac5ab)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:37.112732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:37.313420 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b8f0f9740b44d59ca2617609cac5ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.314069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b8f0f9740b44d59ca2617609cac5ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.321114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b8f0f9740b44d59ca2617609cac5ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.321890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b8f0f9740b44d59ca2617609cac5ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.406870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-cc84bc7d-586b-46e3-8617-7acbf6193a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b8f0f9740b44d59ca2617609cac5ab'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.425245 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4287/8608] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:19:37 2022] DELETE /identity/v3/users/65b8f0f9740b44d59ca2617609cac5ab => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:19:37.672463 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:37.685152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f5ca-66c5-4106-a566-9890125771c0 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:37.742606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:37.743232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:37.743521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:37.743797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] PATH_INFO: `/v3/projects/5c755ba9d0c1434c9e73634c2cc4a80a` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:37.744907 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c755ba9d0c1434c9e73634c2cc4a80a)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:37.746858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:37.854012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c755ba9d0c1434c9e73634c2cc4a80a', 'request_id': 'req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.916673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c755ba9d0c1434c9e73634c2cc4a80a', 'request_id': 'req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.923341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c755ba9d0c1434c9e73634c2cc4a80a', 'request_id': 'req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.933950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] The token cache is being invalidate because project 5c755ba9d0c1434c9e73634c2cc4a80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:19:37.934240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.935134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-75ca04b7-4f5c-4bfe-bafd-d6f32eec1906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:19:37.936626 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4322/8609] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:19:37 2022] DELETE /identity/v3/projects/5c755ba9d0c1434c9e73634c2cc4a80a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:19:37.941558 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:37.941849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:37.942124 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:37.963130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:19:37.964335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:38.023983 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4288/8610] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:19:38.033342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.033669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.033977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.053642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:19:38.054832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:38.062858 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4323/8611] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:19:38.066898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.077324 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01252ed-4cd9-4038-85eb-80332015c5a9 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.082027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.082620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.082897 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.083164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.083798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:19:38.084095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.085752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.097655 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4289/8612] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:19:38.101701 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.110742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bb356-b349-4c16-a21e-376adcb5a3d3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.115385 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.115955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.116231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.116498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.117110 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.119016 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.215759 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4324/8613] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:19:38 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:19:38.219912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.230256 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579912-32b7-48a2-b9b0-b54946ea9dbd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.286831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.287441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.287721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.288006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.288639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.290573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.298401 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:38.361589 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4290/8614] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:19:38 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:19:38.365787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.376598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a6333-a3c2-409b-a63c-a4d0c22bf91f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.381609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.382210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.382495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.382770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.383494 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.385776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.395799 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4325/8615] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:19:38.399694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.409858 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6dc90-ecee-49ab-968e-180884a15737 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.414476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.415072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.415354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.415634 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.416266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.417893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea615e-a969-4b97-926e-c9dc1e612f1c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.428386 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4291/8616] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:19:38.432752 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.442803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957ed64-ee26-4f1d-9ad5-0412208ce842 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.448470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.449106 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.449417 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.449698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] PATH_INFO: `/v3/projects/ec54882ff5fa47fe9303222e3f936de9/users/bd6a4d32970a4d72be7109ceaf173241/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.464034 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec54882ff5fa47fe9303222e3f936de9, user_id=bd6a4d32970a4d72be7109ceaf173241, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.466779 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.516139 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4326/8617] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:19:38 2022] PUT /identity/v3/projects/ec54882ff5fa47fe9303222e3f936de9/users/bd6a4d32970a4d72be7109ceaf173241/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:19:38.521032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9cd3b-ff2e-4b09-87be-255d520ef15f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.521323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9cd3b-ff2e-4b09-87be-255d520ef15f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.521664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9cd3b-ff2e-4b09-87be-255d520ef15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.540644 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-6aa9cd3b-ff2e-4b09-87be-255d520ef15f None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:19:38.541875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6aa9cd3b-ff2e-4b09-87be-255d520ef15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:38.600486 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4292/8618] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:19:38.610178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:38.611860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:38.643073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:38.669012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73740821-044b-4ded-9404-168a15321d73 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:38.672763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e228e-39a9-4506-958b-481073582235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:38.673395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e228e-39a9-4506-958b-481073582235 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:38.673708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e228e-39a9-4506-958b-481073582235 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:38.674010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e228e-39a9-4506-958b-481073582235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:38.684033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e228e-39a9-4506-958b-481073582235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:38.685771 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e228e-39a9-4506-958b-481073582235 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:38.695243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4327/8619] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:19:43.846601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f4fc-69ec-4726-9266-89ac4ccb04b9 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:43.847149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f4fc-69ec-4726-9266-89ac4ccb04b9 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:43.847149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f4fc-69ec-4726-9266-89ac4ccb04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:43.877046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-0104f4fc-69ec-4726-9266-89ac4ccb04b9 None None] MFA Rules not processed for user `bd6a4d32970a4d72be7109ceaf173241`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:19:43.878289 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0104f4fc-69ec-4726-9266-89ac4ccb04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:43.945838 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4293/8620] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:19:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:19:43.962375 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e228e-39a9-4506-958b-481073582235 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:19:43.963885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-157e228e-39a9-4506-958b-481073582235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:44.041882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e228e-39a9-4506-958b-481073582235 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:19:44.047474 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:19:44.048081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:44.048363 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:44.048638 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:44.056552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:19:44.058226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:19:44.067522 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4328/8621] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:19:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:19:46.290824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:19:46.291358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:19:46.291358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:19:46.312343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] MFA Rules not processed for user `bd6a4d32970a4d72be7109ceaf173241`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:19:46.313749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:19:46.322434 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4294/8622] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:19:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:19:54.063400 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=48 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:19:56.305935 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:29.301724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:20:29.303099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:20:29.372336 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ce841-1329-4b08-b70e-ef239d7e18b7 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:20:29.377258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:20:29.377882 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:20:29.378159 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:20:29.378427 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:20:29.380153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:20:29.391883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:20:29.393481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:20:29.402986 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4329/8623] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:20:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:20:37.079844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:20:37.092987 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa08893-d34a-40c3-99f2-8d4dc2332a32 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:20:37.098218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:20:37.102402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:20:37.102402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:20:37.102402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:20:37.102402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:20:37.113855 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:20:37.115419 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fe8bf-0d53-49a5-b021-35418198ad51 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:20:37.125461 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4295/8624] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:20:39.398886 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=32 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:47.121035 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:20:51.511003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:20:51.523811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b3cdf-27a7-4e6a-8275-21c8829139bb service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:20:51.529880 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:20:51.530532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:20:51.530808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:20:51.531078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:20:51.532798 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:20:51.545176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:20:51.547443 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:20:51.557164 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4330/8625] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:21:01.552802 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:01.978749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:21:01.979228 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:21:01.979329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:21:01.998692 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] MFA Rules not processed for user `bd6a4d32970a4d72be7109ceaf173241`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:21:01.999874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:21:02.006806 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4296/8626] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:21:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:21:11.992952 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:21:49.847734 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:21:49.849152 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:21:49.860362 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad00d-4427-49d4-9bc1-6b12e485f557 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:21:49.864560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:21:49.865150 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:21:49.865473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:21:49.865746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:21:49.867401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:21:49.880223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:21:49.881669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:21:49.892525 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4331/8627] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:21:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:21:59.887753 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:05.548555 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:05.558271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c934e-60fc-4538-9bd9-41452871d9e2 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:05.563406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:05.563406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:05.563406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:05.563406 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:05.565300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:05.574651 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:05.576064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:05.584551 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4297/8628] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:22:06.011084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:06.019749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6c823-8020-4bbe-972d-1a688c6d8945 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:06.023355 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:06.023943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:06.029002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:06.029002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:06.029002 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:06.035517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:06.036963 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:06.044965 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4332/8629] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:22:06.195546 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:06.207583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145717c-1134-43de-a87e-ae11c3640cab service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:06.212490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:06.213074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:06.213375 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:06.213650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:06.215328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:06.226677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:06.228224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:06.238573 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4298/8630] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:22:06.520500 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:06.529521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef5a38-41ba-4f94-b515-49f2e40f37cd service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:06.533746 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:06.534368 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:06.534643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:06.534910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:06.536598 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:06.549624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:06.551028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:06.561871 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4333/8631] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:22:06.622255 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:06.632523 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5af02-3fa8-494a-98d1-4e0a22664dda service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:06.637455 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:06.638039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:06.638316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:06.638583 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:06.640270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:06.651849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:06.653429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc982f5-899a-4929-b5ba-63261ba62cd3 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:06.663523 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4299/8632] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:22:16.557268 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:16.659459 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=18 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:18.762859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:22:18.799440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a53b59-9780-4d78-8ef9-c40f40ab95a7 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:22:18.803125 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:22:18.803747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:18.804028 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:18.804303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:18.806340 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:18.824891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:22:18.826342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:22:18.834615 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4334/8633] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:22:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:22:25.029638 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:22:25.030130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:22:25.030229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:22:25.051379 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] MFA Rules not processed for user `bd6a4d32970a4d72be7109ceaf173241`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:22:25.052560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:22:25.072955 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4300/8634] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:22:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:22:28.831200 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=22 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:22:35.067230 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:14.234435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:23:14.243627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b0490-03dd-4bb4-961a-6886e9612081 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:23:14.247516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:23:14.248116 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:14.248394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:14.248664 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:14.250384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:14.271420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:23:14.273243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:23:14.294498 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4335/8635] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:23:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:23:24.291934 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=13 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:33.545066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:23:33.556206 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed238e-9bd2-4882-ac02-7bfb6126c179 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:23:33.560321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:23:33.561023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:33.561303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:33.561605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:33.563393 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:33.586749 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:23:33.588161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:23:33.596011 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4301/8636] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:23:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:23:33.995178 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:23:34.006303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c3d1a-e073-4571-9e84-10da8ff2777a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:23:34.011843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:23:34.012465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:34.012716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:34.012984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:34.014741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:34.026663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:23:34.028275 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57da85-c0c6-4c0d-ac6f-dce512ac62b2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:23:34.039213 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4336/8637] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:23:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:23:40.729732 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:23:40.731279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:40.748620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffb0d-ffb3-401e-ab8e-f140caad5eca service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:23:40.754297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:23:40.754902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:40.755177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:40.755451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:40.757194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:40.771165 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:23:40.773169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:23:40.784255 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4302/8638] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:23:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:23:44.034321 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:50.779665 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=17 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:23:51.239231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b8e-7a5d-46e9-8730-befcd9f48dda None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:51.239758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b8e-7a5d-46e9-8730-befcd9f48dda None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:51.239758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e1b8e-7a5d-46e9-8730-befcd9f48dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:51.260273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-081e1b8e-7a5d-46e9-8730-befcd9f48dda None None] MFA Rules not processed for user `bd6a4d32970a4d72be7109ceaf173241`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:23:51.261488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-081e1b8e-7a5d-46e9-8730-befcd9f48dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:51.268251 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4337/8639] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:23:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:23:52.000606 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:23:52.002087 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:52.040422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8e44-f915-44c4-8f97-877b1d2ab56c service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:23:52.048947 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:23:52.049589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:23:52.049877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:23:52.050151 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:23:52.051856 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:23:52.063689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:23:52.065204 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:23:52.075402 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4303/8640] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:24:01.253803 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:02.071173 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=15 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:44.718229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:24:44.718720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:24:44.718826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:24:44.781022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] MFA Rules not processed for user `135b054aaaae4c84b280fe4e9908e240`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:24:44.782160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:24:44.842748 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4338/8641] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 30 02:24:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:24:44.848742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:24:44.858616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c19-83d1-4982-8c1e-774b50e5647a service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:24:44.862130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:24:44.862718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:24:44.862994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:24:44.863259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:24:44.871483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:24:44.872886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:24:44.882269 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4304/8642] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:24:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:24:54.839061 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=42 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:24:54.877754 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:25:32.095636 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:25:32.108448 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94784ff-8286-4a4d-ba66-84c6e5392395 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:25:32.114268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:25:32.116930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:25:32.116930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:25:32.116930 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:25:32.124700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:25:32.126345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:25:32.136183 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4339/8643] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:25:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:25:42.132099 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:01.255205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:01.265263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25de8-8da6-4933-b89c-8215026e40fa service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:01.268822 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:01.269434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:01.269712 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:01.270091 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:01.279715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:01.281521 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:01.310617 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4305/8644] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:04.881445 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:04.892398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e5523-a095-422e-9930-1454d8f63036 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:04.900328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:04.900944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:04.901227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:04.901561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:04.903835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:04.915944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:04.918199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:04.928472 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4340/8645] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:05.008862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:05.019532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280cb2f-d1cf-4e91-99d5-6d8c1f33f7fc service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:05.024168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:05.024792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:05.025071 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:05.025367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] PATH_INFO: `/v3/users/bd6a4d32970a4d72be7109ceaf173241` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:05.026475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6a4d32970a4d72be7109ceaf173241)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:05.028889 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:05.208683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6a4d32970a4d72be7109ceaf173241'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.209363 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6a4d32970a4d72be7109ceaf173241'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.216782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6a4d32970a4d72be7109ceaf173241'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.217446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6a4d32970a4d72be7109ceaf173241'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.284426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f5f42f45-c0fc-43ef-9e02-5777305cf805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6a4d32970a4d72be7109ceaf173241'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.303508 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4306/8646] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:26:05 2022] DELETE /identity/v3/users/bd6a4d32970a4d72be7109ceaf173241 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:05.554294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:05.565964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec53c-560a-466f-8402-39ee526d79ae service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:05.623135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:05.623750 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:05.624027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:05.624295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] PATH_INFO: `/v3/projects/ec54882ff5fa47fe9303222e3f936de9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:05.625412 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec54882ff5fa47fe9303222e3f936de9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:05.627304 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:05.726608 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec54882ff5fa47fe9303222e3f936de9', 'request_id': 'req-94a780aa-d1d7-4593-ac63-466ae1695208'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.801376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec54882ff5fa47fe9303222e3f936de9', 'request_id': 'req-94a780aa-d1d7-4593-ac63-466ae1695208'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.808667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec54882ff5fa47fe9303222e3f936de9', 'request_id': 'req-94a780aa-d1d7-4593-ac63-466ae1695208'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.831342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] The token cache is being invalidate because project ec54882ff5fa47fe9303222e3f936de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:26:05.831631 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.832257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-94a780aa-d1d7-4593-ac63-466ae1695208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:05.833818 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4341/8647] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:26:05 2022] DELETE /identity/v3/projects/ec54882ff5fa47fe9303222e3f936de9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:05.838701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:05.839097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:05.839254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:05.896861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:05.898132 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:05.955607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4307/8648] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:05.963520 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:05.964006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:05.964123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:05.983012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:05.984190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:05.992180 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4342/8649] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:05.996775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.006537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e89118-8343-4129-9b6f-f364f90aa8bc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.011117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.012320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.012597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.012866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.013526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:26:06.013869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.015453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.023906 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:06.027033 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4308/8650] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:26:06.031191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.040414 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ee2a-085f-4c80-bd21-81c20a01db48 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.046338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.046338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.046702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.046702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.047290 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.049437 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.149201 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4343/8651] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:26:06.153001 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.163496 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a71439-7c18-49c9-a416-c1c96e309bf2 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.220166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.220763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.221040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.221313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.221967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.223849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.321797 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4309/8652] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:26:06 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:26:06.326070 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.336604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6c7d-9344-480d-b582-74c1b3165234 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.341628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.342252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.342528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.342824 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.343462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.345051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.355850 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4344/8653] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:26:06.359910 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.370009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac360b82-fe0c-4143-b473-11b0c16b2926 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.376055 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.376649 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.377198 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.377358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.377979 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.379553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b6eea-dc42-4e28-9280-16bdb8c8054a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.390763 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4310/8654] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:26:06.395044 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.408193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642ca2b-cf8e-4fb0-bfc0-5d20c5c4961f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.410306 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.410967 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.411244 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.411516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] PATH_INFO: `/v3/projects/4882834930374e3093f7a2de25c55d09/users/e0c3d5a6713246f0a856575bc7581a79/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.426627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4882834930374e3093f7a2de25c55d09, user_id=e0c3d5a6713246f0a856575bc7581a79, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.429251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.431373 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:06.484494 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4345/8655] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:26:06 2022] PUT /identity/v3/projects/4882834930374e3093f7a2de25c55d09/users/e0c3d5a6713246f0a856575bc7581a79/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:06.489588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30c2c-0f52-4f72-86f3-21f18da19b47 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.489874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30c2c-0f52-4f72-86f3-21f18da19b47 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.490145 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30c2c-0f52-4f72-86f3-21f18da19b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.509509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-7fb30c2c-0f52-4f72-86f3-21f18da19b47 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:06.510698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7fb30c2c-0f52-4f72-86f3-21f18da19b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:06.569252 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4311/8656] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:26:06.578847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:06.580486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:06.637007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021d6ad-6ac8-4934-94e5-02aca14a23d6 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:06.640676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:06.641269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:06.641579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:06.641851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:06.650802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:06.652714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24643ab3-a05d-42ec-bedf-9173f0591cfd service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:06.662177 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4346/8657] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:12.013510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:12.014069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:12.014069 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:12.046833 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] MFA Rules not processed for user `e0c3d5a6713246f0a856575bc7581a79`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:12.048566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:12.122426 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4312/8658] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:12.132330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:12.135706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:12.135706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:12.152476 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] MFA Rules not processed for user `e0c3d5a6713246f0a856575bc7581a79`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:12.153826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:12.161682 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4347/8659] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:12.174999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:12.177235 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:12.190946 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:12.274878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31d70-3be5-4302-8e1c-7799d772d188 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:12.280786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:12.282685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:12.282685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:12.282685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:12.291270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:12.293599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:12.304055 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4313/8660] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:26:15.391826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:15.393280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:15.477015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98391482-404e-44af-8b72-2aaf2e179428 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:15.483136 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:15.484243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:15.484726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:15.485216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:15.487221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:15.501303 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:15.503345 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66536a6-e8f1-4f0c-a483-2af4936db7fc service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:15.515446 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4348/8661] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:18.059591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:18.061616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:18.079541 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307205a3-d9d4-42eb-a733-85fefc90412b service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:18.086464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:18.087199 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:18.087483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:18.087759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:18.089535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:18.105505 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:18.107141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:18.118216 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4314/8662] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:25.511261 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=1,keystone:SELECT=63 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:25.775161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:25.775447 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:25.775721 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:25.794872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] MFA Rules not processed for user `e0c3d5a6713246f0a856575bc7581a79`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:25.796040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:25.803004 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4349/8663] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:28.113655 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=44 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:35.789501 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:41.568691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:41.570197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:41.581403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e075bb-7633-48b1-91e1-3230bc768e08 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:41.585136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:41.585873 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:41.586156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:41.586428 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:41.588210 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:41.597895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:41.599329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:41.607713 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4315/8664] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:49.818276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:49.824698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:49.840027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff860e-f9c3-4f0a-8672-9809d874aec7 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:49.845691 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:49.846352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:49.846640 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:49.846908 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:49.848609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:49.861783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:49.863419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:49.873815 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4350/8665] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:26:49.928849 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:49.947129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aea66d-76ef-42d7-9924-cf102cc611b3 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:49.947129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:49.947129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:49.947129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:49.947877 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] PATH_INFO: `/v3/users/e0c3d5a6713246f0a856575bc7581a79` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:49.948299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c3d5a6713246f0a856575bc7581a79)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:49.950270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:50.162327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c3d5a6713246f0a856575bc7581a79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.162986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c3d5a6713246f0a856575bc7581a79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.170009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c3d5a6713246f0a856575bc7581a79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.170639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c3d5a6713246f0a856575bc7581a79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.249543 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-f1cfbac0-d372-4061-aef8-260fb7bcc850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c3d5a6713246f0a856575bc7581a79'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.267128 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4316/8666] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:26:49 2022] DELETE /identity/v3/users/e0c3d5a6713246f0a856575bc7581a79 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:50.542049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:50.555222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6df0dd-2ce2-468a-a6b3-aeb505248975 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:50.614544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:50.615190 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:50.615472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:50.615742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] PATH_INFO: `/v3/projects/4882834930374e3093f7a2de25c55d09` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:50.616849 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4882834930374e3093f7a2de25c55d09)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:50.618777 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:50.719820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4882834930374e3093f7a2de25c55d09', 'request_id': 'req-5cff432e-295c-4ad6-a06a-76b49526a3f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.771022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4882834930374e3093f7a2de25c55d09', 'request_id': 'req-5cff432e-295c-4ad6-a06a-76b49526a3f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.777489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4882834930374e3093f7a2de25c55d09', 'request_id': 'req-5cff432e-295c-4ad6-a06a-76b49526a3f9'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.788386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] The token cache is being invalidate because project 4882834930374e3093f7a2de25c55d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:26:50.788613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.789243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-5cff432e-295c-4ad6-a06a-76b49526a3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:26:50.790806 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4351/8667] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:26:50 2022] DELETE /identity/v3/projects/4882834930374e3093f7a2de25c55d09 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:50.796445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:50.796759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:50.797036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:50.816839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:50.818064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:50.876345 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4317/8668] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:50.884374 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:50.884869 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:50.884975 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:50.906235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:50.907439 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:50.915437 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4352/8669] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:50.919742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:50.929803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc18cc-88d6-4af2-8204-d2f35bdc6722 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:50.934328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:50.934922 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:50.935722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:50.935993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:50.936624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:26:50.936928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:50.938625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:50.949934 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4318/8670] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:26:50.954705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:50.964115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a3e1-5627-4764-b95c-b04d16f5bf42 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:50.968804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:50.969424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:50.969706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:50.969977 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:50.970599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:50.972495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.081289 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4353/8671] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:26:50 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:26:51.085316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:51.095642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725783f-7be2-4d75-8b52-4f0390abb35a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:51.140100 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:51.152581 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:51.153180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.153493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.153794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.154451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:51.156408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.234390 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4319/8672] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:26:51 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:26:51.238671 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:51.249814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aed74-5f98-4e98-826a-30ea3b459ab9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:51.254527 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:51.255232 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.255515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.255788 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.256431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:51.258057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.268078 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4354/8673] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:26:51.272085 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:51.282367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cb8e-e47a-4a06-8f4e-d884601bb2c5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:51.287090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:51.287675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.287953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.288224 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.288852 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:51.290528 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c64a4b-bd16-4589-ba9f-f96fecdfdf92 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.302238 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4320/8674] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:26:51.306300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:51.317488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d22c52-83ae-4b14-ae16-d51cd3db0cae admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:51.322331 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:51.322986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.323273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.323546 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] PATH_INFO: `/v3/projects/936bf20a60d74d3eab0a2e1130cc1247/users/a783da1479c24bbb8867c22cef4cabdb/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.342251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936bf20a60d74d3eab0a2e1130cc1247, user_id=a783da1479c24bbb8867c22cef4cabdb, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:51.345196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.405054 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4355/8675] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:26:51 2022] PUT /identity/v3/projects/936bf20a60d74d3eab0a2e1130cc1247/users/a783da1479c24bbb8867c22cef4cabdb/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:26:51.415463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.415829 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.416020 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.445205 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] MFA Rules not processed for user `a783da1479c24bbb8867c22cef4cabdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:26:51.446471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:51.512345 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4321/8676] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:26:51.523015 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:26:51.524740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:26:51.540184 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:26:51.585386 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec503092-c728-4a5a-aa57-105a837e6ea8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:26:51.589032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:26:51.589657 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:26:51.589934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:26:51.590200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:26:51.598858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:26:51.600213 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf6d9e-cc10-4247-b6bd-e60b01dc0a7b service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:26:51.609953 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4356/8677] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:26:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:01.509501 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:01.645660 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=20 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:07.927907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:07.990915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc7b82-6c75-4bbb-b0bb-c3465055f05a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:07.995329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:07.995943 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:07.996220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:07.996488 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] PATH_INFO: `/v3/users/a783da1479c24bbb8867c22cef4cabdb` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:07.998126 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a783da1479c24bbb8867c22cef4cabdb)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:08.000010 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:08.222131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a783da1479c24bbb8867c22cef4cabdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:08.222792 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a783da1479c24bbb8867c22cef4cabdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:08.229761 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a783da1479c24bbb8867c22cef4cabdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:08.230333 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a783da1479c24bbb8867c22cef4cabdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:08.288227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a783da1479c24bbb8867c22cef4cabdb'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:08.306101 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4322/8678] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:27:07 2022] DELETE /identity/v3/users/a783da1479c24bbb8867c22cef4cabdb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:08.310570 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:08.311047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:08.311160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:08.330827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:08.332010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:08.390667 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4357/8679] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:08.400445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:08.401862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:08.458320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afd81-4696-420c-b243-acee432dc910 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:08.462014 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:08.462633 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:08.462906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:08.463171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:08.472605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:08.474083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0002-d79e-42c9-889a-9e77e6bcdfea service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:08.483417 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4323/8680] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:08.713222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:08.714678 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:08.728141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fc208-d4b9-40a1-8466-5a487c2826e1 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:08.733708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:08.734344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:08.734628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:08.734891 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] PATH_INFO: `/v3/projects/936bf20a60d74d3eab0a2e1130cc1247` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:08.736004 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936bf20a60d74d3eab0a2e1130cc1247)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:08.738221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:08.913533 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936bf20a60d74d3eab0a2e1130cc1247', 'request_id': 'req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:09.037175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936bf20a60d74d3eab0a2e1130cc1247', 'request_id': 'req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:09.044085 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936bf20a60d74d3eab0a2e1130cc1247', 'request_id': 'req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:09.054713 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] The token cache is being invalidate because project 936bf20a60d74d3eab0a2e1130cc1247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:27:09.055005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:09.055639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-9d6efabe-c1fd-46a8-9370-0afd520e1ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:09.057125 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4358/8681] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:27:08 2022] DELETE /identity/v3/projects/936bf20a60d74d3eab0a2e1130cc1247 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:09.062414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.062918 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.063024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.084082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:09.085272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:09.102141 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:09.142587 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4324/8682] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:27:09.150292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.150685 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.150966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.171139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:09.172525 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:09.180352 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4359/8683] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:09.184426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.193932 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104d448-f893-4a3f-9c1d-0588031fc4fc None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.199004 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.199591 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.199869 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.200141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.200775 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:27:09.201588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.203159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.214416 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4325/8684] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:27:09.219342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.228484 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddfe26-b477-4279-9d29-5a4febb99ee2 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.233237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.233851 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.234132 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.234402 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.235022 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.236896 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.313690 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4360/8685] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:27:09 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:27:09.317913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.329110 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71f7fa-2de1-4b7a-83ec-c98c30f0a8fe admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.390659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.391274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.391554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.391827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.392495 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.394450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.454993 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4326/8686] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:27:09 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:27:09.459174 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.469460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918d3ed-e9c5-42c0-bb36-b0214dc7c46d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.474354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.474944 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.475217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.475479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.476142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.477763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.487394 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4361/8687] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:09.491331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.501876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cde57-eeb9-4c4a-af99-bd1ea49696d0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.506728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.507321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.507599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.507898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.508540 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.510155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a912d-50f5-444e-846b-cd8b98c5d256 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.521322 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4327/8688] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:09.525462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.535397 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78394b4f-bb56-4e3c-8ec1-f8b6c4c860f7 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.540021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.540663 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.540946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.541222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] PATH_INFO: `/v3/projects/30ec0460376249b5b741f5051364a179/users/06d52114642f480bbe32750976cf13a4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.555793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ec0460376249b5b741f5051364a179, user_id=06d52114642f480bbe32750976cf13a4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.558483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.619819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4362/8689] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:27:09 2022] PUT /identity/v3/projects/30ec0460376249b5b741f5051364a179/users/06d52114642f480bbe32750976cf13a4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:09.631040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.631519 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.631800 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.660082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] MFA Rules not processed for user `06d52114642f480bbe32750976cf13a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:09.661284 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:09.724929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4328/8690] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:09.735294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:09.736978 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:09.759062 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:09.793084 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94748743-eb31-4931-b1f5-0bcf57433811 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:09.797575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:09.798234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:09.798770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:09.799220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:09.807980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:09.809457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3bb5-2934-4adb-ab09-6b5f219193c1 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:09.818949 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4363/8691] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:16.125556 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:16.145005 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:16.188850 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591475d2-31b0-4083-ae22-7098a9d74cf4 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:16.193453 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:16.194082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:16.194358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:16.194626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] PATH_INFO: `/v3/users/06d52114642f480bbe32750976cf13a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:16.195839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d52114642f480bbe32750976cf13a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:16.197836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:16.390183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d52114642f480bbe32750976cf13a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:16.390834 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d52114642f480bbe32750976cf13a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:16.397934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d52114642f480bbe32750976cf13a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:16.398578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d52114642f480bbe32750976cf13a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:16.462296 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d52114642f480bbe32750976cf13a4'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:16.480462 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4329/8692] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:27:16 2022] DELETE /identity/v3/users/06d52114642f480bbe32750976cf13a4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:16.485134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:16.485644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:16.485749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:16.504473 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:16.505700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:16.563141 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4364/8693] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:16.572681 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:16.574168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:16.630274 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a73fe3-02f0-4ca9-b588-36d79407afde admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:16.633923 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:16.634520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:16.634799 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:16.635072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:16.644416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:16.645859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbbdb9-f68a-4f51-bec1-297e7838bac5 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:16.655672 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4330/8694] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:27:16.875499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:16.876878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:16.894700 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a9505-fb5f-49ba-8a72-5991d066ef9b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:16.897215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:16.897415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:16.898096 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:16.898381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] PATH_INFO: `/v3/projects/30ec0460376249b5b741f5051364a179` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:16.900033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ec0460376249b5b741f5051364a179)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:16.902017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.002958 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ec0460376249b5b741f5051364a179', 'request_id': 'req-47771e52-21e8-4e02-8cad-bf7fb7dda9df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:17.065455 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ec0460376249b5b741f5051364a179', 'request_id': 'req-47771e52-21e8-4e02-8cad-bf7fb7dda9df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:17.071906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ec0460376249b5b741f5051364a179', 'request_id': 'req-47771e52-21e8-4e02-8cad-bf7fb7dda9df'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:17.082624 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] The token cache is being invalidate because project 30ec0460376249b5b741f5051364a179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:27:17.082906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:17.083530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-47771e52-21e8-4e02-8cad-bf7fb7dda9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:27:17.084996 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4365/8695] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:27:16 2022] DELETE /identity/v3/projects/30ec0460376249b5b741f5051364a179 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:17.090045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.090348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.090621 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.110237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:17.111421 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:17.144702 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:17.170209 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4331/8696] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:17.178279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.178635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.178887 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.199243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:17.200430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:17.208973 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4366/8697] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:17.213211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.222762 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48269c2-f5fb-47c8-a17a-11c35722504a None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.227236 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.227819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.228096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.228365 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.228996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:27:17.229292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.230887 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.243046 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4332/8698] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:27:17.247315 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.257580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a738-2dbb-451f-9cc8-efc7a294f0e5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.262421 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.263013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.263296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.263568 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.264199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.266144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.332238 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4367/8699] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:27:17 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:27:17.336452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.346841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e958ac-2d9d-4778-b1b0-a613bddf624c admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.404016 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.404622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.404934 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.405208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.405860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.407776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.507991 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4333/8700] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:27:17 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:27:17.516257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.526706 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adc2c-78df-440f-b349-ab0990a7de12 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.531330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.531921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.532207 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.532475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.533117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.534740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.544551 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4368/8701] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:17.549143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.559227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42bdb4-a6a4-4ab5-81f5-f4df5357308b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.564674 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.565295 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.565616 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.565893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.566565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.568164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd2469-b533-4f22-b730-976fff40d6ef admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.585736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.594085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4334/8702] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:17.597151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678baf-3143-4641-9ca3-d30e91fbe016 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.601862 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.605487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.605487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.605487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] PATH_INFO: `/v3/projects/bfd17e8c4aa24960a8b46e4721e2acc7/users/620bbcf5f19d4cfbb8b39de0272870e4/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.605487 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:17.620120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd17e8c4aa24960a8b46e4721e2acc7, user_id=620bbcf5f19d4cfbb8b39de0272870e4, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.622820 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.674273 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4369/8703] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:27:17 2022] PUT /identity/v3/projects/bfd17e8c4aa24960a8b46e4721e2acc7/users/620bbcf5f19d4cfbb8b39de0272870e4/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:27:17.679473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0983-65f0-4e85-9d9a-d3dba9334446 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.679757 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0983-65f0-4e85-9d9a-d3dba9334446 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.680031 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0983-65f0-4e85-9d9a-d3dba9334446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.698599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-958e0983-65f0-4e85-9d9a-d3dba9334446 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:17.699797 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-958e0983-65f0-4e85-9d9a-d3dba9334446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:17.758641 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4335/8704] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:17.768119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:17.769912 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:17.827399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15383a-2b93-49b2-ae51-ed6ce6aa790d admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:17.831064 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:17.831662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:17.831942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:17.832215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:17.841216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:17.843400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:17.852870 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4370/8705] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:22.782906 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:22.783424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:22.783531 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:22.813573 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] MFA Rules not processed for user `620bbcf5f19d4cfbb8b39de0272870e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:22.814487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:22.850220 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:22.883695 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4336/8706] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:22.887766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:22.903090 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5f45-cf5c-4469-90ba-351ef30e467d service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:22.907864 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:22.908697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:22.908972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:22.909241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:22.909957 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:22.912058 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:22.993978 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4371/8707] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:27:22 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:27:22.998129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:23.010426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ae6d-a864-4c61-a72e-3f38e8b74037 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:23.071532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:23.072155 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:23.072434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:23.072710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:23.073366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:23.075328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:23.143994 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4337/8708] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:27:22 2022] POST /identity/v3/users => generated 301 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:27:23.148188 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:23.159544 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2ce61-8305-4b9b-8a50-7a4a72e242d1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:23.165009 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:23.165661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:23.165941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:23.166215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:23.166854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:23.168457 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:23.180498 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4372/8709] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:23.184881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:23.196614 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c82c-8325-4191-9188-6aea10f79c5b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:23.201772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:23.202892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:23.203171 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:23.203443 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] PATH_INFO: `/v3/projects/7724623dc42e4639a8e3849d375b83a4/users/f4d1fd8ed3534095b10860a1b0c0c7bf/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:23.218992 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7724623dc42e4639a8e3849d375b83a4, user_id=f4d1fd8ed3534095b10860a1b0c0c7bf, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:23.221690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:23.326618 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4338/8710] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:27:23 2022] PUT /identity/v3/projects/7724623dc42e4639a8e3849d375b83a4/users/f4d1fd8ed3534095b10860a1b0c0c7bf/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:23.330867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:23.344942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acddee1-2ae0-49e5-a5fe-c9ae78954b6c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:23.409184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:23.409852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:23.410217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:23.410493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:23.411137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:23.412799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a677f82-c83c-465a-8adc-a7ff0c119337 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:23.423945 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4373/8711] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:27:23.428294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:23.439628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab33d4-9131-462d-9d5d-3fb5b7f5288a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:23.444261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:23.444915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:23.445211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:23.445535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] PATH_INFO: `/v3/projects/7724623dc42e4639a8e3849d375b83a4/users/f4d1fd8ed3534095b10860a1b0c0c7bf/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:23.447445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7724623dc42e4639a8e3849d375b83a4, user_id=f4d1fd8ed3534095b10860a1b0c0c7bf, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:23.450136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:23.461314 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4339/8712] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:27:23 2022] PUT /identity/v3/projects/7724623dc42e4639a8e3849d375b83a4/users/f4d1fd8ed3534095b10860a1b0c0c7bf/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:27:28.578561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadcd9-5d10-446d-b35c-6f5cfb50458a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:28.579095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadcd9-5d10-446d-b35c-6f5cfb50458a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:28.579095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fadcd9-5d10-446d-b35c-6f5cfb50458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:28.611759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-46fadcd9-5d10-446d-b35c-6f5cfb50458a None None] MFA Rules not processed for user `f4d1fd8ed3534095b10860a1b0c0c7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:28.613010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-46fadcd9-5d10-446d-b35c-6f5cfb50458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:28.656210 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:28.688107 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4374/8713] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:27:28.705768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:28.707796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:28.790174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070c243-3d5b-4c06-b63c-06d2c477bc04 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:28.796229 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:28.797096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:28.797404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:28.797679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:28.824975 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:28.858955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:28.860695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:28.871110 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4340/8714] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:29.009393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:29.009825 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:29.010013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:29.028840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] MFA Rules not processed for user `620bbcf5f19d4cfbb8b39de0272870e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:27:29.030614 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:29.037281 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4375/8715] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:27:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:27:29.704327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:29.772446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e1259-42b1-46f6-9c45-0f3c953bf29f service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:29.777029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:29.777978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:29.778378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:29.779564 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:29.781786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:29.798819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:29.801133 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:29.814086 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4341/8716] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:33.248861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:33.259805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da9f2-bfa2-4995-a70f-fdeebf831799 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:33.264057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:33.265227 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:33.265543 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:33.265909 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:33.267952 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:33.278672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:33.280817 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c048-a55f-4f99-a650-e2df01737775 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:33.293586 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4376/8717] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:39.808260 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=42 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:41.734109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:27:41.735578 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:27:41.790861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225865a-1db3-4457-a102-f8f50a6a412b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:27:41.794342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:27:41.794925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:27:41.795202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:27:41.795472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:27:41.804491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:27:41.806007 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:27:41.815930 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4342/8718] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:27:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:27:43.286476 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=21 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:27:51.811177 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=26 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:10.585528 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:28:10.586079 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:28:10.586189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:28:10.605582 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] MFA Rules not processed for user `620bbcf5f19d4cfbb8b39de0272870e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:28:10.606759 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:10.614174 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4377/8719] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:28:11.529000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:28:11.530624 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:11.602185 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671c64-4f4b-486d-9e06-a3cf89c01fc9 service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:28:11.607130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:28:11.607725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:28:11.607999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:28:11.608268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:28:11.609982 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:11.621367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:28:11.622951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d232eb8-8355-4daf-8ec7-130e62235456 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:28:11.633250 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4343/8720] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:28:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:28:14.890540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:28:14.892241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:14.905226 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b82c8-3390-4bdd-bb87-1102aad993a3 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:28:14.909507 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:28:14.910114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:28:14.910398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:28:14.910672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:28:14.912418 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:14.927673 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:28:14.929031 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:28:14.940178 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4378/8721] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:28:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:28:21.629137 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=32 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:24.935163 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:28:54.844942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:28:54.845671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:28:54.845671 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:28:55.002137 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] MFA Rules not processed for user `620bbcf5f19d4cfbb8b39de0272870e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:28:55.003261 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:55.010087 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4344/8722] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:28:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:28:55.637761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:28:55.649202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd7d75-bc87-4ca9-a27b-34e7ceeb5ac0 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:28:55.654372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:28:55.655045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:28:55.655389 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:28:55.655732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:28:55.657551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:28:55.669724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:28:55.671705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:28:55.682642 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4379/8723] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:29:04.859492 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:05.679209 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:05.795336 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:05.809058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dce8e-9397-4c2a-8074-aab4f80da92b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:05.814370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:05.814972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:05.815245 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:05.815514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:05.817253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:05.828819 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:05.830390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:05.840767 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4345/8724] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:29:15.836531 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:43.692757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:43.753682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74958d-de0f-435a-a392-1c71de5a248f service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:43.758167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:43.758786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:43.759066 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:43.759338 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] PATH_INFO: `/v3/users/620bbcf5f19d4cfbb8b39de0272870e4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:43.760441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620bbcf5f19d4cfbb8b39de0272870e4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:43.762396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:43.905813 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620bbcf5f19d4cfbb8b39de0272870e4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:43.977531 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620bbcf5f19d4cfbb8b39de0272870e4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:43.978067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620bbcf5f19d4cfbb8b39de0272870e4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:43.990573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620bbcf5f19d4cfbb8b39de0272870e4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:43.999633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620bbcf5f19d4cfbb8b39de0272870e4'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.003680 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4380/8725] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:29:43 2022] DELETE /identity/v3/users/620bbcf5f19d4cfbb8b39de0272870e4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:29:44.262703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:44.270489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832c768-cd74-4f7b-b9bb-95079da03243 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:44.327794 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:44.328422 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:44.328697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:44.328964 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] PATH_INFO: `/v3/projects/bfd17e8c4aa24960a8b46e4721e2acc7` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:44.330086 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd17e8c4aa24960a8b46e4721e2acc7)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:44.331953 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:44.411416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'request_id': 'req-ff41cf18-519f-4522-9a6a-90fef048dfc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.416758 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'request_id': 'req-ff41cf18-519f-4522-9a6a-90fef048dfc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.480303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd17e8c4aa24960a8b46e4721e2acc7', 'request_id': 'req-ff41cf18-519f-4522-9a6a-90fef048dfc3'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.491832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] The token cache is being invalidate because project bfd17e8c4aa24960a8b46e4721e2acc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:29:44.493065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.493065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.494283 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4346/8726] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:29:44 2022] DELETE /identity/v3/projects/bfd17e8c4aa24960a8b46e4721e2acc7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:29:44.498400 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:44.499787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:44.512905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f5da9-92a0-4ed8-818d-4bb05e8825b1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:44.568708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:44.569324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:44.569628 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:44.569901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] PATH_INFO: `/v3/users/f4d1fd8ed3534095b10860a1b0c0c7bf` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:44.571017 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d1fd8ed3534095b10860a1b0c0c7bf)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:44.572927 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:44.594237 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:44.769523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d1fd8ed3534095b10860a1b0c0c7bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.834900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d1fd8ed3534095b10860a1b0c0c7bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.835529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d1fd8ed3534095b10860a1b0c0c7bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.847724 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d1fd8ed3534095b10860a1b0c0c7bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.854610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e1e36e95-edeb-42e4-90f3-c261857afa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d1fd8ed3534095b10860a1b0c0c7bf'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:44.861061 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4381/8727] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:29:44 2022] DELETE /identity/v3/users/f4d1fd8ed3534095b10860a1b0c0c7bf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:29:45.111532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.112733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:45.127374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41cf18-519f-4522-9a6a-90fef048dfc3 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.184247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.185412 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.185687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.185952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] PATH_INFO: `/v3/projects/7724623dc42e4639a8e3849d375b83a4` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.187047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7724623dc42e4639a8e3849d375b83a4)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.188976 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.297950 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:45.309503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7724623dc42e4639a8e3849d375b83a4', 'request_id': 'req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:45.314831 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7724623dc42e4639a8e3849d375b83a4', 'request_id': 'req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:45.389465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7724623dc42e4639a8e3849d375b83a4', 'request_id': 'req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:45.401276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] The token cache is being invalidate because project 7724623dc42e4639a8e3849d375b83a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82036) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:29:45.401587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:45.402215 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-e7ee25f5-1718-4bcb-9ee9-f89e168385b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:29:45.404309 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4347/8728] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:29:45 2022] DELETE /identity/v3/projects/7724623dc42e4639a8e3849d375b83a4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:29:45.409324 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.409633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.409932 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.430144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:45.431326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:45.489844 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4382/8729] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:29:45.497554 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.497839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.498113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.517755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:45.518951 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:45.526769 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4348/8730] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:29:45.531529 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.541055 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631104-7f0a-4d79-887a-17dce80181bd None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.545555 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.546135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.546410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.546676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.547309 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82035) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:29:45.547606 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.549446 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.560673 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4383/8731] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:29:45.564973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.574144 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce07a3-09d2-47d0-8d77-756e2af4c18b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.579217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.579805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.580084 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.580356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.580985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.582893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.659191 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4349/8732] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:29:45 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:29:45.663493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.673804 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72c20-985b-4d7f-b81f-540bbce420c2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.728950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.729575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.729854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.730122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.730744 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.732677 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.805961 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4384/8733] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:29:45 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:29:45.810607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.821202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0879-f0bb-4b1f-9510-124e0aa2ab88 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.826458 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.827047 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.827323 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.827597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.828254 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.829888 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.839585 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4350/8734] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:29:45.843353 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.853204 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98527e5-6d43-4f1b-b164-dcb537508c3a admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.857772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.858354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.858637 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.858904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.859530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.861221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34cd67f-1f7d-4b19-869d-57935b5a4ae0 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.871663 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4385/8735] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:29:45.875993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:45.886130 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc840e-b1e0-421b-90b4-e33ada3e1b2a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:45.891434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:45.892078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:45.892359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:45.892654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] PATH_INFO: `/v3/projects/6305db1090aa4559b92d87c1dbca1443/users/a75d2920b15d4f8fa293477d6cebba8c/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:45.907191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305db1090aa4559b92d87c1dbca1443, user_id=a75d2920b15d4f8fa293477d6cebba8c, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:45.909931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:45.995051 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4351/8736] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:29:45 2022] PUT /identity/v3/projects/6305db1090aa4559b92d87c1dbca1443/users/a75d2920b15d4f8fa293477d6cebba8c/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:29:46.000616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9475d7-9a04-49f4-955e-39d44d0ae402 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:46.000900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9475d7-9a04-49f4-955e-39d44d0ae402 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:46.001221 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9475d7-9a04-49f4-955e-39d44d0ae402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:46.009763 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:46.022130 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-6b9475d7-9a04-49f4-955e-39d44d0ae402 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:46.023347 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6b9475d7-9a04-49f4-955e-39d44d0ae402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:46.081688 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4386/8737] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:29:46.092941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:46.094654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:46.151072 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbdce2-4258-4d4f-bd54-07af1e080c63 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:46.154843 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:46.158933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:46.158933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:46.158933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:46.165193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:46.166576 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:46.176784 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4352/8738] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:29:51.050403 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86784-b859-4121-82dc-b21970468542 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.051352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86784-b859-4121-82dc-b21970468542 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.051805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf86784-b859-4121-82dc-b21970468542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.087239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-fdf86784-b859-4121-82dc-b21970468542 None None] MFA Rules not processed for user `a75d2920b15d4f8fa293477d6cebba8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:51.087239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-fdf86784-b859-4121-82dc-b21970468542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:51.164943 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4387/8739] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:29:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:29:51.166258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.176989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34f6eb-0d0d-4cfd-b83e-895f8b197a99 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.181785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.182389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.182696 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.182972 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] PATH_INFO: `/v3/projects` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.183597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.186048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.295331 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4353/8740] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:29:51 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:29:51.299790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86784-b859-4121-82dc-b21970468542 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.311808 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf86784-b859-4121-82dc-b21970468542 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.370695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.371328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.371605 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.371881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.373077 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.375098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.475874 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4388/8741] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:29:51 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:29:51.479813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.490309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33197be-65b4-48e2-9c91-79773024afac admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.495125 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.495716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.496009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.496263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.497309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.499347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.509544 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4354/8742] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:29:51.515950 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.526464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf26ef7-2947-49d8-9760-4bce5a8035b5 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.531859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.532609 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.532987 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.533398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] PATH_INFO: `/v3/projects/244a01b31b6c43baaa5fd172222a8fd5/users/369331403c02463ca15181a997a9a6e5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.548992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=244a01b31b6c43baaa5fd172222a8fd5, user_id=369331403c02463ca15181a997a9a6e5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.551760 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.625290 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:51.630016 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4389/8743] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:29:51 2022] PUT /identity/v3/projects/244a01b31b6c43baaa5fd172222a8fd5/users/369331403c02463ca15181a997a9a6e5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:29:51.633933 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.644710 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c89984-30a7-46a8-be4c-809f8d3fd70a admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.669870 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:51.703776 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.704382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.704657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.704927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.705585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.707202 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730c10-073f-42bd-972d-9c3eb4367160 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.718347 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4355/8744] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:29:51.722451 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:51.733354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19f6b-c108-4bb4-8f03-5da10c11e60b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:51.738319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:51.738979 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:51.739261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:51.739534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] PATH_INFO: `/v3/projects/244a01b31b6c43baaa5fd172222a8fd5/users/369331403c02463ca15181a997a9a6e5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:51.741475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=244a01b31b6c43baaa5fd172222a8fd5, user_id=369331403c02463ca15181a997a9a6e5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:51.744461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad536ec-54c0-4ebb-be61-31c3ad152b5b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:51.758175 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4390/8745] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:29:51 2022] PUT /identity/v3/projects/244a01b31b6c43baaa5fd172222a8fd5/users/369331403c02463ca15181a997a9a6e5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:29:57.665473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:57.665975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:57.667748 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:57.697612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] MFA Rules not processed for user `369331403c02463ca15181a997a9a6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:57.698842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:57.771581 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4356/8746] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:29:57.824647 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc446e-5c87-4b39-bf0c-d483313917f0 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:57.825705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc446e-5c87-4b39-bf0c-d483313917f0 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:57.825914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc446e-5c87-4b39-bf0c-d483313917f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:57.882878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-34dc446e-5c87-4b39-bf0c-d483313917f0 None None] MFA Rules not processed for user `82ec9bbb37ef44fe8cf300e8f298498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:57.884119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-34dc446e-5c87-4b39-bf0c-d483313917f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:57.956556 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4391/8747] 10.222.0.13 () {58 vars in 1059 bytes} [Sun Oct 30 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:29:57.962919 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:57.972460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70a57-afce-4634-b1dd-81486e4aa53b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:57.976166 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:57.976763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:57.977040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:57.977316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:58.034316 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:58.035742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:58.045491 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4357/8748] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:29:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:29:58.395322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe839-d1e2-44b8-97a2-bdb21f87100f None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:58.395681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe839-d1e2-44b8-97a2-bdb21f87100f None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:58.395900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fe839-d1e2-44b8-97a2-bdb21f87100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:58.452901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e83fe839-d1e2-44b8-97a2-bdb21f87100f None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:29:58.454142 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e83fe839-d1e2-44b8-97a2-bdb21f87100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:58.521070 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4392/8749] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:29:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:29:58.667450 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:29:58.668946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:29:58.723039 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=100 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:29:58.763292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675b660-0a29-4d25-8f81-e7f81b8ba6dc service glance] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:29:58.768598 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:29:58.769208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:29:58.769514 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:29:58.769785 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:29:58.778249 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:29:58.779844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7d28f-6463-413d-92ad-ef324bd0c053 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:29:58.788122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4358/8750] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:30:08.518235 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.758845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:08.759134 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:08.759413 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:08.780117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] MFA Rules not processed for user `a75d2920b15d4f8fa293477d6cebba8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:30:08.781308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:08.785113 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=20 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:08.788239 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4393/8751] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:30:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:30:11.999718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:12.000191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:12.000291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:12.020673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:30:12.021903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:12.029085 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4359/8752] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:30:12.041667 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:30:12.054061 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a3e3-19f9-466f-a92c-a228271a7198 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:30:12.058985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:30:12.059581 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:12.059858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:12.060126 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:12.068942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:30:12.070575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:30:12.079435 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4394/8753] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:30:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:30:20.006129 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:30:20.007842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:20.070508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbcd3e-ebdd-40db-b157-96c06a488189 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:30:20.074035 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:30:20.074636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:20.074912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:20.075184 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:20.076986 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:20.086695 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:30:20.088120 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:30:20.096367 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4360/8754] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:30:20.820931 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:30:20.822980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:21.038518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd48980-ded5-4497-b6ac-7fab07331baf service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:30:21.044122 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:30:21.044729 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:21.045007 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:21.045277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:21.047040 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:21.060602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:30:21.062876 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:30:21.074530 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4395/8755] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:30:30.092633 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=29 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:31.069257 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=43 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:37.324309 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:30:37.325790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:37.396287 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5766-8df4-463a-8394-3aa1c8900eeb service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:30:37.401247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:30:37.405728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:37.405728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:37.405728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:37.405728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:30:37.415883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:30:37.417501 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:30:37.428741 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4361/8756] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:30:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:30:46.793273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:30:46.802835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433ce9d-c8fe-4be5-a5cb-06aa67d38df2 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:30:46.806396 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:30:46.806985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:30:46.807255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:30:46.807518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:30:46.816593 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:30:46.818057 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:30:46.827368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4396/8757] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:30:47.424903 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=32 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:30:56.823219 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:31:25.428781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:31:25.430469 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:31:25.443512 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad0864-3a1e-4990-b8b2-2f78b62e3cd5 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:31:25.448513 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:31:25.449103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:31:25.449402 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:31:25.449679 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:31:25.451291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:31:25.463135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:31:25.464682 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:31:25.474274 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4362/8758] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:31:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:31:35.470159 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:39.675558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:33:39.710879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d250b1-1bec-4e6e-a91c-f68629642267 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:33:39.714506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:33:39.715603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:39.715878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:39.716145 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:39.717877 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:39.763000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:33:39.764415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:33:39.784221 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4397/8759] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:33:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:33:40.245930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:33:40.247802 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:40.352946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51294141-f7c3-40be-bc3f-1d596e28414e service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:33:40.360329 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:33:40.361481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:40.361768 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:40.362497 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:40.364903 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:40.377597 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:33:40.379318 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a923b8-0c61-4264-bb5c-61e72aac31cd service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:33:40.392016 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4363/8760] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:33:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:33:49.781530 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=35 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:50.387747 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=28 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:33:52.074802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:33:52.083299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89cb1-8ea2-442d-910c-32d0b199bc53 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:33:52.086831 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:33:52.087411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:52.087686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:52.087949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:52.089644 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:52.102334 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:33:52.103725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:33:52.114764 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4398/8761] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:33:54.554066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed9506-33b8-42fa-af12-932503347a66 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:54.554508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed9506-33b8-42fa-af12-932503347a66 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:54.554630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed9506-33b8-42fa-af12-932503347a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:54.574683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-d3ed9506-33b8-42fa-af12-932503347a66 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:33:54.579517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d3ed9506-33b8-42fa-af12-932503347a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:54.583139 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4364/8762] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:33:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:33:54.623245 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:33:54.634300 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be5642-05f5-45dc-8f36-fd335d4ba78a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:33:54.639189 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:33:54.639776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:54.640054 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:54.640320 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:54.648181 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:33:54.649769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:33:54.658182 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4399/8763] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:33:55.704276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f01-a1fe-4aff-9dc6-2b4d4b3356df None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:55.704754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f01-a1fe-4aff-9dc6-2b4d4b3356df None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:55.704859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37448f01-a1fe-4aff-9dc6-2b4d4b3356df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:55.723876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-37448f01-a1fe-4aff-9dc6-2b4d4b3356df None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:33:55.725060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-37448f01-a1fe-4aff-9dc6-2b4d4b3356df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:33:55.732282 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4365/8764] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:33:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:33:55.744271 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:33:55.755212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7b04-9b99-4ce8-9864-0cd056fcfde0 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:33:55.760153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:33:55.760775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:33:55.761048 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:33:55.761313 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:33:55.770383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:33:55.773010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:33:55.780064 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4400/8765] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:33:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:34:05.712784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:05.713299 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:05.713460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:05.718519 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:05.734191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] MFA Rules not processed for user `a75d2920b15d4f8fa293477d6cebba8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:34:05.735390 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:05.742207 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4366/8766] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:34:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:34:05.776685 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=18 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:06.005682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:34:06.015335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddb78b-65fb-45ca-b9bc-2d529b5c8286 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:34:06.019123 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:34:06.019716 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:06.019992 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:06.020260 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:06.022062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:06.044314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:34:06.045751 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70951fbc-6662-4c1b-865a-c0fd57a68659 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:34:06.054059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4401/8767] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:34:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:34:06.428143 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:34:06.450560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fecc0-4d7a-4dd9-b17e-fe3ecb021981 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:34:06.455473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:34:06.456075 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:06.456353 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:06.456629 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:06.458370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:06.485258 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:34:06.492783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:34:06.496711 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4367/8768] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:34:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:34:08.912860 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:08.913733 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:08.914006 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:08.933419 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:34:08.935155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:08.942528 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4402/8769] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:34:08.955663 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:34:08.967367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2da13-21bc-4291-9f06-a8249a1e77aa service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:34:08.973042 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:34:08.973697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:08.973971 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:08.974241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:08.982602 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:34:08.984160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:34:08.992509 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4368/8770] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:34:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:34:18.799322 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:34:18.808703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799d01f-ef40-43dd-9b6f-1b89d24b27b6 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:34:18.823222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:34:18.823222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:18.823222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:18.823222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:18.823666 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:18.824728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:34:18.826175 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:34:18.834064 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4403/8771] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:34:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:34:18.989099 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=24 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:25.200471 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:34:25.213592 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f014bd7-8817-44fa-9dd6-1cea3f56926f service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:34:25.220441 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:34:25.221097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:34:25.221404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:34:25.221678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:34:25.223490 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:34:25.236234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:34:25.237836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:34:25.248756 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4369/8772] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:34:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:34:28.830512 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=20 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:34:35.244196 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:01.702592 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:35:01.715547 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb8aa-144e-411a-a108-0e486a6a12fd service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:35:01.721119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:35:01.721737 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:35:01.722014 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:35:01.722281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:35:01.729867 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:35:01.731786 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4bf31-8742-46ec-ad77-b5cacc78a81c service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:35:01.741223 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4404/8773] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:35:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:35:11.736980 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:35:41.295167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:35:41.306729 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834827-2125-436c-af16-91d44e16e85d service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:35:41.311813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:35:41.312414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:35:41.312694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:35:41.312967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:35:41.321385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:35:41.322942 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:35:41.333183 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4370/8774] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:35:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:35:51.328495 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:07.027365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:07.027994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:07.027994 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:07.058948 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:07.060128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:07.067243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4405/8775] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:07.107045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:07.118999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611c54e-9798-4feb-aea3-35025aef2987 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:07.124194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:07.124783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:07.125059 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:07.125328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:07.133507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:07.135058 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:07.142973 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4371/8776] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:36:07.991328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:08.000842 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015ead3-73e5-4c63-999e-151e3b8af6ab None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:08.004295 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:08.005559 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:08.005838 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:08.006105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:08.073993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:08.075344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:08.093704 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4406/8777] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:11.559770 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:11.571429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb895-e479-415e-95d2-a57988ec6379 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:11.576499 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:11.579727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:11.579727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:11.579727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:11.579727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:11.592675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:11.594475 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:11.615917 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4372/8778] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:15.251791 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:15.263953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a3bd7-2f8c-4af7-8f86-53a0513d7907 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:15.268870 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:15.269492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:15.269769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:15.270035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:15.272438 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:15.284051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:15.285635 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:15.296295 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4407/8779] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:36:15.388870 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:15.400532 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed99587-9525-4324-9b25-af6495b2dc53 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:15.405194 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:15.405845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:15.406121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:15.406388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] PATH_INFO: `/v3/users/a75d2920b15d4f8fa293477d6cebba8c` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:15.407482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75d2920b15d4f8fa293477d6cebba8c)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:15.409397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:15.583476 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75d2920b15d4f8fa293477d6cebba8c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:15.584082 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75d2920b15d4f8fa293477d6cebba8c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:15.591530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75d2920b15d4f8fa293477d6cebba8c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:15.592159 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75d2920b15d4f8fa293477d6cebba8c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:15.663197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75d2920b15d4f8fa293477d6cebba8c'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:15.682755 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4373/8780] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:36:15 2022] DELETE /identity/v3/users/a75d2920b15d4f8fa293477d6cebba8c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:36:15.893139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:15.904119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175a40-d1bf-415b-a4af-7743a1773e6b service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:15.961941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:15.962560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:15.962843 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:15.963115 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] PATH_INFO: `/v3/projects/6305db1090aa4559b92d87c1dbca1443` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:15.964239 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6305db1090aa4559b92d87c1dbca1443)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:15.966155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:16.079973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6305db1090aa4559b92d87c1dbca1443', 'request_id': 'req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.081634 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:16.170955 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6305db1090aa4559b92d87c1dbca1443', 'request_id': 'req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.177621 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6305db1090aa4559b92d87c1dbca1443', 'request_id': 'req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.200681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] The token cache is being invalidate because project 6305db1090aa4559b92d87c1dbca1443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:36:16.200966 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.201617 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.203075 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4408/8781] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:36:15 2022] DELETE /identity/v3/projects/6305db1090aa4559b92d87c1dbca1443 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:36:16.207234 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:16.208604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:16.222116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2e606-e3bd-4033-aa72-1a90dafdfc51 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:16.277242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:16.277928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:16.278208 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:16.278481 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] PATH_INFO: `/v3/users/369331403c02463ca15181a997a9a6e5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:16.279630 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369331403c02463ca15181a997a9a6e5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:16.281622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:16.452218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369331403c02463ca15181a997a9a6e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.452881 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369331403c02463ca15181a997a9a6e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.454000 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:16.460769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369331403c02463ca15181a997a9a6e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.461492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369331403c02463ca15181a997a9a6e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.547690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-34ae9b17-32f3-4bd5-bdd1-a90cf7fa2503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369331403c02463ca15181a997a9a6e5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:16.565104 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4374/8782] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:36:16 2022] DELETE /identity/v3/users/369331403c02463ca15181a997a9a6e5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:36:16.811330 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:16.814736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:16.827816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b7ce4-2f90-4b2c-add6-cdbc1f76bc75 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:16.886165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:16.886789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:16.887086 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:16.887356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] PATH_INFO: `/v3/projects/244a01b31b6c43baaa5fd172222a8fd5` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:16.889119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244a01b31b6c43baaa5fd172222a8fd5)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:16.890381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:16.987732 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244a01b31b6c43baaa5fd172222a8fd5', 'request_id': 'req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:17.062517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244a01b31b6c43baaa5fd172222a8fd5', 'request_id': 'req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:17.069428 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244a01b31b6c43baaa5fd172222a8fd5', 'request_id': 'req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:17.079906 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] The token cache is being invalidate because project 244a01b31b6c43baaa5fd172222a8fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:36:17.080193 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:17.080840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-be613df8-5b16-4ddf-9d93-6641e2fe7cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:36:17.082382 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4409/8783] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:36:16 2022] DELETE /identity/v3/projects/244a01b31b6c43baaa5fd172222a8fd5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:36:17.087569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.087854 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.088128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.144967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:17.146534 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:17.204054 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4375/8784] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:17.211698 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.211984 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.212258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.231573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:17.232766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:17.241059 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4410/8785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:17.245267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.254759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d75371-3788-4565-83e9-aec8dc13e814 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.259860 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.260444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.260719 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.260989 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.261657 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:36:17.261956 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.263529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.274731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4376/8786] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:36:17.278811 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.288534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b143f-140d-44cf-adf4-283c58396004 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.293146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.293832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.294107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.294522 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.295153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.297278 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.424425 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4411/8787] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:36:17.429408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.439587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e3b6-353a-49d0-bc8a-6cdef6f33b3d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.494370 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.495040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.495231 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.495503 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.496123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.498050 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.594942 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4377/8788] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:36:17.599121 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.610091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce2b41-c206-4d48-b24d-67df86e80dfe admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.614704 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.615953 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.616234 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.616506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.617141 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.618753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.628467 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4412/8789] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:36:17.632327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.642297 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821d90-d13a-4750-82e4-8bbd15451839 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.647399 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.647988 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.648269 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.648544 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.649177 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.650805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddded34-2690-40c6-8107-bb4e7998e1dc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.656080 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:17.661736 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4378/8790] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:36:17.666687 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.676921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0da6-7d2e-46e8-ada3-6334d7e45f21 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:17.681823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:17.682461 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.682739 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.683010 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] PATH_INFO: `/v3/projects/4a813c90e3ec437fbf1f37dbb2b340d4/users/ef194f895a0c404abc08cad62a3b566d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.686783 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:17.698033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a813c90e3ec437fbf1f37dbb2b340d4, user_id=ef194f895a0c404abc08cad62a3b566d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:17.700669 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:17.823884 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4413/8791] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:36:17 2022] PUT /identity/v3/projects/4a813c90e3ec437fbf1f37dbb2b340d4/users/ef194f895a0c404abc08cad62a3b566d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:36:17.834998 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:17.835321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:17.835613 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:17.862880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:17.864062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:17.929666 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4379/8792] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:17.934119 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:17.998341 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87cbf-2567-4685-9896-61c20b96732b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.003359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.004072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.004262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.004516 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.005200 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.008067 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.194241 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4414/8793] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:36:17 2022] POST /identity/v3/projects => generated 393 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:36:18.198088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.209449 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7aca-af47-458a-a7a9-b8b1cdaa3d31 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.266094 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.266716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.266996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.267340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.267962 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.269894 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.355021 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4380/8794] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:36:18 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:36:18.358814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.369888 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946b6c-92f5-4082-b385-3a37a74536f1 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.374645 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.375242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.375521 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.375792 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.376424 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.378047 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.388599 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4415/8795] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:36:18.393211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.403237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db2bc9-fb19-4f24-a653-fd2964eb77dc admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.407783 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.408416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.408690 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.408955 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] PATH_INFO: `/v3/projects/d1ed3e4607924215bd8d372f849bfd20/users/b6d02f9095544c4b9d3abecd369cb132/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.424654 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed3e4607924215bd8d372f849bfd20, user_id=b6d02f9095544c4b9d3abecd369cb132, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.427367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.485598 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4381/8796] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:36:18 2022] PUT /identity/v3/projects/d1ed3e4607924215bd8d372f849bfd20/users/b6d02f9095544c4b9d3abecd369cb132/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:36:18.489478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.499361 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69acb84-5e1d-4f1f-8936-6db3f5d9f0c8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.555140 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.555743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.556023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.556294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.556921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.558537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b8f50-21bc-4b71-a14e-4e782ec95239 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.568053 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4416/8797] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:36:18.572279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.582641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cc36-7a74-476d-a099-106a6a060c8b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.587824 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.588466 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.588741 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.589013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] PATH_INFO: `/v3/projects/d1ed3e4607924215bd8d372f849bfd20/users/b6d02f9095544c4b9d3abecd369cb132/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.590961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ed3e4607924215bd8d372f849bfd20, user_id=b6d02f9095544c4b9d3abecd369cb132, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.593603 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.604177 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4382/8798] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:36:18 2022] PUT /identity/v3/projects/d1ed3e4607924215bd8d372f849bfd20/users/b6d02f9095544c4b9d3abecd369cb132/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:36:18.613660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.613949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.614225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.641359 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] MFA Rules not processed for user `b6d02f9095544c4b9d3abecd369cb132`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:18.642554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:18.685487 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:18.709610 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4417/8799] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:36:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:18.731451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:18.731451 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:18.774808 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:18.819328 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71a446-cde9-4b70-ba32-416978dd9c3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:18.825112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:18.825750 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:18.826027 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:18.826300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:18.880508 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:18.883283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d4f99-bcb3-4247-8b8b-a0a8d81c3bb2 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:18.892340 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4383/8800] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:24.092741 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:24.094317 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:24.151151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4c1d8-a558-4e2c-9b2a-7e113aada6b4 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:24.154627 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:24.155228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:24.155504 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:24.155770 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:24.165319 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:24.166776 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:24.176501 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4418/8801] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:36:27.658716 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:27.659242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:27.659242 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:27.685354 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:36:27.686617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:27.694927 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4384/8802] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:36:28.469135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:28.470885 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:28.570364 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3ce45-0ff3-4aa7-9f34-0a608391abca service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:28.576602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:28.578037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:28.578037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:28.578037 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:28.579586 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:28.593460 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:28.596082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:28.607244 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4419/8803] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:31.447383 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:31.460599 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb259f04-6404-4260-970e-fbe4bcc1ffd8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:31.465560 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:31.466175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:31.466456 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:31.466715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:31.468434 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:31.481271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:31.482883 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:31.493726 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4385/8804] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:32.052847 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:32.054857 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:32.066160 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551344d-e7a3-4d23-a910-a287234d5c08 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:32.070378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:32.071033 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:32.071329 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:32.071618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:32.073280 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:32.083083 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:32.084566 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc4fc4-53e2-4144-a3de-5e41befa95ee service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:32.093171 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4420/8805] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:32.881537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:36:32.896446 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54292ca1-9512-4d40-8122-c315373a8dd4 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:36:32.903288 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:36:32.903901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:36:32.904183 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:36:32.904454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:36:32.906195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:36:32.919759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:36:32.921672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:36:32.932645 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4386/8806] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:36:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:36:42.089131 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=73 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:36:42.927882 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=60 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:32.419356 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:37:32.419961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:37:32.419961 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:37:32.440934 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:37:32.442184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:37:32.450243 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4421/8807] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:37:32.819509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:37:32.830061 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b25694-4a9d-4d6a-a085-6a9e878057f0 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:37:32.834246 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:37:32.835164 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:37:32.835452 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:37:32.835827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:37:32.838865 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:37:32.849675 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:37:32.851102 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:37:32.861365 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4387/8808] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:37:42.434216 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:37:42.857007 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:08.545536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:39:08.547042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:08.567873 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849087a0-41f0-4c5b-9012-e1ff5b86a4ed None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:39:08.573712 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:39:08.587099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:08.587099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:08.587099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:08.587099 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:08.591676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:39:08.593176 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:39:08.604401 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4422/8809] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:39:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:39:08.929683 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:39:08.939015 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76c0a2-6a75-40a6-b668-c39d4f389ee1 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:39:08.942791 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:39:08.947836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:08.947836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:08.947836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:08.947836 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:08.959772 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:39:08.961191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9d59-b9d4-459c-a1c9-1bf45e227f6f service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:39:08.972575 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4388/8810] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:39:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:39:10.158899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:39:10.168921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47971c-e729-4bc5-a525-7d1984ddd9a2 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:39:10.173425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:39:10.174049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:10.174316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:10.174584 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:10.176298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:10.190915 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:39:10.192342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:39:10.204106 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4423/8811] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:39:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:39:18.967495 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:20.199404 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:24.557672 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:24.558191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:24.558459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:24.579861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:39:24.581098 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:24.588758 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4389/8812] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:39:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:39:28.402349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:39:28.412351 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ae911-2af5-4a1c-b066-6b1754d48fdf service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:39:28.416255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:39:28.416854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:28.417251 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:28.417465 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:28.419603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:28.429597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:39:28.430995 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:39:28.438881 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4424/8813] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:39:34.561276 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:39:34.573832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017c375-b70a-4aa1-bbc4-74d33f8b9f4f None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:39:34.579180 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:39:34.579754 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:39:34.580048 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:39:34.580282 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:39:34.582028 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:39:34.595188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:39:34.596808 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d56145-a5c0-48e9-9c83-cecdc6bb743a service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:39:34.607500 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4390/8814] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:39:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:39:38.435394 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:39:44.602991 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:07.179789 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:07.188425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff76-f259-4321-8fc3-befa5c560ee9 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:07.192707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:07.193293 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:07.193597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:07.193866 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:07.195616 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:07.205850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:07.207279 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:07.215115 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4425/8815] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:40:07.643914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578010-6889-45aa-b5fd-7b1e47e1f9a6 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:07.646575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578010-6889-45aa-b5fd-7b1e47e1f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:07.646575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578010-6889-45aa-b5fd-7b1e47e1f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:07.681790 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-13578010-6889-45aa-b5fd-7b1e47e1f9a6 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:40:07.682990 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-13578010-6889-45aa-b5fd-7b1e47e1f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:07.690235 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4391/8816] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:40:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:40:07.702252 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:07.711146 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efafb-da18-4524-81d5-35fd963957ee service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:07.714818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:07.721003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:07.721003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:07.721003 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:07.723262 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:07.724682 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:07.732813 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4426/8817] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:40:07.873680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880b03-f902-44ad-9b5b-c7213d04f390 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:07.873963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880b03-f902-44ad-9b5b-c7213d04f390 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:07.874240 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c880b03-f902-44ad-9b5b-c7213d04f390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:07.912131 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2c880b03-f902-44ad-9b5b-c7213d04f390 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:40:07.913348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c880b03-f902-44ad-9b5b-c7213d04f390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:07.922172 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4392/8818] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:40:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:40:07.934166 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:07.946042 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba43c-de9a-4153-928c-7d09838e22e5 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:07.950883 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:07.951468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:07.951769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:07.952036 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:07.960135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:07.961725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:07.971776 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4427/8819] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:40:09.264195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:09.264631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:09.264745 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:09.301958 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:40:09.303158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:09.312362 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4393/8820] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:40:09.323394 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:09.332612 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11995814-ee81-4ca7-a958-bdc6759cb6a3 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:09.336081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:09.336660 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:09.336940 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:09.337202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:09.347392 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:09.348784 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:09.359157 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4428/8821] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:40:09.419667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:09.431700 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9756bc1-b1bd-4b3b-8922-548335377a65 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:09.436939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:09.441127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:09.441127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:09.441127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:09.441127 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:09.450995 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:09.452549 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:09.462201 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4394/8822] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:40:19.354670 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=24 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:19.458088 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=33 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:40:46.342365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:40:46.353552 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276bbb5-c5da-4faf-9dd1-712a949355ab service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:40:46.358603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:40:46.359220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:40:46.359498 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:40:46.359799 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:40:46.361550 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:40:46.373225 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:40:46.374816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:40:46.385283 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4429/8823] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:40:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:40:56.381026 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:15.552574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:41:15.563359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4342886-b9da-4907-9ba3-fd8d9477a179 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:41:15.568650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:41:15.569248 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:41:15.569563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:41:15.569840 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:41:15.571697 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:41:15.583409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:41:15.585043 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573df97-d87b-4bcc-b94a-8464a1e6c494 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:41:15.595680 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4395/8824] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:41:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:41:18.940654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:41:18.950197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f6c3-2760-47b6-98b9-5d4e69feed2e service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:41:18.954041 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:41:18.954642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:41:18.954942 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:41:18.955210 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:41:18.964074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:41:18.965523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:41:18.974338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4430/8825] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:41:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:41:24.386812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:41:24.387385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:41:24.389040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:41:24.410828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:41:24.412190 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:41:24.419640 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4396/8826] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:41:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:41:28.970302 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:34.405225 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:37.322753 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:41:37.332013 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773f03-2f42-4af8-bd74-b5e887e7ef32 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:41:37.335761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:41:37.336333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:41:37.336613 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:41:37.336881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:41:37.348120 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:41:37.349763 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:41:37.360668 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4431/8827] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:41:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:41:38.245074 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:41:38.258088 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f42062-0e47-49c5-bf46-da07841ebc97 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:41:38.263337 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:41:38.263941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:41:38.264310 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:41:38.264588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:41:38.274659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:41:38.276447 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e812e-6f82-49a0-a130-73ed9f195250 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:41:38.286516 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4397/8828] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:41:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:41:47.356104 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:41:48.282292 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:04.497676 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:43:04.512523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971da063-b0e9-4f0a-a1ef-83100bad2183 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:43:04.520435 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:43:04.521382 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:43:04.521668 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:43:04.521985 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:43:04.533212 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:43:04.536579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:43:04.548907 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4432/8829] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:43:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:43:14.543336 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:20.466373 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:43:20.466925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:43:20.466925 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:43:20.487930 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] MFA Rules not processed for user `ef194f895a0c404abc08cad62a3b566d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:43:20.489163 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:43:20.497897 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4398/8830] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:43:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:43:20.834723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:43:20.845409 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c071f-250b-439b-8ad7-f105f9e82501 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:43:20.849486 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:43:20.850229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:43:20.850611 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:43:20.850981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:43:20.859074 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:43:20.861202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:43:20.873541 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4433/8831] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:43:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:43:24.263909 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:43:24.274479 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eea7b-4740-410b-a1ba-f572ccb702d0 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:43:24.278492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:43:24.279112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:43:24.279394 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:43:24.279668 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:43:24.288507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:43:24.290279 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:43:24.298887 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4399/8832] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:43:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:43:30.866149 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:43:34.295101 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:09.584803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:09.621326 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f2a8-bf8b-43a8-8596-6676dadc6a59 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:09.624918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:09.625537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:09.625809 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:09.626072 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:09.656352 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:09.657832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:09.678651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4434/8833] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:10.860064 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:10.887659 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df060e-57f0-46e9-b326-62ad103a9a65 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:10.891338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:10.892464 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:10.892744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:10.893011 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:10.905167 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:10.906626 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:10.918297 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4400/8834] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:18.558514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:18.570220 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162f54-dd32-4d3e-8c02-9492eb333773 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:18.575642 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:18.576228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:18.576501 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:18.576768 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:18.586030 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:18.587561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9d541-f8f1-4b6d-8f34-a2133c6ed48b service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:18.597720 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4435/8835] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:20.913318 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=15 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:23.735265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:23.797520 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bf314-ba6a-4aee-9312-464543744522 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:23.804000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:23.804617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:23.804898 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:23.805170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] PATH_INFO: `/v3/users/ef194f895a0c404abc08cad62a3b566d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:23.806331 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef194f895a0c404abc08cad62a3b566d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:23.808230 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:23.988250 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef194f895a0c404abc08cad62a3b566d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:23.988907 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef194f895a0c404abc08cad62a3b566d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:23.996384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef194f895a0c404abc08cad62a3b566d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:23.997024 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef194f895a0c404abc08cad62a3b566d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.059083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef194f895a0c404abc08cad62a3b566d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.077318 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4401/8836] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:44:23 2022] DELETE /identity/v3/users/ef194f895a0c404abc08cad62a3b566d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:24.081981 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:24.082467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:24.082596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:24.110836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:24.112046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:24.170723 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4436/8837] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:24.181326 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:24.182733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:24.250565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4980e-53da-4b57-990f-29e2c09ae151 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:24.254313 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:24.254912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:24.255191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:24.255460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:24.264275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:24.265727 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:24.274969 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4402/8838] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:24.512836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:24.515133 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:24.527045 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa0b7-8a80-48cc-accb-563d549f82d5 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:24.531561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:24.532288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:24.532436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:24.532711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] PATH_INFO: `/v3/projects/4a813c90e3ec437fbf1f37dbb2b340d4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:24.533852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a813c90e3ec437fbf1f37dbb2b340d4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:24.536358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:24.629569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a813c90e3ec437fbf1f37dbb2b340d4', 'request_id': 'req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.715059 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a813c90e3ec437fbf1f37dbb2b340d4', 'request_id': 'req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.721718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a813c90e3ec437fbf1f37dbb2b340d4', 'request_id': 'req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.726285 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:24.733151 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] The token cache is being invalidate because project 4a813c90e3ec437fbf1f37dbb2b340d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:44:24.733472 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.734135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.735602 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4437/8839] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:44:24 2022] DELETE /identity/v3/projects/4a813c90e3ec437fbf1f37dbb2b340d4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:24.739608 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:24.749197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7e6f8-241f-440b-8daf-a726de07b46e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:24.756918 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:24.805195 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:24.805875 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:24.806158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:24.806429 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] PATH_INFO: `/v3/users/b6d02f9095544c4b9d3abecd369cb132` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:24.807530 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d02f9095544c4b9d3abecd369cb132)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:24.809445 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:24.987037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d02f9095544c4b9d3abecd369cb132'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.987688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d02f9095544c4b9d3abecd369cb132'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.995233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d02f9095544c4b9d3abecd369cb132'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:24.995859 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d02f9095544c4b9d3abecd369cb132'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.063584 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-0737fe18-c967-45ad-9041-6178b2fa8b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d02f9095544c4b9d3abecd369cb132'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.080857 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4403/8840] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:44:24 2022] DELETE /identity/v3/users/b6d02f9095544c4b9d3abecd369cb132 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:25.489393 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:25.492183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:25.506720 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee0997-068e-46d0-a7d3-bfbcc1dddbe8 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:25.566348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:25.566946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:25.567223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:25.567492 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] PATH_INFO: `/v3/projects/d1ed3e4607924215bd8d372f849bfd20` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:25.568595 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ed3e4607924215bd8d372f849bfd20)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:25.570530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:25.698708 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ed3e4607924215bd8d372f849bfd20', 'request_id': 'req-d1db575f-17fa-47de-a2cf-f32020085c35'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.767360 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ed3e4607924215bd8d372f849bfd20', 'request_id': 'req-d1db575f-17fa-47de-a2cf-f32020085c35'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.774381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ed3e4607924215bd8d372f849bfd20', 'request_id': 'req-d1db575f-17fa-47de-a2cf-f32020085c35'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.784711 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] The token cache is being invalidate because project d1ed3e4607924215bd8d372f849bfd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:44:25.785000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.785658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-d1db575f-17fa-47de-a2cf-f32020085c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:44:25.787158 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4438/8841] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:44:25 2022] DELETE /identity/v3/projects/d1ed3e4607924215bd8d372f849bfd20 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:25.792863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:25.793355 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:25.793482 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:25.813033 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:25.814969 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:25.873123 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4404/8842] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:25.882091 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:25.882456 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:25.882802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:25.903372 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:25.904610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:25.913038 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4439/8843] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:25.917703 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:25.927912 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23692270-2391-4a14-9cfd-bf8158770368 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:25.932491 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:25.933078 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:25.933388 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:25.933667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:25.934306 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:44:25.934607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:25.936189 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:25.947517 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4405/8844] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 30 02:44:25.951723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:25.960861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7bcf2-de36-42bd-a39d-c3b24ad7ea91 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:25.965495 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:25.966081 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:25.966357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:25.966626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:25.967247 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:25.969137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.106903 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4440/8845] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:44:25 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:44:26.111158 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:26.121368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4df1-05a9-4331-b933-99274d320323 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:26.133394 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:26.177037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:26.177715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.177996 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.178267 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.178895 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:26.180839 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.298951 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4406/8846] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:44:26 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:44:26.303199 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:26.313918 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609f02d-63ff-4dd2-904b-f5d5df76a218 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:26.318431 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:26.319019 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.319296 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.319565 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.320197 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:26.321852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.331519 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4441/8847] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:44:26.336006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:26.347095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afe3d8-038f-4231-87de-41d506a7e1be admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:26.352436 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:26.353066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.353358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.353655 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.354293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:26.355867 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ba463-c9f3-497b-93cd-6e6d00e988e9 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.366546 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4407/8848] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:44:26.370502 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:26.380832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6d00c-35be-40e3-8fd7-47a41692524f admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:26.385376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:26.386005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.386281 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.386548 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] PATH_INFO: `/v3/projects/d49c70393b0144a1a1e946fea78b47a9/users/4deb849d2b814e648cd1d84a82d1783d/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.401286 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49c70393b0144a1a1e946fea78b47a9, user_id=4deb849d2b814e648cd1d84a82d1783d, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:26.403960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.482442 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4442/8849] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:44:26 2022] PUT /identity/v3/projects/d49c70393b0144a1a1e946fea78b47a9/users/4deb849d2b814e648cd1d84a82d1783d/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:26.487812 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75287-f624-4b87-ad3e-6f56d9c9767b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.488101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75287-f624-4b87-ad3e-6f56d9c9767b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.488438 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f75287-f624-4b87-ad3e-6f56d9c9767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.509044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-86f75287-f624-4b87-ad3e-6f56d9c9767b None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:26.511217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-86f75287-f624-4b87-ad3e-6f56d9c9767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:26.570122 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4408/8850] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:26.579794 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:26.581658 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:26.603471 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:26.639348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e400227-38e8-45a2-b811-30b2c5b29765 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:26.642971 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:26.643567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:26.643840 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:26.644108 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:26.652895 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:26.654335 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:26.664270 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4443/8851] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:31.588893 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:31.589424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:31.589691 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:31.621667 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] MFA Rules not processed for user `4deb849d2b814e648cd1d84a82d1783d`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:31.622890 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:31.696430 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4409/8852] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:31.700577 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:31.716723 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160e527-257f-4edd-887f-07b3e1c65f9e service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:31.721929 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:31.723161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:31.725714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:31.725714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:31.725714 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:31.730135 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:31.815385 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4444/8853] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:44:31 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:44:31.819389 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:31.832494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0bdbe-156d-44db-92dd-6aa22a3a846d None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:31.867857 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:31.916699 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:31.917220 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:31.917538 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:31.917813 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:31.918448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:31.921410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:32.026731 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4410/8854] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:44:31 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:44:32.030780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:32.042563 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08fa0e-ccc0-4fd0-89bd-da60d46f4e2b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:32.048149 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:32.048936 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:32.049294 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:32.050209 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:32.051173 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:32.052899 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:32.071901 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4445/8855] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:44:32.076492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:32.089688 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83faa2-e1dd-4007-afea-b72495a8692d admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:32.096311 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:32.097000 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:32.097285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:32.097773 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] PATH_INFO: `/v3/projects/db33f81407f04dd598541a758fde653c/users/b9501738a0b946ee940a2a8ec9705cd5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:32.117721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db33f81407f04dd598541a758fde653c, user_id=b9501738a0b946ee940a2a8ec9705cd5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:32.120387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:32.173588 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4411/8856] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:44:32 2022] PUT /identity/v3/projects/db33f81407f04dd598541a758fde653c/users/b9501738a0b946ee940a2a8ec9705cd5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:44:32.177675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:32.188467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd284-7e54-4fda-81d4-d116e67807a9 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:32.259391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:32.259391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:32.259391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:32.259391 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:32.259874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:32.259874 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9365be-e74d-4c10-82c4-63c306519311 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:32.269178 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4446/8857] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:44:32.273845 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:32.284721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbfe75-d8b9-4504-8d32-c20ec5c42adb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:32.290489 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:32.291175 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:32.291454 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:32.291733 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] PATH_INFO: `/v3/projects/db33f81407f04dd598541a758fde653c/users/b9501738a0b946ee940a2a8ec9705cd5/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:32.293722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db33f81407f04dd598541a758fde653c, user_id=b9501738a0b946ee940a2a8ec9705cd5, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:32.296339 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:32.307836 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4412/8858] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:44:32 2022] PUT /identity/v3/projects/db33f81407f04dd598541a758fde653c/users/b9501738a0b946ee940a2a8ec9705cd5/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:44:37.671509 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04db8b-f063-4830-80ae-1bde1a2cba9d None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:37.673683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04db8b-f063-4830-80ae-1bde1a2cba9d None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:37.673683 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04db8b-f063-4830-80ae-1bde1a2cba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:37.705222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-bd04db8b-f063-4830-80ae-1bde1a2cba9d None None] MFA Rules not processed for user `b9501738a0b946ee940a2a8ec9705cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:37.706499 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bd04db8b-f063-4830-80ae-1bde1a2cba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:37.784685 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4447/8859] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:37.801983 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:37.804029 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:37.924507 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46550c0-17e6-4b3c-86ff-5377ebe47ddb admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:37.932096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:37.932096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:37.932096 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:37.932744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:38.001049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:38.002753 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:38.013223 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4413/8860] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:40.535425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:40.536264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:40.536541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:40.558483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] MFA Rules not processed for user `4deb849d2b814e648cd1d84a82d1783d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:44:40.558483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:40.563923 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4448/8861] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:44:41.290386 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:41.292356 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:41.313492 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:41.391557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d099e-7f40-4065-a2bc-40f21f72cdfe service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:41.396991 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:41.397632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:41.397914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:41.398188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:41.400003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:41.412945 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:41.414844 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:41.426113 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4414/8862] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:44:44.256377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:44.262466 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:44:44.314477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b2ae1-0b44-4c00-8e3b-925908608a6a None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:44.318618 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:44.319206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:44.319479 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:44.319742 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:44.321470 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:44.331274 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:44.333399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:44.341321 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4449/8863] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:49.985978 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:49.987459 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:50.002805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5dcc62-11ec-4ed6-b874-c808a04e8f85 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:50.008886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:50.009510 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:50.009793 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:50.010066 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:50.011788 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:50.023414 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:50.024965 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:50.035624 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4415/8864] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:44:52.390910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:44:52.392327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:44:52.402980 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0472956-e523-4e52-9b4a-6f0df23465cb service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:44:52.406610 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:44:52.407191 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:44:52.407462 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:44:52.407726 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:44:52.417511 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:44:52.418949 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:44:52.428189 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4450/8865] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:44:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:45:00.030967 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=40 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:45:02.424006 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=30 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:45:52.232090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:45:52.233517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:45:52.247253 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158d5-eeed-4af6-8215-75955c26eeae service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:45:52.252423 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:45:52.253023 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:45:52.253304 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:45:52.253610 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:45:52.255286 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:45:52.266931 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:45:52.268494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ef29-e1fb-497c-a4ea-fe0306ad3187 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:45:52.278779 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4416/8866] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:45:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:46:02.274052 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:46:44.425815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:46:44.436652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f34733-704a-4e8c-811c-a844635a9a11 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:46:44.441542 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:46:44.442128 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:46:44.442401 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:46:44.442661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:46:44.444467 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:46:44.455575 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:46:44.457131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:46:44.467183 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4451/8867] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:46:54.462610 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:03.321886 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce668b7-4952-4d8e-820b-03be7d2d1ad1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:03.322463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce668b7-4952-4d8e-820b-03be7d2d1ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:03.322604 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce668b7-4952-4d8e-820b-03be7d2d1ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:03.384320 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-2ce668b7-4952-4d8e-820b-03be7d2d1ad1 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:47:03.386073 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2ce668b7-4952-4d8e-820b-03be7d2d1ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:03.457904 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4417/8868] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:47:03.584935 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:03.586370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:03.675348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b1bd-8402-4f3e-9787-a0de9f89c6ff service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:03.680387 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:03.680988 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:03.681299 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:03.681604 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:03.690399 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:03.691974 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:03.700755 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4452/8869] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:47:13.454876 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=47 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:13.696706 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=41 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:18.203973 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:18.204628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:18.204628 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:18.246997 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] MFA Rules not processed for user `1449e0ef893c420e93cf26910f4a6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:47:18.248197 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:18.257510 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4418/8870] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 30 02:47:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:47:18.273184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:18.273184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:18.350993 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf444390-8379-40c3-8154-4ebb2518a7f2 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:18.354946 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ec9bbb37ef44fe8cf300e8f298498f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:18.355551 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:18.355832 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:18.356105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:18.366588 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:18.368012 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:18.378765 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4453/8871] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:47:18.527993 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:18.537685 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668af786-7c4f-44f9-bf33-f70315add1c8 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:18.541227 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:18.541862 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:18.542138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:18.542409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:18.544119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:18.553548 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:18.554952 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:18.563394 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4419/8872] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:47:18.635681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:18.647011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7bcf6-45bf-474b-aed3-7071b3dc24a4 service glance] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:18.651377 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:18.651989 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:18.652268 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:18.652536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:18.654282 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:18.671063 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:18.673453 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaee274-6fd9-47c9-952b-e760fc6ff22a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:18.683240 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4454/8873] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:47:18.748650 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:18.760851 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a25fc2-81c6-4ba2-875c-22ff159a7a4e service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:18.767565 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:18.768265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:18.768448 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:18.768796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:18.770588 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:18.782335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:18.783678 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:18.793760 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4420/8874] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:47:22.291430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4c11-59c3-489c-8c72-a44a8a6f0ea4 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:22.292569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4c11-59c3-489c-8c72-a44a8a6f0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:22.292569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da4c11-59c3-489c-8c72-a44a8a6f0ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:22.312652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e3da4c11-59c3-489c-8c72-a44a8a6f0ea4 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:47:22.313878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e3da4c11-59c3-489c-8c72-a44a8a6f0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:22.320972 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4455/8875] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:47:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:47:22.332927 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:22.345300 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e783-a0d1-438a-b7df-9db80c07a1ae service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:22.350403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:22.351003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:22.351285 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:22.351563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:22.360480 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:22.362090 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:22.370300 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4421/8876] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:47:32.307583 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=44 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:32.366875 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=30 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:36.483545 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:36.484093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:36.484214 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:36.503834 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:47:36.505147 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:47:36.512344 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4456/8877] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:47:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:47:36.525041 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:47:36.536605 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8cf29-3781-49de-ac5a-eb3e88b318ed service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:47:36.541744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:47:36.542340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:47:36.542619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:47:36.542892 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:47:36.550941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:47:36.553013 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:47:36.560671 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4422/8878] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 30 02:47:46.497814 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:47:46.557280 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:48:47.721167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:48:47.739680 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fea4f4-784b-4bbf-b851-5e7cf620fbc9 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:48:47.745679 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:48:47.746161 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:48:47.746442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:48:47.746715 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:48:47.748488 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:48:47.763976 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:48:47.765803 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a08b6-eac6-4233-ba32-e0f999b18683 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:48:47.778161 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4457/8879] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:48:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:48:47.875160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:48:47.893999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675c5b-6448-4c8e-81ab-f2b46367c3ec service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:48:47.898999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:48:47.899580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:48:47.899861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:48:47.900157 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:48:47.902060 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:48:47.913113 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:48:47.914580 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:48:47.923614 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4423/8880] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:48:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:48:54.300740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:48:54.301235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:48:54.301376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:48:54.320596 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] MFA Rules not processed for user `4deb849d2b814e648cd1d84a82d1783d`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:48:54.321858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:48:54.328788 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4458/8881] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:48:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:48:57.919221 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:04.315196 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=9 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:15.086946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:15.088347 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:49:15.166660 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07dc8f2-67de-491e-9612-1674f24b25d6 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:15.170272 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135b054aaaae4c84b280fe4e9908e240', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:15.170866 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:15.181721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:15.181721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:15.181721 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:49:15.186642 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:15.188037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:15.199104 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4424/8882] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:49:15.478781 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:15.488062 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c143f-5122-4f3a-957f-964db465830c None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:15.491538 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:15.492153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:15.492430 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:15.492695 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:15.494404 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:49:15.503633 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:15.505049 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:15.513504 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4459/8883] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:49:16.207820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:16.217569 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58c98-fbc5-401a-a1e6-7e71f1bb234d service cinder] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:16.221247 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:16.221880 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:16.222188 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:16.222463 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:16.224361 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:49:16.238689 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:16.240063 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:16.251324 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4425/8884] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:49:25.510051 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:26.246251 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=41 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:37.673718 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:37.687297 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4877e1f-dab6-479b-9a19-4fa6151fb65a service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:37.692688 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:37.693273 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:37.693579 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:37.693850 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:37.701815 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:37.703384 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:37.712651 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4460/8885] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:49:39.978340 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:39.989485 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806f534-340d-4935-9a5d-1efa764d80de service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:39.996160 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:39.996756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:39.997032 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:39.997301 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:39.999156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:49:40.013467 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:40.015040 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:40.025979 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4426/8886] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:49:46.869796 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:49:46.880117 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec23bf-feaa-46ca-949f-9df484217e21 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:49:46.884211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:49:46.884959 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:49:46.885243 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:49:46.885569 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:49:46.893699 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:49:46.895144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:49:46.904368 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4461/8887] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:49:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:49:50.021280 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:49:56.900646 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:50:55.285967 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:50:55.296946 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5692d-6e98-4f00-ac4e-452e3f5d5bcf service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:50:55.301908 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:50:55.302494 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:50:55.302769 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:50:55.303037 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:50:55.311517 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:50:55.313239 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:50:55.323401 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4427/8888] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:50:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:51:05.319607 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:51:45.399845 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:51:45.414508 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d687b-2aad-4592-a824-4ab8f9c6d081 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:51:45.419381 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:51:45.419965 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:51:45.420241 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:51:45.420512 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:51:45.430639 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:51:45.432184 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:51:45.441844 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4462/8889] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:51:55.437735 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:21.994664 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:52:22.010639 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf5787-60da-40d8-8a22-036ff88b054a service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:52:22.016138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:52:22.016728 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:52:22.017003 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:52:22.017273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:52:22.026820 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:52:22.028343 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:52:22.039539 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4428/8890] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:52:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:52:22.805990 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:52:22.815269 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d9df-5a2c-44e8-b13b-6cd2a9e1bb8e service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:52:22.819196 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:52:22.819797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:52:22.820078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:52:22.820349 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:52:22.827968 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:52:22.829523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:52:22.838122 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4463/8891] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:52:22.927619 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:52:22.937677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4cf90-0953-4eeb-a122-543ecb2f9c97 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:52:22.941196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:52:22.941817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:52:22.942095 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:52:22.942369 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:52:22.952294 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:52:22.953744 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:52:22.964456 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4429/8892] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:52:23.028370 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:52:23.040913 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ece0c-68a3-417a-a4bd-e23ba1a9d8b5 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:52:23.045863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:52:23.046452 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:52:23.046730 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:52:23.047000 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:52:23.055167 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:52:23.057257 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:52:23.066787 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4464/8893] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:52:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:52:32.959805 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=12 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:52:33.062734 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:53:58.993874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:53:59.002335 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50976d5d-c253-485a-85dd-92c293aaf23b service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:53:59.006008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:53:59.006590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:53:59.006868 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:53:59.007141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:53:59.014121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:53:59.015526 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:53:59.023684 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4430/8894] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:53:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:09.019754 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:20.477311 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:20.559011 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfe8f8-d69f-4216-9f1c-fea568dd4763 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:20.564878 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:20.565518 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:20.565846 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:20.566215 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:20.576093 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:20.577769 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:20.588484 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4465/8895] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:20.855397 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:20.887327 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f75b-43f1-4c09-9957-4dc7ec6787e9 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:20.897731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:20.898367 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:20.898658 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:20.898929 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:20.911398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:20.924525 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:20.925495 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4431/8896] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:22.121205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:22.130333 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9378-e2c9-4d5a-a882-f4a183e4c72d service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:22.134703 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:22.135276 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:22.135554 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:22.135826 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:22.146308 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:22.147749 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:22.159309 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4466/8897] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:29.254211 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:29.255816 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:29.292504 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998cf1b-5289-4fa6-af2b-c36b21e6f797 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:29.296341 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:29.296944 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:29.297223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:29.297529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:29.299344 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:29.385416 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:29.386900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:29.406581 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4432/8898] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:54:32.154272 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=33 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:33.255344 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:33.261515 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ef6e-1da8-42ee-b025-6d391b658395 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:33.266416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:33.267005 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:33.267328 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:33.267597 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:33.269288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:33.281654 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:33.283223 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:33.293896 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4467/8899] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:37.160863 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:37.163045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:37.176092 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6343-9a03-451f-adf1-6ec83d9a3400 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:37.181566 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:37.182196 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:37.182473 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:37.182742 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] PATH_INFO: `/v3/users/4deb849d2b814e648cd1d84a82d1783d` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:37.196193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4deb849d2b814e648cd1d84a82d1783d)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:37.198134 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:37.369223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4deb849d2b814e648cd1d84a82d1783d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:37.369963 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4deb849d2b814e648cd1d84a82d1783d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:37.377123 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4deb849d2b814e648cd1d84a82d1783d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:37.377803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4deb849d2b814e648cd1d84a82d1783d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:37.379481 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:37.492045 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4deb849d2b814e648cd1d84a82d1783d'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:37.509874 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4433/8900] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:54:37 2022] DELETE /identity/v3/users/4deb849d2b814e648cd1d84a82d1783d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:37.777277 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:37.791168 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ff2e8-385f-45d4-b30d-b968a7f553e6 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:37.853481 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:37.854105 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:37.854383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:37.854652 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] PATH_INFO: `/v3/projects/d49c70393b0144a1a1e946fea78b47a9` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:37.866032 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49c70393b0144a1a1e946fea78b47a9)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:37.868095 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:37.978143 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49c70393b0144a1a1e946fea78b47a9', 'request_id': 'req-13cd8e31-6289-4e25-b280-9599a0aa7a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.044879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49c70393b0144a1a1e946fea78b47a9', 'request_id': 'req-13cd8e31-6289-4e25-b280-9599a0aa7a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.051697 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49c70393b0144a1a1e946fea78b47a9', 'request_id': 'req-13cd8e31-6289-4e25-b280-9599a0aa7a79'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.062314 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] The token cache is being invalidate because project d49c70393b0144a1a1e946fea78b47a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:54:38.062539 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.063163 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.064622 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4468/8901] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:54:37 2022] DELETE /identity/v3/projects/d49c70393b0144a1a1e946fea78b47a9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:38.069275 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:38.070698 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:38.083781 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c90d6-fbba-4c8d-8996-c2f446c2f0d0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:38.138739 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:38.139358 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:38.139637 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:38.139911 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] PATH_INFO: `/v3/users/b9501738a0b946ee940a2a8ec9705cd5` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:38.153646 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9501738a0b946ee940a2a8ec9705cd5)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:38.155563 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:38.361398 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9501738a0b946ee940a2a8ec9705cd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.362044 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9501738a0b946ee940a2a8ec9705cd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.369536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9501738a0b946ee940a2a8ec9705cd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.370237 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9501738a0b946ee940a2a8ec9705cd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.433707 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-c9d6f61e-75b2-49db-8288-d9c818e56db5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9501738a0b946ee940a2a8ec9705cd5'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.451992 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4434/8902] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:54:38 2022] DELETE /identity/v3/users/b9501738a0b946ee940a2a8ec9705cd5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:38.709818 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:38.711261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:38.723897 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8e31-6289-4e25-b280-9599a0aa7a79 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:38.780853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:38.781536 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:38.781782 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:38.782051 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] PATH_INFO: `/v3/projects/db33f81407f04dd598541a758fde653c` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:38.792725 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db33f81407f04dd598541a758fde653c)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:38.794661 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:38.796073 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:38.930255 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db33f81407f04dd598541a758fde653c', 'request_id': 'req-254a8801-5849-46a2-98e9-9c4921028f2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:38.999823 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db33f81407f04dd598541a758fde653c', 'request_id': 'req-254a8801-5849-46a2-98e9-9c4921028f2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:39.006917 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db33f81407f04dd598541a758fde653c', 'request_id': 'req-254a8801-5849-46a2-98e9-9c4921028f2a'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:39.017288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] The token cache is being invalidate because project db33f81407f04dd598541a758fde653c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:54:39.017603 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:39.018249 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-254a8801-5849-46a2-98e9-9c4921028f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:54:39.019725 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4469/8903] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:54:38 2022] DELETE /identity/v3/projects/db33f81407f04dd598541a758fde653c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:39.025271 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.025589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.026135 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.072838 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:39.074065 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:39.087191 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:39.132302 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4435/8904] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:54:39.140298 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.140587 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.140865 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.160686 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:39.161960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:39.170646 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4470/8905] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:54:39.174725 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.184338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbe6b-ba7a-44ed-bbe6-a877683577ca None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.189112 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.189752 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.190062 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.190359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.191002 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82036) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 30 02:54:39.191303 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.192928 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.204336 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4436/8906] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 30 02:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 30 02:54:39.208426 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.218075 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933df31-6e26-4112-a967-dc59d5e5d927 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.222641 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.223216 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.223493 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.223761 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.224383 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.226892 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.330146 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4471/8907] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:54:39 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:54:39.334186 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.344980 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78fe57-497a-4cfc-b13a-9cc6966bca3b admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.401861 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.402557 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.402722 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.402994 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.403607 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.405529 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.488578 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4437/8908] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:54:39 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:54:39.492395 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.503310 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c160850-8e77-4974-b000-9506351a349c admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.508489 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.509094 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.509406 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.510111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.510764 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.512365 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.523291 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4472/8909] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:54:39.527585 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.538019 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e794-77f3-4aea-a251-4adf92fde22e admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.542617 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.543207 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.543486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.543755 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.544384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.546006 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f31164-54a3-49c2-9b22-2406753fba45 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.556607 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4438/8910] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:54:39.560747 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.571235 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd19a96-6c95-46e9-b4c6-5cd05b12fc6e admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.575910 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.576540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.576821 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.577092 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] PATH_INFO: `/v3/projects/59500d959c9f445eb7b4bb07c464cbb4/users/6751185089fc469eb6d5db2e13058d15/roles/0586b2548ccb452b89a7c40125c21137` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.592564 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59500d959c9f445eb7b4bb07c464cbb4, user_id=6751185089fc469eb6d5db2e13058d15, role_id=0586b2548ccb452b89a7c40125c21137)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.595236 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.679515 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4473/8911] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:54:39 2022] PUT /identity/v3/projects/59500d959c9f445eb7b4bb07c464cbb4/users/6751185089fc469eb6d5db2e13058d15/roles/0586b2548ccb452b89a7c40125c21137 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:39.684486 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5f01-9e0c-4aa8-9ba4-494d11399ef1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.684767 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5f01-9e0c-4aa8-9ba4-494d11399ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.685039 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5f01-9e0c-4aa8-9ba4-494d11399ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.705115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-141d5f01-9e0c-4aa8-9ba4-494d11399ef1 None None] MFA Rules not processed for user `4a27d1c574be440baaae707174fd41c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:39.706366 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-141d5f01-9e0c-4aa8-9ba4-494d11399ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:39.765065 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4439/8912] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:54:39.774960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:39.777202 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:39.833423 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002164c-9d9e-4ae2-a7f7-76c88bac6d40 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:39.837217 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:39.837853 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:39.838139 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:39.838410 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:39.847475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:39.848827 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:39.858152 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4474/8913] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 30 02:54:45.098260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.098841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.098841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.138169 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] MFA Rules not processed for user `6751185089fc469eb6d5db2e13058d15`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:45.139440 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:45.154444 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:45.212796 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4440/8914] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:54:45.217240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.227514 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4351f-25d2-41c9-b6bd-361e97ec03c9 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.232440 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.233046 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.233517 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.233790 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] PATH_INFO: `/v3/projects` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.234523 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.236441 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.314746 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:45.322583 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4475/8915] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 30 02:54:45 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 30 02:54:45.326763 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.338262 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73476ab7-825b-43a4-9305-97cfc68ad5d3 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.396487 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.397140 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.397444 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.397715 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] PATH_INFO: `/v3/users` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.398342 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.400241 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.506313 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4441/8916] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 30 02:54:45 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 30 02:54:45.510258 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.520900 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b1bfa-0210-4749-91d3-31070847464b admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.525490 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.526376 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.526656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.526928 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.527561 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.529153 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.541326 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4476/8917] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:54:45.545618 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.556265 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae8113-a9e3-4729-a0ea-72f9807190af admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.560926 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.561589 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.561871 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.562141 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] PATH_INFO: `/v3/projects/9a922e2954d1452095308a65fd36df35/users/65617a19237c442991a89dd574709e96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.576612 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a922e2954d1452095308a65fd36df35, user_id=65617a19237c442991a89dd574709e96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.579193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.663648 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4442/8918] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:54:45 2022] PUT /identity/v3/projects/9a922e2954d1452095308a65fd36df35/users/65617a19237c442991a89dd574709e96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:54:45.667578 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.677672 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4afa4-14b2-4acf-b09a-8aaf2ed18380 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.732589 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.733182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.733491 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.733762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] PATH_INFO: `/v3/roles` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.734390 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.735973 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3212-d322-4d4b-bb1f-ccd732526804 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.746232 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4477/8919] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 30 02:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 30 02:54:45.750378 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:45.760896 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9127-c1fa-48fd-a596-852411588904 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:45.765509 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:45.766149 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:45.766426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:45.766694 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] PATH_INFO: `/v3/projects/9a922e2954d1452095308a65fd36df35/users/65617a19237c442991a89dd574709e96/roles/2be61dd3a1dd4c158a4acc57cb37fb15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:45.768625 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a922e2954d1452095308a65fd36df35, user_id=65617a19237c442991a89dd574709e96, role_id=2be61dd3a1dd4c158a4acc57cb37fb15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:45.771260 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:45.782271 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4443/8920] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 30 02:54:45 2022] PUT /identity/v3/projects/9a922e2954d1452095308a65fd36df35/users/65617a19237c442991a89dd574709e96/roles/2be61dd3a1dd4c158a4acc57cb37fb15 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 30 02:54:51.482560 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda3c8-64a5-461f-8628-9f66cd8ee306 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:51.483068 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda3c8-64a5-461f-8628-9f66cd8ee306 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:51.483240 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eda3c8-64a5-461f-8628-9f66cd8ee306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:51.513464 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-22eda3c8-64a5-461f-8628-9f66cd8ee306 None None] MFA Rules not processed for user `65617a19237c442991a89dd574709e96`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:51.514793 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-22eda3c8-64a5-461f-8628-9f66cd8ee306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:51.593539 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4478/8921] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:54:51.610266 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:51.612146 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:51.692720 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5ea59-fed0-45ff-ac2e-eb34d20639fd admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:51.698798 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:51.699424 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:51.699701 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:51.699975 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:51.704474 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:51.759939 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:51.761601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:51.771092 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4444/8922] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:54.513242 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:54.513819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:54.513819 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:54.534675 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] MFA Rules not processed for user `6751185089fc469eb6d5db2e13058d15`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:54:54.536228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:54.545043 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4479/8923] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:54:54.904348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:54.905846 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:54.969941 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14b92-7009-4298-b6ab-34b6fd9e42d9 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:54.973627 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:54.974408 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:54.974803 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:54.975083 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:54.976915 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:54.987492 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:54.991553 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:54.998324 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4445/8924] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:55.417316 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:55.418736 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:55.496721 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=100 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:54:55.523580 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ce4d-dec2-4847-9740-fecb9b30e397 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:55.529231 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:55.529859 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:55.530137 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:55.530411 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:55.532186 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:55.544354 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:55.545951 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:55.555500 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4480/8925] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:54:58.768413 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:54:58.778268 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfeb54-2729-4d09-bfad-fb3e37b59d9d service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:54:58.782782 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:54:58.783535 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:54:58.783891 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:54:58.784291 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:54:58.786631 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:54:58.797832 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:54:58.799273 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:54:58.808358 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4446/8926] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:54:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:55:05.551509 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=13 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:08.529378 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:55:08.538802 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffe7cf-171d-484b-a9b4-27c216754434 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:55:08.542567 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:55:08.543155 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:55:08.543432 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:55:08.543767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:55:08.552805 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:55:08.554237 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:55:08.564173 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4481/8927] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:55:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:55:08.805591 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=57 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:10.381587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:55:10.383251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:55:10.399226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97fc84-6391-4fcb-a78c-c270966115f1 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:55:10.405874 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:55:10.406483 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:55:10.406764 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:55:10.407036 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:55:10.408841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:55:10.424594 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:55:10.426217 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:55:10.437537 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4447/8928] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:55:18.560049 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:20.432987 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:55:58.275945 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:55:58.277327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:55:58.291890 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fc9bb-7242-4d49-86e7-4cff3f272237 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:55:58.296766 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:55:58.297358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:55:58.297653 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:55:58.297921 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:55:58.299537 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:55:58.311219 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:55:58.312775 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca09cd-8538-4b48-a61e-42940588dbff service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:55:58.322534 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4482/8929] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:55:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:56:08.318410 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:56:48.458587 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:56:48.469731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22aba7-239a-4a63-9b85-4756e8703929 service nova] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:56:48.475251 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:56:48.475842 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:56:48.476121 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:56:48.476395 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:56:48.478136 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:56:48.490103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:56:48.491677 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:56:48.501391 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4448/8930] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:56:58.497377 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:07.747415 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269252-345e-43fc-87e0-a6790ae5ad15 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:07.748021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269252-345e-43fc-87e0-a6790ae5ad15 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:07.748021 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269252-345e-43fc-87e0-a6790ae5ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:07.812111 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-65269252-345e-43fc-87e0-a6790ae5ad15 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:57:07.813366 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-65269252-345e-43fc-87e0-a6790ae5ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:07.887207 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4483/8931] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:57:08.040731 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:57:08.042168 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:08.130116 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fb581-4fff-49b3-b77d-646eb4f03fc5 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:57:08.135021 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:57:08.135620 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:08.135902 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:08.136172 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:08.144796 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:57:08.146426 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:57:08.154909 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4449/8932] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:57:17.884105 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=47 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:18.151589 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=41 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:18.969468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:18.969943 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:18.970023 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:18.989449 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] MFA Rules not processed for user `6751185089fc469eb6d5db2e13058d15`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:57:18.990583 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:18.997372 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4484/8933] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 30 02:57:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:57:19.320665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:57:19.330046 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57d80b-9375-4adf-9678-f1d8d97c3fe1 service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:57:19.333537 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:57:19.334128 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:19.334403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:19.334673 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:19.336359 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:19.346506 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:57:19.347917 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c985e-b2f4-4c5b-96e4-8e792d7bd11a service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:57:19.356382 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4450/8934] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:57:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:57:21.334740 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:57:21.348902 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f1581-c8d1-41ba-987e-8bbdd5f7344b None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:57:21.354941 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:57:21.355573 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:21.355852 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:21.356131 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:21.357956 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:21.383195 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:57:21.384783 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:57:21.396033 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4485/8935] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:57:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:57:22.091114 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:22.091575 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:22.091841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:22.112778 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:57:22.114103 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:57:22.121722 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4451/8936] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:57:22.134442 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:57:22.145656 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05b633-be21-4317-8c24-516425e31c30 service nova] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:57:22.151097 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:57:22.151634 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:57:22.151939 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:57:22.152211 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:57:22.161165 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:57:22.163065 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dda485-4efa-44f7-97e8-40cfe305a169 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:57:22.171819 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4486/8937] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:57:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:57:32.105637 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=9 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:57:32.168064 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=20 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:02.970756 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:02.980470 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8c888-9074-49a3-bab0-4682013b1b37 None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:02.984270 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:02.984876 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:02.985156 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:02.985465 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:02.987687 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:02.997117 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:02.998615 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:03.007062 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4452/8938] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:13.003604 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:13.223854 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a7b1-0d4f-499d-b877-ec7d31a58520 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:13.224358 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a7b1-0d4f-499d-b877-ec7d31a58520 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:13.224450 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a7b1-0d4f-499d-b877-ec7d31a58520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:13.243468 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-e981a7b1-0d4f-499d-b877-ec7d31a58520 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:59:13.247107 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e981a7b1-0d4f-499d-b877-ec7d31a58520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:13.251910 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4487/8939] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 30 02:59:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:59:13.291718 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:13.304259 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee9-fbee-4402-a142-814b0c491a01 service neutron] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:13.309191 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:13.309817 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:13.310101 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:13.310374 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:13.318828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:13.320385 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:13.328513 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4453/8940] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:59:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:59:23.238106 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:23.325089 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=6 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:24.138922 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] REQUEST_METHOD: `POST` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:24.139206 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:24.139475 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:24.160690 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.auth.core [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82035) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:59:24.161905 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:24.168927 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4488/8941] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:59:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:59:24.181403 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:24.192293 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda3f4a-2a68-4d24-b70b-cdaaa8b280fa service swift] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:24.197233 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:24.197841 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:24.198115 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:24.198380 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:24.206680 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:24.208226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d09345-37bf-44dc-9ddc-96ea25da1352 service swift] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:24.216097 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4454/8942] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:59:26.375797 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:26.385881 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879ae08-1885-4cc4-806e-a273fc059039 None None] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:26.389901 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:26.390532 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:26.390814 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:26.391082 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:26.392872 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:26.407482 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:26.408986 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:26.420568 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4489/8943] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:27.619784 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b374e7-5d83-4376-a1ff-5b87c9418ec7 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:27.620338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b374e7-5d83-4376-a1ff-5b87c9418ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:27.620338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b374e7-5d83-4376-a1ff-5b87c9418ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:27.669049 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-37b374e7-5d83-4376-a1ff-5b87c9418ec7 None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:59:27.670325 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-37b374e7-5d83-4376-a1ff-5b87c9418ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:27.677442 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4455/8944] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 02:59:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 30 02:59:27.686321 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:27.695327 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe512a7-1fb1-4c26-8b94-c6b67e1b75ed service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:27.698835 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:27.699425 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:27.699702 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:27.699972 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:27.701707 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:27.714772 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:27.716205 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:27.726905 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4490/8945] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:30.072368 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:30.072828 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:30.072950 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:30.092223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] MFA Rules not processed for user `9833a132beb6400aa12dd449c3bca42c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:59:30.093409 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:30.100929 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4456/8946] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 30 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:59:30.112780 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:30.123767 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d16f5c-605f-47a9-92d3-c95f02d43736 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:30.128643 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88425fb345824272be839024c9316741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:30.129228 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:30.129541 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:30.129816 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:30.137743 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:30.139288 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:30.148018 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4491/8947] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 30 02:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 30 02:59:34.918223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:34.932536 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c4ec8-8607-48d9-be51-9e4a14c90f0b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:34.938223 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1449e0ef893c420e93cf26910f4a6a1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:34.938830 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:34.939109 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:34.939384 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:34.941292 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:34.953636 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:34.957977 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0bba4-3a63-450b-be55-03f2a074186c service nova] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:34.966242 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4457/8948] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:39.848787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:39.860787 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088a74-391d-4856-9b93-3db65d5098e7 service swift] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:39.866556 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:39.867158 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:39.867436 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:39.867705 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:39.869557 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:39.882483 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:39.884098 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:39.895677 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4492/8949] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:40.296226 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:40.296656 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:40.296786 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:40.317154 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] MFA Rules not processed for user `85f46542ac5a496285440fb9421b1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 02:59:40.318382 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:40.324749 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4458/8950] 10.222.0.13 () {58 vars in 1062 bytes} [Sun Oct 30 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 02:59:40.331535 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:40.340496 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95fd7-4c38-4c27-829e-c66533becfe4 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:40.344254 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f46542ac5a496285440fb9421b1fab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:40.344836 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:40.345157 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:40.345458 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:40.407348 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:40.408879 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:40.423338 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4493/8951] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 02:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 02:59:43.781622 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:43.795882 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029fea8-8edc-4190-a6cd-0babbda5267b None None] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:43.801174 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:43.801823 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:43.802097 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:43.802404 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] PATH_INFO: `/v3/users/6751185089fc469eb6d5db2e13058d15` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:43.803590 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6751185089fc469eb6d5db2e13058d15)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:43.805601 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:43.948472 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6751185089fc469eb6d5db2e13058d15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:43.949077 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6751185089fc469eb6d5db2e13058d15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:43.957632 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6751185089fc469eb6d5db2e13058d15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:43.958348 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6751185089fc469eb6d5db2e13058d15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.049985 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6751185089fc469eb6d5db2e13058d15'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.070947 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4459/8952] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:59:43 2022] DELETE /identity/v3/users/6751185089fc469eb6d5db2e13058d15 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:59:44.296964 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:44.310398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27547b6-f796-4880-8398-39131578ba29 service neutron] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:44.366904 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:44.367530 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:44.367807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:44.368078 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] PATH_INFO: `/v3/projects/59500d959c9f445eb7b4bb07c464cbb4` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:44.369222 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=59500d959c9f445eb7b4bb07c464cbb4)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:44.371144 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:44.493709 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:44.502757 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59500d959c9f445eb7b4bb07c464cbb4', 'request_id': 'req-3b452f55-b229-49fa-923b-3714ed7f49ad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.563256 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59500d959c9f445eb7b4bb07c464cbb4', 'request_id': 'req-3b452f55-b229-49fa-923b-3714ed7f49ad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.569861 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59500d959c9f445eb7b4bb07c464cbb4', 'request_id': 'req-3b452f55-b229-49fa-923b-3714ed7f49ad'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.580342 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] The token cache is being invalidate because project 59500d959c9f445eb7b4bb07c464cbb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:59:44.580626 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.581264 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.582773 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4494/8953] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:59:44 2022] DELETE /identity/v3/projects/59500d959c9f445eb7b4bb07c464cbb4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:59:44.586913 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:44.588321 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:44.602147 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b19b83-de3b-44d0-973c-02c70c4e08e5 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:44.657387 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:44.658009 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:44.658827 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:44.659108 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] PATH_INFO: `/v3/users/65617a19237c442991a89dd574709e96` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:44.660218 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65617a19237c442991a89dd574709e96)` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:44.662161 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:44.666704 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:44.834138 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65617a19237c442991a89dd574709e96'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.834805 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65617a19237c442991a89dd574709e96'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.841999 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65617a19237c442991a89dd574709e96'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.842641 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65617a19237c442991a89dd574709e96'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.912345 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.notifications [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65617a19237c442991a89dd574709e96'} {{(pid=82036) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:44.930622 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4460/8954] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 30 02:59:44 2022] DELETE /identity/v3/users/65617a19237c442991a89dd574709e96 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:59:45.171506 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 02:59:45.173080 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 02:59:45.186855 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b452f55-b229-49fa-923b-3714ed7f49ad admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 02:59:45.245534 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a27d1c574be440baaae707174fd41c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4f4b3ee17464dd9b78ef48e253d6687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 02:59:45.255261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 02:59:45.255261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 02:59:45.255261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] PATH_INFO: `/v3/projects/9a922e2954d1452095308a65fd36df35` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 02:59:45.255261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a922e2954d1452095308a65fd36df35)` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 02:59:45.255261 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 02:59:45.352480 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a922e2954d1452095308a65fd36df35', 'request_id': 'req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:45.403558 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a922e2954d1452095308a65fd36df35', 'request_id': 'req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:45.410420 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a922e2954d1452095308a65fd36df35', 'request_id': 'req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2'} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:45.425540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] The token cache is being invalidate because project 9a922e2954d1452095308a65fd36df35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82035) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 30 02:59:45.425540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:45.425540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.notifications [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82035) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 30 02:59:45.425540 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4495/8955] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 30 02:59:45 2022] DELETE /identity/v3/projects/9a922e2954d1452095308a65fd36df35 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 30 02:59:54.927013 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 02:59:55.417638 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:01:00.233901 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:01:00.237263 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:01:00.304119 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4823100-8929-43c1-94a0-0a5bfd218ef0 admin admin] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:01:00.362312 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:01:00.362914 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:01:00.363193 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:01:00.363493 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:01:00.365192 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:01:00.376170 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:01:00.377759 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:01:00.387380 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4461/8956] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:01:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:01:10.383276 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=58 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:01:55.401325 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:01:55.402728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:01:55.417662 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3c56-a48b-4d1d-95c8-7ccd1213fce2 admin admin] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:01:55.422599 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:01:55.423182 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:01:55.423477 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:01:55.423728 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:01:55.425398 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.fernet_utils [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82035) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:01:55.436684 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:01:55.438267 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:01:55.447826 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4496/8957] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:02:05.443772 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=6 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:06:05.251243 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] Authenticating user token {{(pid=82036) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:06:05.312349 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f621-6dc7-4536-8e95-bda9bb607846 service placement] Validating token access rules against request {{(pid=82036) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:06:05.317410 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82036) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:06:05.318005 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] REQUEST_METHOD: `GET` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:06:05.318283 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:06:05.318559 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:06:05.326900 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:06:05.328460 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a8f89-00c9-4f80-93cb-5967652cda78 service placement] RBAC: Authorization granted {{(pid=82036) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:06:05.338128 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4462/8958] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:06:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:06:15.334018 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=27 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:07:00.406416 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:07:00.463807 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828d102-2890-49f6-bf8c-beeb14fad340 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:07:00.468858 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:07:00.469478 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:07:00.469758 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:07:00.470027 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:07:00.478292 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:07:00.479863 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:07:00.489982 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4497/8959] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:07:10.485938 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=27 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:08:01.400961 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25099de-0644-4751-be29-28edc7fa1cc1 None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:08:01.401574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25099de-0644-4751-be29-28edc7fa1cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:08:01.401574 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25099de-0644-4751-be29-28edc7fa1cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:08:01.470338 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-a25099de-0644-4751-be29-28edc7fa1cc1 None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 03:08:01.471462 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-a25099de-0644-4751-be29-28edc7fa1cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:08:01.479999 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4463/8960] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Oct 30 03:08:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 03:08:01.504018 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:08:01.514602 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e4b-fe5e-4bf2-bd5d-ba9a4751faf2 service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:08:01.520183 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:08:01.520762 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:08:01.521035 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:08:01.521302 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:08:01.529357 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:08:01.530914 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:08:01.540311 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4498/8961] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:08:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:08:07.228474 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688927f-6daf-47d9-b223-7efa18faa24f None None] REQUEST_METHOD: `POST` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:08:07.229008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688927f-6daf-47d9-b223-7efa18faa24f None None] SCRIPT_NAME: `/identity` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:08:07.229008 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688927f-6daf-47d9-b223-7efa18faa24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82036) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:08:07.248665 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.auth.core [None req-8688927f-6daf-47d9-b223-7efa18faa24f None None] MFA Rules not processed for user `897aa8bacc3b47ef90b104754bb2817c`. Rule list: `[]` (Enabled: `True`). {{(pid=82036) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 30 03:08:07.249878 n-d-master-1 devstack@keystone.service[82036]: DEBUG keystone.common.fernet_utils [None req-8688927f-6daf-47d9-b223-7efa18faa24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82036) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 30 03:08:07.258907 n-d-master-1 devstack@keystone.service[82036]: [pid: 82036|app: 0|req: 4464/8962] 10.222.0.46 () {58 vars in 1015 bytes} [Sun Oct 30 03:08:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 30 03:08:07.294540 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] Authenticating user token {{(pid=82035) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 30 03:08:07.305114 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1ccf4-1d4e-48cf-81ec-549c7229d1cd service placement] Validating token access rules against request {{(pid=82035) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 30 03:08:07.311052 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '897aa8bacc3b47ef90b104754bb2817c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '657aeb3031984f5f88426c3f9f385d20', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82035) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 30 03:08:07.311681 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] REQUEST_METHOD: `GET` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 30 03:08:07.311960 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 30 03:08:07.312229 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82035) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 30 03:08:07.321487 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 30 03:08:07.323060 n-d-master-1 devstack@keystone.service[82035]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f5b1d-92be-4f47-b71a-ca74e68836e9 service placement] RBAC: Authorization granted {{(pid=82035) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 30 03:08:07.333421 n-d-master-1 devstack@keystone.service[82035]: [pid: 82035|app: 0|req: 4499/8963] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 30 03:08:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 30 03:08:17.243003 n-d-master-1 devstack@keystone.service[82036]: DEBUG dbcounter [-] [82036] Writing DB stats keystone:SELECT=25 {{(pid=82036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 03:08:17.328636 n-d-master-1 devstack@keystone.service[82035]: DEBUG dbcounter [-] [82035] Writing DB stats keystone:SELECT=12 {{(pid=82035) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}